There is no such central server. The difficulty is adjusted using an algorithm that all the bitcoin clients implement. This looks at the generation times of the last 2,016 blocks and works out from that if difficulty needs to be higher or lower.
Since all clients implement the same algorithm, they all get the same difficulty value.
Since all clients implement the same algorithm, they all get the same difficulty value.