Raising prices = Demand > Supply. You can either try to curb the demand (by e.g. creating incentives for companies to build offices elsewhere, move government bureaucracy somewhere else, etc.) or improve the supply by facilitating new construction, which in most places on earth is limited by, again, local government restrictions.
edits: grammar