Is it that bad to ask workers to come back 5 days a week in the office?

When did the simple request of asking people to come to the office everyday and on-time became an insult ? As a CTO, I feel very frustrated to have to justify my reasoning to my team, while I see in-office interaction as being such a compelling experience, and a big advantage when working on common projects.

Note: in these conditions, the occasional day of working from home would still be accepted.