I do not agree with gnopgnip, but I think the way you are dressed might have a priming effect. There were quite a few studies conducted on this topic. But I don't think its effect is significant, and if you associate being dressed for the office with something stressful, then it might have negative effect on you.
http://en.wikipedia.org/wiki/Priming_%28psychology%29