Is consistency alone good design?

Or can you get away by being bad in a consistent way? For ex. if a button which does not look like a button, but is probably the only kind of button in the application. Links which are not underlined. Thoughts?