Ask HN: Performance gain of microprocessors

I am recently learning the basics of computer architecture with a slight remark on parallel computing. The whole design seems so terrible complex to me that I hardly believe in straight performance gains in the near future. Especially regarding GPUs / parallel computing. Is my impression wrong ? Are there any good, complete and up-to-date sources to this topic ?