Ask HN: Challenges with Buying a Home?

Whether you're looking to buy your first / a new home, or interested in buying real estate, what has been your biggest hurdle?

Do you struggle with the decision financially? Do you feel unprepared? Are real estate agents not helpful enough?