I worried about this too. But I think my attitude has changed after watching lots of the PBS Space Time youtube channel. They do a great job of breaking down these concepts at a level where highly interested non-physicists can get what feel like the real details without dumbing it down too much. They have good videos on many physics topics, and regularly explain new discoveries.
https://youtu.be/QLSIZg0npuA