While I'm inclined to agree with your point and I do think that some languages really are just more difficult, I think it should be pointed out that something like 54% of adults in the USA read below a sixth grade level. Many of them (about half) are functionally illiterate.
source:
https://en.m.wikipedia.org/wiki/Literacy_in_the_United_State...