Comment by EGreg

So why not make a service for arxiv papers or any other source of resources and have experts critique them?

Maybe there is already a good source of experts on Quora or something. Or start a new site where experts are invited.