> 2. I'd argue that it'll take a long time to set up a company anywhere when you don't know the customs of the country. Of course, language is an additional barrier, but I'm pretty sure I'd manage to set up a startup quickier in France than in the US, just because I'm French. Same for you in your own country. Big deal.
No, that's objectively false:
http://www.doingbusiness.org/rankings
France isn't that bad, but it's not as good as it could be.