Comment by lukebaker

The compile happens in the setup of the benchmark. So the actual benchmark is testing the rendering speed of the compiled templates.