Comment by mrboatshoepants

That first bar chart showing between 15-36 tokens/second is for a 8,192 token context. Thats not nearly enough context to be useful these days