Comment Comment by fc417fc802 fast != practicalYou can get lots of tokens per second on the CPU if the entire network fits in L1 cache. Unfortunately the sub 64 kiB model segment isn't looking so hot.But actually ... 3000? Did GP misplace one or two zeros there? parent fc417fc802 8 months ago
You can get lots of tokens per second on the CPU if the entire network fits in L1 cache. Unfortunately the sub 64 kiB model segment isn't looking so hot.
But actually ... 3000? Did GP misplace one or two zeros there?