CupOfJava
Joined 9 years ago
Karma
89
Submissions
33
Member since
May 26
Joined 9 years ago
How much did it improve load times? Why do you think syntect was faster than what you tried previously?
You can make 3x there? Why are you still here then? Instead of making up numbers, here's a more balanced opinion on salary differences between Waterloo and Silicon Valley: https://medium.com/@srlake/debunking-the-myth-of-higher-pay-...
Long-term structure MuseNet uses the recompute and optimized kernels of Sparse Transformer to train a 72-layer network with 24 attention heads—with full attention over a context of 4096 tokens. This long context may be one reason why it is able to remember long term structure in a piece