Hey I work at Adept and helped make this!
Happy to answer questions.
The thing I think is especially neat/notable is how simple you can make the model architecture while still getting good performance.
I expect we'll continue to see bits of these models get deleted in the next few years
Note that you can get the model weights on HuggingFace here: https://huggingface.co/adept/fuyu-8b