Comment by francoisfleuret

This is 300M parameters model (1/1300th of the big llama-3) trained with 5M frames with 12 days of a GTX4090.

This is what a big tech company was doing in 2015.

The same stuff at industrial scale à la large LLMs would be absolutely mind blowing.