Comment by ryno364

This is really cool. But, from what I can tell, its not a huge game changer. Anyone was able to run the open weights model locally anyway. This is just higher performance.

Unless someone disagrees.