Comment by Aerroon

A bit related: open weights models are basically time capsules. These models have a knowledge cut off point and essentially forever live in that time.