Comment by tsunamit

Good point. It's logical to expect that the dataset format wouldn't stay the same over time e.g. agents, multimodalities, these forms you brought up. I could see it growing into supporting many common dataset formats or more niche formats if needed.