Comment by waldarbeiter

There is actually a whole lot of research around the "use less data" called data pruning. The goal in a lot of cases there is basically to achieve the same performance with less data. For example [1] received quite some attention in the past.

[1] https://arxiv.org/abs/2206.14486