I'm a little surprised that we haven't seen something more AI driven yet. (yes yes buzzword I know)
i.e. slice it not just into scenes but also into objects and do bitrate on that level. i.e. Face and objects in foreground get more. It seems we now have pretty small models that can do that sort of stuff (see Apple & MS ones recently) so should be feasible at scale.
I'd imagine you can also train an LLM on patterns that encoders choke on...chequered patterns etc.
i.e. slice it not just into scenes but also into objects and do bitrate on that level. i.e. Face and objects in foreground get more. It seems we now have pretty small models that can do that sort of stuff (see Apple & MS ones recently) so should be feasible at scale.
I'd imagine you can also train an LLM on patterns that encoders choke on...chequered patterns etc.