One thing I find particularly interesting is that SOTA video understanding requires significantly less parameters than SOTA language understanding. Are we just overfitting way too much to language?
Also how long until SAM gets aligned to an LLM? Would be great to natively prompt it and not hackily chain through separate vision models
Also how long until SAM gets aligned to an LLM? Would be great to natively prompt it and not hackily chain through separate vision models