My gut agrees with you that LLMs shouldn't do this well on a specialty domain.
But I think there's also the bitter lesson to be learned here: many times people say LLMs won't do well on a task, they are often surprised either immediately or a few months later.
Overall not sure what to expect, but fine tuning experiments would be interesting regardless.
But I think there's also the bitter lesson to be learned here: many times people say LLMs won't do well on a task, they are often surprised either immediately or a few months later.
Overall not sure what to expect, but fine tuning experiments would be interesting regardless.