Maybe the LLM is just doing interpolation rather than regression?
I've played with math examples (a while back, not with recent models) where they make errors, but seem to get the magnitude right, so perhaps easy to find the closest points (or roughly closest) to interpolate between.
I've played with math examples (a while back, not with recent models) where they make errors, but seem to get the magnitude right, so perhaps easy to find the closest points (or roughly closest) to interpolate between.