My guess is that we underestimate how much non-Java data and context in general is needed to create a good Java coding model.
It could be true that a good Java model would be of 80-90% the size of a comparable overall coding model.
Obviously, I have no idea but I guess it’s not as simple as “just train only on Java code and reduce size to 1/10th”.
Obviously, I have no idea but I guess it’s not as simple as “just train only on Java code and reduce size to 1/10th”.