Well music is arguably its own language. You wouldn't expect a monolingual English speaker to speak fluent Chinese. In the same way you can't expect a musically untrained person (or model) to "speak music".
But if you took an LLM size neural network and trained it on all the music in the world - I dare say you may get some interesting results.
But if you took an LLM size neural network and trained it on all the music in the world - I dare say you may get some interesting results.