How foreign is the language - was it likely included in pre training to some degree? Does it use grammar, syllables, and logic similiar to one of the large languages?
Your approach assumes there is an easy to learn mapping between context in your target language and concepts in a prettained llm.
Can you get more text written in the low resources language?
Can you get more text written in the low resources language?
Are you ok to share the name of the language?