Comment by TYMorningCoffee

Some setups can run devstral small locally. Have you tried?

Also have you tried any other open weight models as the architect?

Third, as far as I understood, devstral was made with open hands so it might perform better there than aider out of the box.

Finally, I'm looking for local llm only setups for apple silicon 32gb and was considering devstral with open hands.