Comment by aluxian

Thought the same. Ollama has a JSON mode, it's the closest I got to using it for function calling:

  brew install ollama
  brew services start ollama
  curl http://localhost:11434/api/generate -d '{
    "model": "phi:2.7b-chat-v2-q5_K_M",
    "prompt": "Generate a JSON object that models a list of products",
    "raw": true, "format": "json",
    "stream": false
  }' | jq

If you want to keep in touch / share intel: linkedin.com /in/ aluxian or `me` at my username dot com