Comment Comment by startupsfail For the local model it forces valid json structure and formatting tokens are being produced by code rather than generated by an LLM. parent startupsfail 3 years ago