Yeah sorry, it is still quite slow due to the traffic. It'd be much faster and robust to run locally via git cloning the repo and adding your own API key as shown in the README
For using other models it should be pretty straightforward to just modify the api functions to suit whatever model is being used -- would be fun to try out custom models! (Feel free to pull request the repo btw if you do modify such things)
An idea we had initially was actually to use an open-source model and fine-tune it using the DB of responses (including the hidden violation bot and refinement bot outputs) collected from people playing the game. That way the game could get better and better over time as more user data gets collected.
Disclaimer we actually did implement this via postgres and now have thousands of responses from players in case anyone wants to follow through on this idea.
For using other models it should be pretty straightforward to just modify the api functions to suit whatever model is being used -- would be fun to try out custom models! (Feel free to pull request the repo btw if you do modify such things)
An idea we had initially was actually to use an open-source model and fine-tune it using the DB of responses (including the hidden violation bot and refinement bot outputs) collected from people playing the game. That way the game could get better and better over time as more user data gets collected.
Disclaimer we actually did implement this via postgres and now have thousands of responses from players in case anyone wants to follow through on this idea.