I just reached out to Huggingface about this to figure out why this happened all of a sudden. Pretty sure this was a hug of death.
I rebuilt the app just now and it is working... for now.
At the moment, I am not taking advantage of certain things I should be doing (e.g. better non-deterministic decoding, caching) that will most likely help avoid this hug of death. I may also need to host the model in the same repo.
I rebuilt the app just now and it is working... for now.
At the moment, I am not taking advantage of certain things I should be doing (e.g. better non-deterministic decoding, caching) that will most likely help avoid this hug of death. I may also need to host the model in the same repo.