That's really interesting. Let me know if you'd want to talk to me or Michael sometime about it. With the models we run currently, you'd really have to have a GPU to run locally and get a lot of utility. I'm curious if you have some thoughts on how to run these large language models on edge devices.
I'm wilson@ our website (trying to avoid too much spam from bots).
I'm wilson@ our website (trying to avoid too much spam from bots).