Comment by randomdrake

After a bit of research, it looks like BOINC[0] and AI Horde[1] are along the lines of what I was building. It appears NVIDIA PAIR[2] has been working on distributed inference for local networks as well.

[0] - https://boinc.berkeley.edu/

[1] - https://aihorde.net/

[2] - https://www.nvidia.com/en-us/ai-on-rtx/personal-ai-router/