Do you have beefy hardware? i dream of using a local LLM, but neither my 24GB RAM M4 Air nor my PC with a RTX3080 and 16GB of RAM seem usable (yet).
i could label them usable if "prompt it and then wait for 6 minutes for it to change a single line" is deemed usable, which i don't.
spent the last weekend in a rabbit-hole of which models to use in what kind of setup, but i think with my hardware i'm just out of luck for now.
for private matters I can use Cloud AIs, but not allowed to use it for work-related matters, which is where i could use it the most. they do provide us an isolated AI environment where we can use Claude etc. for work stuff, but heavily rated (about 20 prompts per week per Claude model).
Do you have beefy hardware? i dream of using a local LLM, but neither my 24GB RAM M4 Air nor my PC with a RTX3080 and 16GB of RAM seem usable (yet).
i could label them usable if "prompt it and then wait for 6 minutes for it to change a single line" is deemed usable, which i don't.
spent the last weekend in a rabbit-hole of which models to use in what kind of setup, but i think with my hardware i'm just out of luck for now.
for private matters I can use Cloud AIs, but not allowed to use it for work-related matters, which is where i could use it the most. they do provide us an isolated AI environment where we can use Claude etc. for work stuff, but heavily rated (about 20 prompts per week per Claude model).