Comment by physicles

What stack do you use for that home inference? I’m rolling my own with gemma4, but even with Claude helping with the implementation it’s a lot of moving pieces to figure out.