Comment

Comment by brucethemoose2

Well, this post is the second result for even running llama on Versal, so...

I think MLC-LLM (though TVM) can maybe run inference?

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton