liteclient

it makes sense architecturally

they replace dot-product attention with topology-based scalar distances derived from a laplacian embedding - that effectively reduces attention scoring to a 1D energy comparison which can save memory and compute

that said, i’d treat the results with a grain of salt give there is no peer review, and benchmarks are only on 30M parameter model so far

I also recently bought liteclient.com just because it was available. Finally, decided to create a vs code extension around it; I don't even know how to make one but learnt so much in the past few weeks :)

Open to any feedback!

This is still in very early phase - plan is to make it fully featured and functional in the next few days without requiring you to sign-in just to test your APIs.