hassaanr

Yes but mostly not. Modern MacOS is based off of NeXTSTEP OS from the NeXT acquisition, not classic.

You’re right, but this poses a separate issue as the providers then do FP4 PTQ, which is quite lossy. Reduces the model size and optimizes for Blackwells at the (imo severe) cost of performance.

While cool, quantization to FP4 is practically never lossless in actual use. A lot of providers are advertising high TPS on Kimi and GLM, but the models are functionally lobotomized and no longer close to frontier quality. Would love to see this not be true.

Incredibly cool project and fantastic write up!

In love with projects that are done solely because 'why the hell not'. Fantastic writeup and work.

engine braking does not have any effect on the clutch, other than while downshifting, which if you're blipping/rev-matching has practically no effect

Also to add- the one service that was fast enough on the LLM side was Cerebras. The time to first token (ttft) is incredibly fast (200-300ms) and the t/s is 2000t/s for 8B- combined making for a great conversational experience.

Please try it again when you get the chance! We were dealing with high load the past few days and are good to go again! Re: head movements, I totally agree; natural head movements are really important to make it feel more natural. The issue is controllability today, which is something we're working on as well!

Oh no- what issue were you facing with Hassaan bot? It might just have been getting the hug of death. Hope you can try again!

If you use the demo on the website you don’t have to enter an email, tavus.io

Thanks friend! Great to hear- let us know how we can help in any way :)

This is definitely a good idea! I think the hard part is making it contextual and relevant to the last question/response, in which case the LLM comes into the equation again. Something we're looking at though!

Totally- as programmers we're so used to communicating via text and meeting computers where they are- it's easy for us. However, we're the minority in the world! I think most people who are not us want to communicate like they do with others.

This is good feedback. We have a base subscription fee to cover ongoing costs of maintaining the models/replicas you create and other elements, otherwise it's all on-demand.