h-bradio
Joined 3 years ago
Joined 3 years ago
A tutorial and demo video are in the link.
I saw a post on HN that introduced me to Whisper.cpp. I’ve been excited to see so many AI tools start to support my M3 Macbook/Metal/whatever so I can put my 96GB of memory to use.
I don’t have the timing windows tuned perfectly. Feel free to play with it!
To make the LLMs able to use tools, I had to configure them in the Zed settings like this: https://gist.github.com/hbradio/fa4b456658a8d250e6ccc69ae9b3...
Also, I had to go into LM Studio and increase the max context size for each model I wanted to use in Zed. Otherwise it gives a parsing error on the response. I set it to the max allowable value.
I start LM Studio, start the LM Studio server, then go to Zeds AI config and tell it to connect to LM Studio. I put it in Agent mode, and it seems to work!
I don't know much about temperature, and I didn't use any other system prompt.
Good luck!
(Please focus on his discussion of PE licensure, not on what developers should call themselves)
He says some software can be designed in our usual way: informal, fast, iterative, democratized, agile. But more and more software needs to be designed like a PE designing a public bridge: carefully, to stand strong for 100 years.