cocktailpeanut
Joined 3 years ago
Karma
508
Submissions
20
Member since
Mar 12
Recent submissions
Comment · 3 years ago
Comment · 3 years ago
UPDATE 2:
Thanks to all the pull requests, we've managed to solve most of these issues in the most optimal manner.
Version 0.1.0 released: https://news.ycombinator.com/item?id=35143171
Comment · 3 years ago
Hi HN!
I posted Dalai on HN yesterday (https://news.ycombinator.com/item?id=35127020) and I have been spending the last 24 hours trying to listen to all the feedback and incorporate all the incoming pull requests and make a new release.
1. If you had trouble installing and they were just not installing for some reason, make sure you try this version.
2. If you had trouble working with models other than the 7B one, yes it was my fault, only the 7B one was working, and now this has been fixed, and now ALL models should work with this new version
3. Use existing workspace: If you already have an existing llama.cpp workspace folder, now Dalai can connect to it programmatically instead of creating its own repository under ~/dalai. Remember, while the easy installation is important, the most important aspect of Dalai is that it lets you interact with llama.cpp with JavaScript. So even if you already have an existing llama.cpp and just want to play with it using JS, you can use Dalai.
4. New Web UI
Finally, like 90% of the code for this release came from people other than myself and it's amazing how this happened. Thank you everyone who contributed.
There are some further issues I think need to be addressed. If you have any feedback that hasn't been addressed with this release, please let me know!
and if you want to follow along with the development, you can find me on Twitter https://twitter.com/cocktailpeanut
As soon as I saw Alpaca.cpp on the front page, I started working on Dalai's JavaScript integration, and today I'm happy to release Dalai Alpaca.
Dalai is now kind of like a package manager of sorts, just one command to install LLaMA or Alpaca, and all integrated with the web UI and the ultra-hackable API. All you need to do is one command: "npx dalai install alpaca 7b"
Also, been fixing a lot of bugs since last time so if you had trouble installing, I recommend you try again.
Officially supports Windows, Mac and Linux. Still some quirks here and there but mostly works and happy to figure out if you are having trouble. This time it's much simpler to use because it only takes up like 4.2GB. Appreciate any feedback!