chown
Joined 16 years ago
Karma
267
Submissions
90
Member since
May 16
Recent submissions
Comment · 2 months ago
My biggest frustration with Anthropic with Opus being too verbose is that they tried to put this on users. It’s pretty clear that Anthropic employees don’t use the day-to-day models that everybody else use. They have access to the next tier model so they don’t see the problems that everybody else is dealing with.
Comment · 1 year ago
Shameless plug: if someone wants to try it in a nice ui, you could give Msty[1] a try. It's private and local.
[1]: https://msty.ai
Comment · 1 year ago
Save text as JSON as comments but the file itself is a PNG so that you can use it as an image (like previewing it) as they would ignore the comments. However, the OP’s editor can load the file back, parse the comments, and get the original data and continue to edit. Just one file to maintain. Quite clever actually.
Comment · 1 year ago
I totally agree with this. I wanted to make it really easy for non-technical users with an app that hid all the complexities. I basically just wanted to embed the engine without making users open their terminal, let alone make them configure. I started with llama.cpp amd almost gave up on the idea before I stumbled upon Ollama, which made the app happen[1]
There are many flaws in Ollama but it makes many things much easier esp. if you don’t want to bother building and configuring. They do take a long time to merge any PRs though. One of my PRs has been waiting for 8 months and there was this another PR about KV cache quantization that took them 6 months to merge.
[1]: https://msty.app
Comment · 1 year ago
I wanted to present it as - “Msty As x Alternative”. But I think maybe I like Compare better. I will think about changing it. Thank you for the suggestion.
Comment · 1 year ago
If anyone is looking for a one click solution without having to have a Docker running, try Msty - something that I have been working on for almost a year. Has RAG and Web Search built in among others and can connect to your Obsidian vaults as well.
Comment · 2 years ago
I am looking for a 55” 4K OLED. Do you have a recommendation? And are there any technical caveats with it? (I use a Mac primarily). Thank you
Comment · 2 years ago
I am working on making using LLMs easy for everyone. Focus is to make users productive rather than having them configuring their environment to death. Wrote this app for my wife who, even as a smart software engineer, was getting overwhelmed with AI and LLMs.
Comment · 2 years ago
I've recently started using Arc mostly out of FOMO and there are parts that I like and parts I don't. I have been a Firefox user for a long time before that so glad to see something similar that's one of the major priorities is the aesthetics and I very much appreciate that.
I tried to use it on my macOS Apple Silicone and got an error about it being broken and macOS suggested to trash it. Not sure if it is a bug issue. Will come back and try it again though to give it a second chance :)
Comment · 2 years ago
Wow! The benchmarks are truly impressive, showing significant improvements across almost all categories. It's fascinating to see how rapidly this field is evolving. If someone had told me last year that Meta would be leading the charge in open-source models, I probably wouldn't have believed them. Yet here we are, witnessing Meta's substantial contributions to AI research and democratization.
On a related note, for those interested in experimenting with large language models locally, I've been working on an app called Msty [1]. It allows you to run models like this with just one click and features a clean, functional interface. Just added support for both 8B and 70B. Still in development, but I'd appreciate any feedback.
[1]: https://msty.app
Comment · 2 years ago
If you are still looking for it, I just made it available on an app[1] that I am working on with Gemma2 support.
Comment · 2 years ago
This is a great release! If you are looking to try it locally with a great interface, I am working on an app [1] and I just pushed an update to support Gemma2.