jpe90

I recently wrote a blog post exploring the idea of interfacing with local LLMs for ambiguous tasks like this. Doesn't that make more sense than coding the neural network yourself? Using something like llama.cpp and evaluating whether a small model solves your problem out of the box, and fine-tuning if not, then programmatically interfacing with llama.cpp via a wrapper of your choice seems more pragmatic to me.

I started blogging about stuff I've learned about that I am likely to forget down the road. It feels so good when you throw up a post, never share it, and still manage to get a thank you email for writing it years later. If you have a folder full of notes, I would recommend turning them into a blog on a rainy day.

Out of curiosity, what is your development setup for that?

Since this is Kotlin there's not really a sane way to call this from Clojure, right?

I only read the headline, so I'm going all-in on Clojure/Datomic off the bat at a new job. Half kidding.

I recently learned Fennel and cranked out a Love2D game as well. Not only that, but I discovered it’s trivial to run the game on some spare nintendo consoles I have lying around, because Lua is insanely portable.

In contrast, I spent a ton of time trying to build other lisps that are designed to be embeddable on those consoles and got nowhere.

Fennel rocks. Such a pragmatic and well designed mini-language.

I don't think CAPI works on mobile runtimes, unfortunately

I’ve been exploring this project recently, I’m having a great time with it so far. The many examples and great documentation are much appreciated. I’m very tempted to try it for some upcoming projects building workflow systems at work.

Would it be feasible to fine-tune a large, capable model (like the recent LIMA) on the source code (and maybe a few high quality libraries) of a niche language, such that it's much better at helping you write and understand it?

Imagine how many doors it would open if you could fine-tune models capable of writing language bindings for you and keeping them up to date.

> The OpenAI chat completion endpoint encourages the second-person prompting you describe, so that could be why you see it a lot.

You're talking about system prompts specifically right? And I'm assuming the "encouragement" you're referring to is coming from the conventions used in their examples rather than an explicit instruction to use second person?

Or does second person improve responses to user messages as well?

Oh that’s clever! Thanks for answering!