proof_by_vibes
Joined 2 years ago
Joined 2 years ago
I think the ideal mode for engaging with LLMs should be as interactive encyclopedias. They are excellent at rewarding curiosity when someone passionate about learning sits in the driver seat of this kind of tool. There is something to be said about the benefits of _active_ learning over _passive_ instruction.
Nonetheless, it's impossible to consistently discern fact from fiction when in the form of narrative. As such hallucinations are the key counterexample for why we can't have a world where LLMs can be effective instructors. Because it's one thing to be exposed to the structure of a narrative, and to read it as grammar, but you don't ever know how to _feel_ about these structures until you become tuned to another human being.
The open source model of development has encouraged the correct incentives for people to become active in identifying and fixing possible exploits in a global, communal effort.
Every server on the cloud has (by a large margin) chosen Linux as the OS to trust specifically for this reason.
The bindings are set and have a monadic interface, but there's some abstractions that still need refining/iterating: mostly I want to be able to formalize keyboard input and eventually build a tactic framework for zero-knowledge proofs.
Nonetheless, I concur that LLMs don't yet know how to translate a request stated in a prompt to a complete Lean4 interpretation. My practice so far has usually required me to first choose an existing reference file that is similar to my desired goals, and use this reference as "inspiration" for how the LLM should go about formalization.