As someone who does both hardware design (mostly high precision analog electronics) and software engineering, the difference between both fields in AI capability is striking. Models like Fable and Astra can provide lots of interesting insights into the design of specialty electronics when prompted correctly. Yet they can hardly put that knowledge to work if instructed to generate a schematic or lay out a PCB.
Of course, for readers here with a solid grasp on how LLM's operate it's not exactly surprising. Still, I feel this is exactly the kind of thing that drives home that the way we reason about (general) intelligence does not map cleanly to LLM operation, no matter how advanced the current models are.
Of course, for readers here with a solid grasp on how LLM's operate it's not exactly surprising. Still, I feel this is exactly the kind of thing that drives home that the way we reason about (general) intelligence does not map cleanly to LLM operation, no matter how advanced the current models are.