xw333
Joined 16 days ago
Joined 16 days ago
To me that points to the real the step change in LLMs. They are not deterministic and they always give a result to any query. Even if the query is invalid, missing data, or has no possible logically correct answer, you still get a result.
Probably true for some definitions of me. :)
This sentence from the article really stuck out to me.
> and you write the rule down so clearly that nobody (human or otherwise) has to guess again.
Writing rules, or steps, unambiguously in a high level language and having those statements translated to lower level languages, that ultimately get executed by a machine, is what compilers do.
The commands you gave were not unambiguous at all and although an LLM would produce a result, the result would definitely be nonsense.
"make me a budget, here is 6 months of credit card receipts"
For example, a valid budget requires some knowledge of expected income...
I also coach kids and none of their moves are random in the mathematical sense. They dont play the best moves but the moves are understandable once you hear their reasoning, it's just their reasoning doesn't properly evaluate the immediate position, future shapes and transformations.
For example looking at my chess.com profile I find basically every hung piece, and I am excellent at taking advantage of pinned piece opportunities and almost never allow an imbalance due to pinned piece, but I have blind spot when it comes to clearance sacrifices both taking advantage of them and allowing them.
So I suspect a good way to approximate a human would be to bork the evaluation based on a profile and then pick from that narrowed set of candidate moves at random. Which is more or less my understanding of how the chess.com bots work
There is no easy or even single "correct" answer. Just trade-offs.
"If you ask a user what percentage of Word features they use, they will tell you 10%. But if you ask multiple users which 10% they use, they will all give you a different 10%."
I use the open source EDA tools for VLSI everyday and I do like them, especially how hackable they are, but they are very unreliable compared to the closed source tools, and that's not the highest bar.
Run time of the open source EDA tools are also very slow for designs over, say, ~250K gates. And that's an issue when in commercial designs the base unit for measuring the number of gates in a macro is megacells, i.e. 10^6 cells. Much of the effort of the commercial tools has just been keeping up with Moore's law which is not easy when many brute-force form EDA algorithms are like n^3 even with heuristics.