0xfaded
Joined 15 years ago
Joined 15 years ago
I was experimenting with a rather complicated backfill operation, were I had a validation script I understand and have Clod come up with the backfill script. I was running against a local prod copy, and it proposed running the actual (unfinished) backfill script against prod.
It didn't have access to the secrets and I also caught the command, but a good reminder that this stuff needs guardrails.
I never thought about it until seeing these, but line scans yield an orthographic projection in the scan direction. There was a little bit of uncanny valley being able to see parts of the front/back of the car that would have normally been compressed out occluded by perspective.
A "train of thought" can be seen as a trace of a depth first search where the preceding trace is used to guide termination and next expansion decisions. A similar concept, "taboo search", exists in classical constraint optimization where previous solutions are fit to a model that guides future expansion (but as the name "taboo" implies, away from uninteresting solutions).
We also have harnesses that perform breath first search.
If I tried to describe what it means to "think deeply", I would probably say a combination of both.
Ultimately I believe that we will surpass human capabilities but fail with alignment. Handing the world's resources over to stochastic systems that can evolve faster than we can reason about them simply leaves too many "interesting" outcomes that do not end well. I also expect the failure modes will be totally non-obvious.
Funnily, I'm quite strong at maths and can easily reason about things like dependency graphs in my head, but I don't need to close my eyes to see it. So I can think and type with my eyes open at the same time :p
The worst is when it works around the deny list by running an equivalent command like "bfs /" or just writes itself a script.
I wish we would get better sandboxing than more "safeguards", but the direction things are going seems inspired by craw.
There's even a big button that says "Start Self Driving" in the valuable visual real estate where the speed limit once was.
The reason it would be unreasonable in America today is because there is no alternative, and people are expected to be able to commute long distances. Bring in alternatives and it becomes logical.
Look at the cities in Japan, most people live within a 15 minute walk of a subway station, but people still drive.
This stuff can be negotiable if asked for and planned correctly. It won't be offered.
The Danes do it best, they basically shut down the country for 3 months every summer and have an unspoken agreement that nothing will get done.
I shipped a really embarrassing off-by-one error recently because some polygon representations repeat their last vertex as a sentinel (WKT, KML do this). When I checked the "tests", there was a generated test that asserted that a square has 5 vertices.
I'd love the open source community to come up with a way to harvest model usage by experienced software engineers before we forget our crafts. I'm not against auto mode, but it's not something a couple private companies should have monopolies on.