adamb
Joined 19 years ago
Joined 19 years ago
It will do things like separate out different kinds of test failures (by error message and stacktrace) and then measure their individual rates of incidence.
You can also ask it to reproduce a specific failure in a tight loop and once it succeeds it will drop you into a debugger session so you can explore what's going on.
There are demo videos in the project highlighting these techniques. Here's one: https://asciinema.org/a/dhdetw07drgyz78yr66bm57va
It's also the part of V2V that seems to be most powerful and least talked about.
I hope you're right and that once we establish best case utility, as a community we refocus on handling component failures more gracefully.
Although it's unclear if the second and third order system effects in our financial system will ever get that sort of treatment. So let's hope driving gets a bit closer to flying (and farther from wall street) in terms of attitude towards safety.
EDIT: clarity
Especially the associated threat modelling and engineering principles!
I'd rather just have to trust the safety standards of the manufacturer of my car (and to a lesser extent the cars I might directly collide with), not the safety standards of every vehicle within transmit distance.
That is, as a human I know that the drivers around me might have broken lights or misuse their signals.
I also assume that other drivers do not have my best interest at heart.
A reasonable V2V system should be expected to handle these scenarios just as easily as they handle wireless interference and packet loss.
V2V communication means BT exploits can become worms even more easily, spreading from phone to vehicle to vehicle.
My point is that V2V systems and research papers I've seen just don't make meaningful claims about safety. They instead make claims about convenience and efficiency, which are not substitutes for safety.
We know to test vehicles for crash safety before putting them on the road.
While I believe there are certainly ways to make use of V2V communication that increase overall safety, I haven't seen anything remotely resembling a crash test for V2V systems.
Creating a system that relies on the correct behavior of all components is not a recipe for safety or reliability. This is especially true as the number of components increases (this happens when a car exchanges messages with all the cars around it).
We need V2V systems that rely only on correct behavior of any component and allow for malicious behavior of some components.
The idea that a protocol version mismatch from some rolling deploy can cause injuries in cars made by other manufacturers is the sort of thing that I haven't seen a single person point out. How would something like this even be caught and debugged?
Advocating for an ecosystem where these things are likely but neither addressed nor considered is just plain irresponsible.
From https://knowledge.ni.com/KnowledgeArticleDetails?id=kA00Z000...
I have yet to see these sorts of considerations in any V2V communication system. The idea that my car might act on (or propagate) incorrect/sabotaged information that it receives from a "peer" is a terrifying form of fragility.
This sort of failure mode needs to be studied and addressed directly before any of these systems are deployed.
It should also be assumed that these new patterns of information propagation will create a huge financial incentive for people to sell after market modifications that exploit the trust models of these protocols.
It feels like your comment about the network and community being the most valuable part of program is probably right. Given that, is it possible to be a Pioneer, but not accept the money?
It might be an interesting starting point for you: https://observablehq.com/@ajbouh/editor