Whenever you introduce (or grow) the presence of computer automation you need to consider the human / social interactions. You are responsible for the whole system, not just your software.
It is well understood that human diligence falls dramatically in the face of automation that is perceived to be highly reliable.
There is a tendency for software people to say “it has a 5% error rate, so make sure to carefully check every time”. Even though we know that humans simply won’t check carefully the results of a 95% accurate system.
It is well understood that human diligence falls dramatically in the face of automation that is perceived to be highly reliable.
There is a tendency for software people to say “it has a 5% error rate, so make sure to carefully check every time”. Even though we know that humans simply won’t check carefully the results of a 95% accurate system.