“But even for humans, sensor problems are difficult. While we’ll eventually figure out what’s going on, we’ll still struggle in the face of conflicting signals, as anyone who has responded to an incident can tell you. And in high-tempo situations, where we need to respond quickly enough or something terrible will happen…we simply might not be able to respond quickly enough.”
https://surfingcomplexity.blog/2024/12/07/your-lying-virtual-eyes/
Mastodon Source 🐘
Related & IIRC, Sydney Dekker shared a story in one of his books about a ship accident. The sensor state was correct, but the operator didn't detect the state change because it was so rare. This led into a discussion about https://en.wikipedia.org/wiki/Inattentional_blindness