Comment by mglz

The underlying problem is that the current FSD architecture doesn't seem to have good guard rails for these outlier situations you describe (sunlight blinding the camera from just the right angle probably?) and it is probably not possible to add such rules without limiting the system enormously.

Fundamentally driving consists of a set of fairly clear cut rules with a ridiculous amount of "it depends" cases.