Because while the ARM processor is probably supported, most of the other sensors, camera, cell radios, etc have proprietary binary drivers that are not.
Just read the problems Replicant, the true FOSS android, has had getting all components to work correctly.
Just read the problems Replicant, the true FOSS android, has had getting all components to work correctly.