Comment by mattjjatgoogle

You're right! Maybe we should revise that... I made https://github.com/google/jax/pull/17851, comments welcome!