Comment by School-Cotton

I suspect the act of running nvidia-smi itself prevents the GPU from being put into a low-power state.