Comment by emmettm

The representation is learned. Also, see Sutter's "Bitter Lesson" essay