Comment by jiveturkey

There's additionally a mail setting for list management that interacts with tracking. That one might need to be disabled as well. This is very poorly documented.