Comment by M_Bakhtiari

Was all IPv6 traffic slower or just this one apparently misconfigured host?

If the former I'd image this is a kernel bug and has nothing to do with any Ubuntu servers.