My litmus test for translation services is to see if the ambiguity between "turkey" (the bird) and "Turkey" (the country) manifests itself. Many European languages have two separate words for the two concepts that can't possibly be confused, so I think this is a good unit test.
My Dutch test sentence is: "de kalkoen bezoekt Turkije" (the bird visits the country). Most of them get it wrong for most European languages:
google -> german: "die türkei besucht die türkei"
bing -> swedish: "kalkonen besöker kalkon"
deepl -> hungarian: "a pulyka meglátogatja a pulykát"
translate.com -> french: "la dinde visite la dinde"
lingvanex.com -> spanish: "el pavo visita pavo"
Only one gets it right:
systran.net -> french: "La dinde visite la Turquie"
My Dutch test sentence is: "de kalkoen bezoekt Turkije" (the bird visits the country). Most of them get it wrong for most European languages:
google -> german: "die türkei besucht die türkei"
bing -> swedish: "kalkonen besöker kalkon"
deepl -> hungarian: "a pulyka meglátogatja a pulykát"
translate.com -> french: "la dinde visite la dinde"
lingvanex.com -> spanish: "el pavo visita pavo"
Only one gets it right:
systran.net -> french: "La dinde visite la Turquie"