There aren't good datasets for that. Even neural TTS for Japanese struggles with it since Japanese transcriptions used to train models don't preserve pronunciations used.
(or maybe it could be theoretically done, just the mechanism to automatically classify wildly different pronunciations mapped to the same literal expressions don't yet exist)
(or maybe it could be theoretically done, just the mechanism to automatically classify wildly different pronunciations mapped to the same literal expressions don't yet exist)