I have the exact same setup. I found Infuse a PITA to begin with. Now it works pretty dang well, even remotely. One big irritation though is the subtitles are always on by default, on Apple TV it's an issue as I can't find a way to disable the default haha! Sometimes there is also a delay between when Jellyfin can play a new video in the browser and when Infuse can play it even though it can see the file.
I do find Infuse significantly better than the Jellyfin apps though.
I do find Infuse significantly better than the Jellyfin apps though.