I'll try a different color space, for sure, but I think the interpolation method is the real culprit.
I have the feeling that in a configuration like this:
A-B
|/|
C-D
the position of D could have an impact on how ABC is rendered.
But I'll try another color space first, it should be easier to implement.
But I'll try another color space first, it should be easier to implement.