Comment by KaiserPister

Exactly! On my tool I specifically use 4x4 grids which is limiting and I use canny edge maps to help enforce consistency. A very fun problem to solve!