Hopefully the title wasn't too confusing. Basically, I want to know if it's possible to use my own texture, such as paint brush strokes, to break up the smooth gradient of the UV coordinates texture into flat shapes and splotches. The voronoi node's position output does something similar, but I want the end result to be more hand-painted looking, so I can use these coordinates to map any image texture to look hand painted. I've included one of the paint brush stroke textures I've made to hopefully made it clearer what it is I'm trying to achieve.
PS: One of the easiest methods I've seen and tried is just mixing/overlaying the texture on top of the uv coordinates. However, this still keeps the smooth gradient within the paint strokes, which means the UV texture just shifts the image texture around, instead of turning it into flat colors.
Edit: I've added another example of what I want to achieve, to hopefully clarify what I'm trying to do.