I'm looking into how to achieve forces in Blender particles and fluids driven by motion vector image data. Think "optical flow". This is possible in Nuke, Houdini, and other packages. It appears like the functionality may be there in Blender but I haven't been successful in getting it to work correctly. I'm wondering if some of you out there have had success. Thank you kindly for your help.
hmm just brainstorming. Convert motion vectors to points use those points (make sure to keep points to a limited number) to act as effectors in a fluid sim. So you have to probably write a script that converts pixel location x,y,z data into points. There is software out there but that's the extent of my knowledge on this.
I use this with the depth data from structure scanner to make a per frame point cloud. It might work with standard motion vectors. Its a start.