I am trying to create a heatmap style of animation from a black and white image sequence.
So far I created a grid, applied the image sequence as a texture and then added a displacement modifier. As long as I don't click 'apply' on the modifier, it updates with each frame -> perfect. I also activated the options, that the mesh is updated in edit mode. However, somehow the texture coordinates node does not recognize the new z-positions, unless I click apply on the modifier. But then, it's not dynamic to the image sequence texture.
For the moment, I created a workaround by not choosing the "generated" texture coordinates, but the "reflection" option. However, this may ressemble the actual z- positions, but is not acurate enough for me as it also changes with the viewing angle.
Current node setup: