There is more ways to achieve something like that. Usually Particle System is used. In some cases also cold smoke or fluid could work even better than particles because for something like sand or dust you would have to use a lot of particles ... it would be probably quite crazy to calculate :)
Particles
I didn't convert them to Rigid Body sim it would be more accurate, but a lot heavier to calculate. To let those here to collide with Colliders
- Deflect > enable Size Deflect
To Collide particles between each other
- Force Field Settings > enable Self Effect and under Type1 > Force > Strength 1 (but animate the value from zero to one otherwise you get shock wave :). enable also FallOff > Max Distance ... since my particle is Size 0.04 I set half Max Distance 0.02
- or switch Physics from Newtonian to Fluid and under Advanced set all to zero ... it seems to be more stable ... more info
Above the Cube I used subtle Turbulence Force Filed object to throw particles down.
Smoke
For something more dusty ... Smoke simulation with Domain > Heat -1
Fluid
Or you can try Fluid System and reuse Fluid Particles in some fake ... for more see