Actually I was trying to get a faster rendering of my image with few rays in general and more rays only for certain areas. With the solution provided by Nick, I'm twice faster globally with a perfect definition for my point of interest.
Here is an example, voluntarily extreme :
