That isn't possible with the binaries. However, you could do that with the source code.

You could download the source code from the repository and compile it by yourself. With this method, you only need to download the files that changed. If you choose to do this, you will need to compile Blender each time you update your code which is more time consuming than just installing it.