I'm using Blender version 2.82.
The HDRI is visible in the render mode.
Blender Stack Exchange is a question and answer site for people who use Blender to create 3D graphics, animations, or games. It only takes a minute to sign up.
Sign up to join this communityIn Blender 2.91.0 I see the so called Material Preview
mode which allows what you're looking for.
There I have the option to use the built in HDRI's or installing my own one by conveniently using the little gear icon on that pop-up window.