The exterior of the bottle makes a transition from rounded-square to circular profile:
..here, a loft, using Bridge Edge Loops between a plane with its corners CtrlShiftB bevelled, and a duplicate of it, put through Loop Tools > Circle.
CtrlB Bevel the top circle to reference, scale the inside and extrude, to form the neck of the bottle. Give the bottle a Solidify modifier. Don't worry about the shell at the bottom of the bottle, it will be deleted. It's maybe more convenient to uncheck 'Fill Rim' in the modifier before applying it.. it will make selection simpler:
(Below left) With everything hidden, still in Edit Mode, create a UV sphere with 12 segments to match the existing profiles. We want a little less than a hemisphere, so, here, 7 rings. The top half is deleted, and the remainder adjusted to reference. AltN > Flip its normals. It's on the inside.
(Middle, above ) Now, the inner shell is un-hidden, its bottom face deleted,its bottom edge GG slid upwards and scaled, making a nice- looking gap to be bridged, again using Bridge Edge Loops. (You may need to rotate the hemisphere through
360/24 degrees in Z, first, to avoid twist.)
(If you need to cut further loops to aid the transition, or just for more even density of faces, don't forget Loop Tools > Circle doesn't need to be applied at 100%.)
Unhide the rest of the bottle, bridge the rim, put in some bevels by hand to sharpen edges under subdivision, and put on your Subdivision Surface modifier:
You can probably render better than this.. I've got a feeling there's some fakery going on in your reference :)