I've got a job and I've got dozens of pictures of an old apartment house and blueprint that let me get mostly basic info like length of some walls so I can model a refurbished object that someone will put over the image and possibly a video clip that presents the actual object. So after I drew some lines with a blueprint, I set the camera at a particular angle, set the picture as a background, position and FOV around 41 degrees by hand, and then I modeled what blueprint couldn't give.
Before I finished the corner I wanted to set another angle and then I ran into big big troubles. I sat for 2h and the closest I got with a camera (which fov is different and is around 72 degrees) is this. Don't look at the roof as it was just temporary, I care about the elevations.
I supposed it to be exact, but it's not and now I question if I'm able to continue the work if I can't get a reference. Do you think it's as bad as I think it is? Should I worry about it? What would you do?