I just got started messing around with motion tracking and the largest issue I seem to have is getting the tracking points to the correct location in 3D space. For example, I could get a dozen tracking points on one wall tracked for an entire shot, for which Blender will return a low error report (e.g. 0.6) after solving for camera motion. But, after I throw in the film as a background and start throwing in objects (e.g. a table that is supposed to overlay an actual table in the recording) it's obvious that the camera isn't properly tracked and although the real camera may just have some slight movement from hand instability, Blender is acting as if I'm bouncing my camera up and down at ridiculous speeds. Sometimes I can almost account for this by trying different combinations of setting points as the Wall and Floor, but since I can only set three points at once for this, all other points which may be on the wall or the floor end up being 100 meters away in 3D space (this sometimes is and isn't an exaggeration).
Is there a way to greater control tracked points after they've been added to the 3D scene? Or another solution which may help? (I also have the proper focal length and sensor size set up for my camera).