I noticed that when viewing relatively small models (e.g. pincell, sphere, box, etc.) the panning worked great, but when I loaded a larger model where the camera was far from the origin panning moved the model only slightly relative to the image frame.