Best method for tracking multiple points in a room pan

I have footage from the POV of someone in a bed who looks around from one side of the room to the other in a pan. I need a creature standing at the foot of the bed as well as one on each side of the bed. Every method I’ve tried so far makes the creatures a bit floaty. Anyone have an idea on the best way to achieve more of a solid track for each of these figures in the pan?

thanks