Use the guiding calibration to offset the scope movement, since you know the direction of movement, you should reorientated the telescope controls to move the telescope position.
for example, today, pushing UP, makes the image move down and right. if you reoriented based on calibration when pushing UP, it would move the image UP.