Ok figured it out.
I restarted the Seestar and went into scenery mode. I moved it around with the Virtual Joystick and then I realized that the arm was not turn 180 and whenever I tried to "close" the arm it tried to just go the wrong way (I don't know maybe because it thoughts it's shorter way?) so I brought the arm all the way back the other way to close it. Then opened it via the button and closed it again.
Seems like when the arm is over a certain angle backwards it goes home the wrong way.