Space Engineers crash on server join

Good day, I'm currently hosting a dedicated server for me and my friends.

The server has been working great but this changed when I started to build an asteroid base.

If my character went offline at the asteroid then I started experiencing some crashes when attempting to start the game, it was nothing big at first, maybe a crash once or twice but it would load up eventually.

The issue seemed to be getting worse the more I built though, so I thought it would be a good idea to avoid leaving the game at the asteroid, so that's what I tried doing.

Then when my base has progressed further, my character went offline (crashed) when I was located at the asteroid and I was then unable to rejoin the server at all. (I tried joining around 20 times)

I then tried the following things: restarting PC, clearing the Space Engineers temp, cache and shadercache folders, clearing the cache of Nvidia, Verifying integrity of game files, reinstalling the game, restarting server, rolling back a GPU driver and turning off the overclock of my GPU.

What ended up "fixing" this issue was moving my character to a different location by downloading the world, opening it with SEToolBox, selecting my character then moving it to the moon, reuploading that world to the server and then joining it.

I don't really find this to be a fix though since I am now unable to log off at my asteroid base now which is my main base and I have to remind myself to leave it everytime I stop playing or it will result in me locking my game, even accidentally crashing at it will now result in some trouble.

I was wondering if there is anything I can do about this, I have included my game log from when the game kept crashing caused by my character being nearby the asteroid.

Thanks in advance!

Greetings,

Tom