The only one that comes close would be borderless gaming which isn't active on Starmade nor Java.
That said I can't seem to reproduce it anymore either since it is now working.
It was only like that the first time I ran the game again after a long time and after the rejoin (went just back to the menu so not even a full restart) it is still fine.
I tested a clean install by removing the old install too and it still worked on the first launch. Not quite sure want went wrong there, maybe the report was a bit prematurely.
Might be some weird caching issue with the shaders which could also related to an AMD bug since their cards / drivers sometimes do weird things (at least for all the AMD / ATI cards I've owned so far).