Game now back to working with 3 players, and there seems to be less disconnects, the only issues was when there is more than 1 player at the Boss scene, it won't work. Working on that that.
Shoutout to Andro, Devin, Dominik, Mathias, Nin and P for helping me test!
Thanks for the patience!