We have a chat server built on Socket.IO, which depends on MongoDB adapter. We only connect with Websocket, so do not need to worry about sticky sessions. I have a couple of questions on the setup and will really appreciate if you guys can throw some light on it:
I am using dedicated-1x server. How much should be the Hard Limit for the connection in config? 25 is too less, but what should be the basis of calculation, as there can be 100’s or 1000’s connections, but most being in idle state. How can I scale or set server size in this scenario?
Can I scale this server, just as any other regular node server. Do I need to look at anything apart from implementing Socket.IO adapters? The socket.io documents do mention about clustering, via node or pm2, however, I am not scaling via node/pm2, so have not implemented any clustering code in the project. So can I just scale this server with flyctl scale ?
When is the new server created if soft limit is reached? Is it the moment concurrent requests hit soft limit, or it watches for few seconds after concurrent limit hits soft/hard limit?