[Advice Needed] Designing a system to handle 60K concurrent websockets.

I have sketched a very basic architecture in: https://imgur.com/T7ZVwbd, assume I have a server that can handle 20K concurrent websockets. I am able to spin up as many images of this server.

I am wondering if load balancing with a nginx server is a good idea for websockets since the LB needs to have a socket connected with the client and then another socket to relay the data to the server. So that means for 20K client connections the LB will need to maintain 2*20K connections.

Will the LB able to handle these many connections?

Or is it better to make client connect to the servers directly instead of using LB as a relay. (In this case I need to have a system to let the client know which server to make the socket connection to)

update 1: I have posted on r/networking – [Advice Needed] Designing a system to handle 60K concurrent websockets.