DEV Community


Discussion on: Explaining Load Balancers

eichgi profile image

Slavius, how can I know how many nodes my load balancer is able to handle? I mean I've been taking metrics of usage and for example CPU is barely spiking 20% with 11 node. I guess I have plenty of capacity for more nodes?

But which should be the rule of thumb for this escenarios? thanks!

slavius profile image
Slavius Author

The best is to do a load testing. Generally what you're looking for is error-free operation with acceptable latency. Use something like Apache jMeter and try increasing the load while adding nodes. Your target is all connections are handled gracefully by the load balancer while keeping the response time from nodes in reasonable values. I'm afraid there's no golden rule here.