DEV Community

Increase Node JS Performance With Libuv Thread Pool

💻 Bleeding Code-By John Jardin on September 07, 2020

In this 5th instalment of my “Node JS Performance Optimizations” series, I show you how to increase Node JS performance with thread pool manageme...
Collapse
 
fauzanss profile image
Akhmad Fauzan • Edited

Great article.
How do you think when we deploy nodejs app on openshift?
As we know, we can configure the CPU size and scale up the services.
Is this will increase apps performance with UV_THREADPOOL_SIZE config ?

Collapse
 
bleedingcode profile image
💻 Bleeding Code-By John Jardin

Hi Akhmad. Thanks for the comment 👍.

So, with my limited knowledge of OpenShift, when you re-configure your CPU size, your node app doesn't get restarted and remains in memory. Therefore, it will not take advantage of the new CPU cores until it's rebooted.

However, if you autoscale your node services in that OpenShift spawns new replicas, then the new replicas will take advantages of the new CPUs.

If I didn't answer your question correctly, maybe provide me with a bit more info ;)

Collapse
 
tomeraitz profile image
Tomer Raitz

Great article, thank you for that!
I did not know about this ability in nodejs, so I have a nuby question, is it make a difference if I run one project on the machine or several projects? For example, I use a host cloud like Heroku, and I believe they run many nodejs projects on a single machine. Is this important?

Collapse
 
bleedingcode profile image
💻 Bleeding Code-By John Jardin

Hi Tomer. Thanks for the response and sorry for the late reply. It seems Dev.to doesn't notify me when users comment on my articles.

To answer your question simply, you need to balance how many nodejs apps you run on a machine, because each nodejs app requires resources to initiate and keep running. If you have 5 web services running as 1 nodejs app, it would be less resource intensive than running 1 nodejs app per web services (i.e. 5 nodejs apps).

However, you don't want to put yourself in a position where all your services are now running as 1 nodejs application...this would start looking like a monolithic app, which is not what you want.

I would group together a subset of services that make sense to be together and run them as a nodejs application.

Make sense?

Collapse
 
tomeraitz profile image
Tomer Raitz

Yes, Thank you for the answer, I think this information is essential, even though it's something the DevOps team / CTO need to deal with this, but it's good to know this kind of configuration to help them make the project better.

Collapse
 
louieaniez profile image
louieaniez

Hi! I just have a question, because I've implemented a, somewhat like a watchdog mechanism for user session, using socket.io, I sent an event in a regular interval from my client controller in angularjs to my node server, as long as the client's browser is active, the interval continues, does that affect my server's response time eventually due to a regular interval? And also, I'm using callbacks in all of my database query, like this:

app.post('/postData', (req, res) => {
modules.postData(req.body, function (response) {
if (!response) { res.send('Error') }
else { res.status(200).send(response) }
})
})

Does this affect the response time of the server initially? this seriously is a pain in the ass, because I've created an embeddable app, and before it loads, it should get its data from my node server, however, the server will return a connection timeout error very often and that causes the app to not to display in the clients iframe, any idea how should I fix this? thanks in advance!

Collapse
 
bleedingcode profile image
💻 Bleeding Code-By John Jardin

Hi there. Regular pings to your server should be fine as long as the actual processing time and payloads are kept to a minimum. Your example above doesn't really give me too much insight into what's happening.

I see below you are new to Node. Firstly welcome to Node World :). I recommend joining the Node Reddit Group and bouncing ideas and asking for help there, but you might need to provide a bit more info to get a response.

Collapse
 
louieaniez profile image
louieaniez

I just started using nodeJS actually, I think it's been 2 months since I started to code in nodejs, there's a lot to learn I guess

Collapse
 
farabidev473 profile image
Al Farabi

Good write brother. One question, If our production application is managed by PM2, do we still need to manually adjust the thread pool size to utilize the maximum CPU potential, as demonstrated in your example?

Collapse
 
victorneves profile image
Victor Neves

Thanks for sharing this
This helped me a lot and now I think I very a better overview of the problem that I'm currently facing on my app
After running the basic test and even seetting the UV_THREADPOOL_SIZE dynamically I got an average of 6.4 requests per second :/

The app has an auth0 autentication to access basically all pages, is it possibe to pass the authentication when running the tests in order to test those pages? I try to run the project and access it on the browser doing the authentication and only run the tests after, but it doesn't, I see the redirect from the localhost:3000/ to localhost:3000/login when running the test :/

Collapse
 
louieaniez profile image
louieaniez

Please help, thanks!