DEV Community

Discussion on: 64 Cores on Fire: Supercharging My Development Experience

Collapse
 
stilldreaming1 profile image
still-dreaming-1 • Edited

So if 64 cores gets it down to 17 minutes, what would happen if you add even more cores? Or is 64 the max? It would be I interesting to see how far this can be taken. Is there a point at which adding more cores doesn't make it faster?
If there is a maximum number of cores per virtual machine, could multiple machines work together to compile it faster?

Collapse
 
aminmansuri profile image
hidden_dude

That would all depend on how parallelizable the task is (for example if its too small to subdivide its not worth it) and how well the algorithms work.

But in general huge tasks that split up easily have no limit. But at some point you're going to hit a RAM limits or other bottlenecks. Especially if the number of cores starts exceeding what can go into one processor. Soon the network becomes the bottleneck.