I'm a coder who has worn a lot of hats, from individual contributor to lead engineer to "CTO" (yes, in quotes, make of that what you will!). I've a lot to learn and hopefully some to share as well.
I learned that each stage in a MongoDB aggregation pipeline can use a maximum of 100 MB RAM and will error if it needs more. There is an allowDiskUse option you can enable to make it use temporary files on disk to exceed that limit. Though optimizing the pipeline is a better solution when possible!
I'm a fan of Open Source and have a growing interest in serverless and edge computing. I'm not a big fan of spiders, but they're doing good work eating bugs. I also stream on Twitch.
I learned that each stage in a MongoDB aggregation pipeline can use a maximum of 100 MB RAM and will error if it needs more. There is an
allowDiskUse
option you can enable to make it use temporary files on disk to exceed that limit. Though optimizing the pipeline is a better solution when possible!