Nobody has infinite resources to allocate to their CI/CD.
When you are using GitHub Actions or CircleCI you can control the resources based on some spending per month.
If you spend more than you allocate, your team will have to develop without CI/CD until the next month.
When discussing Tekton and self-hosted CI/CD, it's crucial to manage the allocation of resources explicitly. This ensures efficient use of available resources, maintains system performance, and prevents overconsumption or bottlenecks.
At Woovi, we moved from the cloud to our bare-metal hardware, we have constrained resources, so we need to explicitly set resource limits to be used on our services.
Resource Management at Tekton
Tekton only enables us to control resources per step of a given task.
We had 40VCPU and 200GB of RAM to be used in our self-hosted CI/CD.
Our most expensive task is to run tests.
Jest consumes a lot of CPU and memory.
We have a task test-pkg that runs tests in a given package.
We define the resource requests and limits per step
Requests are the minimal resources required to run the step, and limits are the maximum resources that this step can use.
- name: test-pkg
resources:
requests:
memory: 2Gi
cpu: 1
limits:
memory: 16Gi
cpu: 8
We decided to allocate 1VCPU and 2Gi of memory per test-pkg, so we can run at most 40 task steps in parallel.
When Kubernetes does not have enough resources to allocate it will queue the task until some resources are freed.
Sum up
When you are using a self-managed service like GitHub Actions or CircleCI you don't need to worry about resources at CPU or Memory level but more about your money budget.
When you move to self-hosted with your hardware, you need to care more about CPU and Memory resources.
It makes you optimize as much as possible.
Woovi is an innovative startup revolutionizing the payment landscape. With Woovi, shoppers can enjoy the freedom to pay however they prefer. Our cutting-edge platform provides instant payment solutions, empowering merchants to accept orders and enhance their customer experience seamlessly.
If you're interested in joining our team, we're hiring! Check out our job openings at Woovi Careers.
Photo by Marcin Jozwiak on Unsplash
Top comments (0)