DEV Community

Cover image for Amazon EMR on EKS now supports Service Quotas
Learn2Skills for AWS Community Builders

Posted on • Edited on

Amazon EMR on EKS now supports Service Quotas

Amazon EMR on EKS now supports Service Quotas, allowing users to manage and request increases for quotas like StartJobRun API calls directly in the AWS Service Quotas console.

Key Benefits
This eliminates the need for support tickets in many cases, enabling automated approvals for eligible requests and faster scaling. Users can also set CloudWatch alarms to monitor usage against quotas, improving operational efficiency.

Previously, to request an increase for EMR on EKS quotas, such as maximum number of StartJobRun API calls per second, customers had to open a support ticket and wait for the support team to process the increase. Now, customers can view and manage their EMR on EKS quota limits directly in the Service Quotas console. This enables automated limit increase approvals for eligible requests, improving response times and reducing the number of support tickets. Customers can also set up Amazon CloudWatch alarms to get automatically notified when their usage reaches a certain percentage of a maximum quota.

How It Works
Access the Service Quotas console via the AWS Management Console to view EMR on EKS limits by region. Requests for increases are processed centrally, with some approved automatically to reduce wait times.

With Service Quotas, you can view and manage your quotas for AWS services from a central location. Quotas, also referred to as limits in AWS services, are the maximum values for the resources, actions, and items in your AWS account. Each AWS service defines its quotas and establishes default values for those quotas. If your business needs aren't met by the default limit of service resources or operations that apply to an AWS account, resource, or an AWS Region, you might need to increase your service quota values. Service Quotas enables you to look up your service quotas and to request increases. Support might approve, deny, or partially approve your requests.

AWS Management Console
The Service Quotas console is a browser-based interface that you can use to view and manage your service quotas. You can perform almost any task that's related to your service quotas by using the console. You can access Service Quotas from any AWS Management Console page by choosing it on the top navigation bar, or by searching for Service Quotas in the AWS Management Console.

Using the AWS Management Console to request an increase
To request a service quota increase

  1. Sign in to the AWS Management Console and open the Service Quotas console at https://console.aws.amazon.com/servicequotas/home.

  2. In the navigation pane, choose AWS services.

  3. Choose an AWS service from the list, or enter the name of the service in the search box.

  4. If the quota is adjustable, you can request a quota increase at either the account-level or resource-level based on the value listed in the Adjustability column.

  • Account-level – Request a quota increase at the account-level for an account-level quota such as Domains per Region for Amazon OpenSearch Service. To do so, select the quota from the list and choose Request increase at account-level.

  • Resource-level – Request a quota increase for a specific resource for a resource-level quota such as Instances per domain for Amazon OpenSearch Service. To do so, choose the quota name to view additional information about the quota. Under the Resource-level quotas section, select the resource for which you want to increase the quota value, and choose the Request increase at resource-level button.

  1. For Increase quota value, enter the new value. The new value must be greater than the current value.

  2. Choose Request.

  3. To view any pending or recently resolved requests in the console, navigate to the Request history tab from the service's details page, or choose Dashboard from the navigation pane. For pending requests, choose the status of the request to open the request receipt. The initial status of a request is Pending. After the status changes to Quota requested, you'll see the case number with Support. Choose the case number to open the ticket for your request.

Service Flow Diagram

This diagram illustrates the streamlined process: workloads interact with quotas checked via the console, with monitoring and requests handled centrally for EMR on EKS resources like API rates and cluster limits.

Reference:

  1. Customizing the Service Quotas dashboard
  2. Getting started with Service Quotas Automatic Management

Top comments (0)