DEV Community

Eliana Lam
Eliana Lam

Posted on • Originally published at aws-user-group.com

Architecting for Efficiency and Reliability with Performance Testing at Scale

Luis Guirigay @ AWS Amarathon 2025



Testing Categories:

  • Code Testing: Code Analysis, Unit Testing

  • Integration & Interface: Contract Testing, Interface Testing

  • Functional: User Acceptance, Regression Testing

  • Non-Functional: Performance Testing, Chaos Engineering

  • End-to-end Testing: Comprehensive testing covering all aspects

Performance Metrics:

  • Load: System performance under expected usage

  • Stress: Evaluate system behavior under extreme load conditions

  • Endurance: Sustained load testing to identify long-term issues

  • Scalability: Measuring performance under growing user/transaction volume

  • Spike: Rapidly increasing or decreasing load to assess resilience and behavior

  • Volume: Evaluates the impact of handling large amounts of data

Measurement Criteria:

  • Percentiles: 50th, 90th, 95th, 99th, 99.9th, 100th

  • Counts & Averages: Total Transactions, Success, Failures, Response Times, Latency, Connection Time, Bandwidth

  • Errors: All errors, prioritize critical

  • Resources: CPU usage, Memory consumption, Disk I/O, Network Traffic

Testing Strategies:

  • Early: Incorporate testing early in the development lifecycle

  • After: Testing post-infrastructure changes

  • Always: Continuous testing throughout the development process

  • Development: Testing integrated into the development workflow

  • Infrastructure Changes: Testing following any infrastructure modifications

  • Staging: Testing in a staging environment before production

  • Major Events: Testing prior to significant system events

  • Post-Production: Post-deployment performance validation

  • Milestones: Testing at specific project milestones

Benefits:

  • Efficiency: Improved system efficiency

  • Reliability: Enhanced system reliability

  • Better User Experience: Superior user experience through optimized performance

  • Scalability: Improved system scalability

  • Cost Optimization: Reduced costs through optimized resource utilization

Amazon Web Services Solutions:

  • 1M+ Deployments: Extensive deployment experience

  • Vetted, Supported: Thoroughly vetted and professionally supported solutions

  • Solutions Library: Comprehensive library of vetted solutions

  • Pay for what you use: Flexible pricing model based on usage

  • Single Tenant: Solutions designed for single tenant environments

  • 100% Open Source: Commitment to open source solutions

Top comments (0)