DEV Community

Cover image for Architecting for Efficiency and Reliability with Performance Testing at Scale
Eliana Lam for AWS Community On Air

Posted on

Architecting for Efficiency and Reliability with Performance Testing at Scale

Speaker: Luis Guirigay @ AWS Amarathon 2025

Summary by Amazon Nova



Testing Categories:

  • Code Testing: Code Analysis, Unit Testing

  • Integration & Interface: Contract Testing, Interface Testing

  • Functional: User Acceptance, Regression Testing

  • Non-Functional: Performance Testing, Chaos Engineering

  • End-to-end Testing: Comprehensive testing covering all aspects

Performance Metrics:

  • Load: System performance under expected usage

  • Stress: Evaluate system behavior under extreme load conditions

  • Endurance: Sustained load testing to identify long-term issues

  • Scalability: Measuring performance under growing user/transaction volume

  • Spike: Rapidly increasing or decreasing load to assess resilience and behavior

  • Volume: Evaluates the impact of handling large amounts of data

Measurement Criteria:

  • Percentiles: 50th, 90th, 95th, 99th, 99.9th, 100th

  • Counts & Averages: Total Transactions, Success, Failures, Response Times, Latency, Connection Time, Bandwidth

  • Errors: All errors, prioritize critical

  • Resources: CPU usage, Memory consumption, Disk I/O, Network Traffic

Testing Strategies:

  • Early: Incorporate testing early in the development lifecycle

  • After: Testing post-infrastructure changes

  • Always: Continuous testing throughout the development process

  • Development: Testing integrated into the development workflow

  • Infrastructure Changes: Testing following any infrastructure modifications

  • Staging: Testing in a staging environment before production

  • Major Events: Testing prior to significant system events

  • Post-Production: Post-deployment performance validation

  • Milestones: Testing at specific project milestones

Benefits:

  • Efficiency: Improved system efficiency

  • Reliability: Enhanced system reliability

  • Better User Experience: Superior user experience through optimized performance

  • Scalability: Improved system scalability

  • Cost Optimization: Reduced costs through optimized resource utilization

Amazon Web Services Solutions:

  • 1M+ Deployments: Extensive deployment experience

  • Vetted, Supported: Thoroughly vetted and professionally supported solutions

  • Solutions Library: Comprehensive library of vetted solutions

  • Pay for what you use: Flexible pricing model based on usage

  • Single Tenant: Solutions designed for single tenant environments

  • 100% Open Source: Commitment to open source solutions



Team:

AWS FSI Customer Acceleration Hong Kong

AWS Amarathon Fan Club

AWS Community Builder Hong Kong

Top comments (0)