When designing modern cloud architectures, Event-Driven Architecture (EDA) is the gold standard for creating decoupled, scalable, and resilient systems. However, choosing the right AWS service for passing messages around can be daunting.
Let’s break down exactly what this means, how each part works, and look at simple real-world examples for each.
Part 1: AWS SQS (Simple Queue Service)
"For resilient pull-based processing with FIFO for ordering guarantees"
What it means
- Pull-Based Processing: Instead of pushing an event directly onto a consumer (which might overwhelm it), messages sit safely in a storage queue. The consumer "pulls" (polls) messages from the queue only when it has the capacity to process them.
- Resilient: If your consumer service crashes or experiences a sudden traffic spike, the messages aren’t lost. They wait in the queue until the service recovers.
- FIFO (First-In, First-Out): Standard queues process messages roughly in order, but sometimes duplicate or out-of-order messages happen. A FIFO queue guarantees strict ordering (Message A will always be processed before Message B if A arrived first) and exactly-once processing.
Simple Example: The Coffee Shop
Imagine a busy coffee shop. Customers place orders, and instead of shouting them directly at one overworked barista (push-based), the orders are printed on paper tickets and lined up on a rail (the queue).
The barista pulls the next ticket from the rail only when they finish the current drink (pull-based processing). If the barista steps away for a moment, the tickets don't vanish; they just wait on the rail (resilient).
- Why FIFO matters here: If Customer A orders a Latte and Customer B orders an Espresso immediately after, the barista must make the Latte first to ensure fairness and prevent Customer A from waiting forever.
Part 2: AWS SNS (Simple Notification Service)
"For fan-out to multiple consumers simultaneously"
What it means
- Fan-Out Pattern: This is a "push-based" publish/subscribe (Pub/Sub) pattern. A publisher sends a message once to an SNS "Topic," and SNS instantly clones and broadcast-pushes that message to multiple subscribers (consumers) simultaneously.
- Decoupling: The service sending the message doesn't know (or care) who is listening. It just drops the message in the bucket, and SNS handles the distribution.
Simple Example: The New Author Announcement
Imagine an author finishes a new book. Instead of emailing every single fan individually, they post an update to a subscription newsletter service (the SNS Topic).
Instantly, that single update is broadcasted ("fanned out") to thousands of subscribers via different channels: some get an email, some get an SMS text, and another system automatically updates the bookstore website inventory.
-
In a software example: When a user buys a product on an e-commerce site, the
OrderPlacedevent is sent to SNS. SNS instantly "fans out" this event to three different systems at the exact same time: - The Shipping Service queue to pack the item.
- The Invoicing Service queue to charge the card.
- The Analytics Service to update marketing dashboards.
Part 3: AWS EventBridge
"For complex routing with pattern-based rules... my default for internal domain events"
What it means
-
Complex Routing & Pattern-Based Rules: EventBridge is a serverless event bus. Unlike SNS, which blasts messages to everyone subscribed, EventBridge inspects the contents of the event payload. You can write specific rules like: "Only forward this event if
statusis 'FAILED' andlocationis 'US'." -
Internal Domain Events: A "domain event" is something meaningful that happened in your business logic (e.g.,
UserUpgradedToPremium). EventBridge is built to be the central nervous system connecting all your microservices. - Schema Registry & TypeScript Auto-Generation: As your team grows, keeping track of what an event looks like (its schema) becomes difficult. EventBridge’s Schema Registry automatically detects the structure of your events. It can then generate code bindings (like TypeScript types). This means developers get auto-complete in their code editors for events happening across the entire company!
Simple Example: The Airport Sorting System
Think of EventBridge like an automated airport baggage handling system. Every bag (event) has a tag indicating its destination, weight, and airline.
The main conveyor belt (the Event Bus) scans the tag of every bag and uses rules to route it:
- If the destination is "London," send it to Gate 4.
- If the bag is flagged as "Oversized," route it to the special handling team.
- If it belongs to a third-party partner airline, route it to their terminal.
Furthermore, the airport maintains a central database of exactly what a valid baggage tag looks like (Schema Registry), so every airline's computer system knows precisely how to print a compatible tag without manual coordination.
When to use which?
- Use SQS when your primary goal is load-smoothing and safety. You want to make sure your database or microservice doesn't break under high traffic, and you need to process items sequentially.
- Use SNS when you want to broadcast a single event to multiple distinct systems instantly, and you want a simple "fire-and-forget" mechanism.
- Use EventBridge when you are building an enterprise microservice mesh. It is the ideal choice when you need to route events based on what is inside them, integrate with SaaS apps (like Zendesk or Stripe), or want strict code-level governance over your event data structures.
hope you find it helpful
Hash
Top comments (0)