AWS now offers over 30 AI and ML services. The breadth is impressive — but it also means teams frequently pick the wrong tier, over-engineer solutions with SageMaker when a pre-trained API would suffice, or under-invest when custom models are actually needed.
This guide maps every AWS AI service into a decision framework: three tiers based on how much control (and responsibility) you want, with clear guidance on when each service fits.
Rule of thumb: Start at Tier 3 (cheapest, fastest). Move to Tier 2 if you need generative AI or customization. Drop to Tier 1 only when you need full model control.
Tier 1: Amazon SageMaker AI — Custom ML Platform
Use when: You need to train custom models on your own data, have ML engineers on staff, or require full control over the model lifecycle.
Core Capabilities
Feature
What It Does
SageMaker Studio
Unified IDE for ML development (notebooks, experiments, pipelines)
Training
Managed distributed training on GPU/Trainium instances with spot pricing (up to 90% savings)
Inference
Real-time endpoints, batch transform, serverless inference, and async inference
Autopilot
AutoML — automatically trains and tunes models from tabular data with zero code
Canvas
No-code ML for business analysts (point-and-click model building)
Pipelines
CI/CD for ML — automated training, evaluation, and deployment workflows
Feature Store
Centralized feature repository shared across training and inference
Model Monitor
Detects data drift, model quality degradation, and bias in production
Ground Truth
Data labeling service with human-in-the-loop workflows
Clarify
Model explainability and bias detection
JumpStart
Pre-trained model hub (deploy open-source models with one click)
When to Choose SageMaker
You have proprietary data that requires custom model training
Your team includes ML engineers who manage model lifecycles
You need MLOps: versioning, A/B testing, model registry, automated retraining
Latency or cost requirements demand optimized custom inference
You're training models from scratch or heavily fine-tuning open-source models
Tier 2: Amazon Bedrock — Generative AI Platform
Use when: You want to build generative AI applications without training models from scratch. Bedrock provides serverless access to foundation models plus the building blocks for production AI applications.
Foundation Models Available
Provider
Models
Amazon
Nova (Micro, Lite, Pro, Premier), Nova Canvas (images), Nova Reel (video), Nova Sonic (speech), Titan (Embeddings, Text, Image)
Anthropic
Claude 4 Sonnet, Claude 4 Opus, Claude 3.5 Haiku
Meta
Llama 4 Scout, Llama 4 Maverick
Mistral AI
Mistral Large, Mistral Small
Cohere
Command R+, Embed
DeepSeek
DeepSeek-R1
Stability AI
Stable Diffusion XL, Stable Image
AI21 Labs
Jamba Instruct
Luma
Ray 2 (video generation)
Bedrock Building Blocks
Feature
What It Does
Agents
Autonomous AI agents that plan, execute multi-step tasks, and call APIs. Support memory retention and multi-agent collaboration
Knowledge Bases
RAG (Retrieval-Augmented Generation) — connect your documents, databases, and data sources to ground model responses in facts
Managed Knowledge Base
Fully managed RAG (GA June 2026) — no vector DB provisioning, auto-scaling, multimodal ingestion
Guardrails
Content filtering, denied topics, PII detection, word filters, hallucination prevention — safety layer for any model
Flows
Visual workflow builder for chaining prompts, models, and data sources into applications
Prompt Management
Version, test, and optimize prompts across models
Fine-tuning
Customize foundation models with your data (continued pre-training or instruction tuning)
Model Evaluation
Compare models on quality, latency, and cost for your specific use case
AgentCore
Runtime infrastructure for deploying agents with tool use, orchestration, and observability
When to Choose Bedrock
Building chatbots, copilots, content generators, or summarization tools
You want RAG (ground AI responses in your company's data)
Need agentic AI that can call APIs, query databases, and take actions
Online fraud detection using ML models trained on your data
Per prediction
Amazon DevOps Guru
ML-powered operational anomaly detection for AWS resources
Per resource/hour
Amazon CodeGuru
Automated code reviews and application performance recommendations
Per lines analyzed
Code & Development
Service
Use Case
Pricing Model
Amazon Q Developer
AI coding assistant — code generation, debugging, transformation, security scanning
Per user or free tier
Amazon CodeWhisperer
(Now part of Q Developer) Real-time code suggestions in IDE
Included in Q Developer
Infrastructure Layer: Compute for AI
Service
Best For
EC2 P5/P4 instances
GPU training with NVIDIA H100/A100 (highest performance)
AWS Trainium (Trn1/Trn2)
Cost-effective custom model training (up to 50% cheaper than GPU)
AWS Inferentia (Inf2)
High-throughput, low-cost inference at scale
EC2 UltraClusters
Massive distributed training (thousands of GPUs)
Elastic Inference
Attach fractional GPU to any EC2 for cost-efficient inference
Decision Framework: Which Service Do I Use?
START
│
├── Do you need generative AI (text/image/video generation)?
│ ├── YES → Amazon Bedrock
│ │ ├── Need RAG? → Bedrock Knowledge Bases
│ │ ├── Need agents that call APIs? → Bedrock Agents
│ │ ├── Need safety controls? → Bedrock Guardrails
│ │ └── Need custom model? → Bedrock Fine-tuning or SageMaker
│ │
│ └── NO → Continue ↓
│
├── Does a pre-trained API solve your problem?
│ ├── Extract text from documents? → Textract
│ ├── Analyze sentiment/entities? → Comprehend
│ ├── Detect objects in images? → Rekognition
│ ├── Convert speech to text? → Transcribe
│ ├── Convert text to speech? → Polly
│ ├── Translate languages? → Translate
│ ├── Build a chatbot? → Lex (rules-based) or Bedrock (AI-powered)
│ ├── Search enterprise docs? → Kendra or Q Business
│ ├── Product recommendations? → Personalize
│ ├── Time-series forecast? → Forecast
│ └── Detect fraud? → Fraud Detector
│
└── Need to train a custom model on your data?
└── YES → Amazon SageMaker AI
├── Have ML engineers? → SageMaker Studio + Pipelines
├── No-code needed? → SageMaker Canvas or Autopilot
└── Deploy open-source model? → SageMaker JumpStart
Bedrock vs SageMaker: The Key Distinction
Criteria
Bedrock
SageMaker
Primary use
Generative AI applications
Custom ML model lifecycle
Model ownership
Use provider models (no training)
Train/own your models
Infrastructure
Fully serverless
Managed instances (you choose size)
Customization
Fine-tuning, RAG, prompt engineering
Full training from scratch
Scaling
Automatic (pay per token)
Manual endpoint scaling
ML expertise needed
Low (application developer level)
High (ML engineer level)
Best for
Chatbots, copilots, content generation
Recommenders, forecasting, custom NLP/CV
The overlap: SageMaker JumpStart can deploy foundation models too. But Bedrock adds the application layer (agents, RAG, guardrails) that SageMaker doesn't provide natively.
Cost Optimization Patterns
Start with Bedrock Haiku/Nova Micro for prototyping, upgrade to larger models only when quality demands it
Use SageMaker Spot Training — up to 90% savings on training jobs
Inferentia for inference — 2-4x better price-performance than GPU for supported models
Bedrock Provisioned Throughput — reserved capacity for predictable high-volume workloads (cheaper than on-demand at scale)
Batch inference — process large datasets offline at lower per-token cost
Model distillation — train a smaller model to mimic a larger one for production (lower inference cost)
What's New in 2026
Amazon Nova — AWS's own foundation model family (text, image, video, speech, code) — competitive with Claude and GPT at lower price points
Bedrock Managed Knowledge Base (GA June 2026) — fully managed RAG without provisioning vector databases
Bedrock AgentCore — production runtime for deploying agents with tool use and observability
Multi-agent collaboration — specialized agents working together on complex tasks
SageMaker Unified Studio — merged notebook, pipeline, and lakehouse experience
Trainium2 — next-gen custom silicon for training (up to 4x performance over Trn1)
Summary
The AWS AI stack is deep, but the decision framework is simple:
Need generative AI? → Bedrock (serverless, no training required)
Need a specific AI task solved? → Pre-trained APIs (Rekognition, Textract, Transcribe, etc.)
Need full ML control? → SageMaker (training, MLOps, custom models)
Need AI infrastructure? → Trainium/Inferentia for cost, GPU P5 for performance
The most common mistake is jumping to SageMaker when Bedrock or a pre-trained API would solve the problem in days instead of months. Start simple, measure, and escalate only when the simpler tier doesn't meet your requirements.
Alpesh Kumbhare is an AWS Architect at Atos, specializing in AWS infrastructure automation and cloud AI solutions. Connect on LinkedIn.
Top comments (0)
Subscribe
For further actions, you may consider blocking this person and/or reporting abuse
We're a place where coders share, stay up-to-date and grow their careers.
Top comments (0)