Originally published on PkLavc.
Confirmed facts
On October 22, 2026, Amazon SageMaker AI announced the general availability of training session APIs for its serverless model customization offering. These APIs are available in US East (N. Virginia), US West (Oregon), and Asia Pacific (Mumbai) regions.
The new training session APIs provide customers with direct control over their post-training algorithms without requiring them to provision or manage GPU infrastructure. This expands upon existing SageMaker AI capabilities, which previously offered managed techniques like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and other reinforcement learning (RL) methods where SageMaker AI handled the training execution based on customer-selected techniques and models.
With the introduction of training session APIs, developers can now write custom training loops. This enables them to reproduce existing techniques like SFT or DPO on their own terms, or to implement custom loss functions, new RL reward signals, data curricula, or algorithms derived from recent research. Specific operations, such as forward_backward(), optim_step(), and sample(), are exposed as API calls against a live, stateful session.
SageMaker AI manages the underlying infrastructure and operational aspects for these sessions, including GPU allocation, loading of models and LoRA (Low-Rank Adaptation) weights, distributed execution, fault recovery, checkpoint storage, and security. Developers interact with these operations directly from their Python code to drive custom training objectives, including reinforcement learning and supervised fine-tuning, with built-in checkpointing and resume functionality.
The billing model for these training sessions is per token processed. Local computation, such as reward scoring in RL, is not billed as GPU time. To assist developers, SageMaker AI has released the SageMaker training sessions cookbook, a collection of ready-to-run SFT and RL recipes that serve as blueprints for custom training loops. Getting started involves installing the SageMaker Python SDK, cloning the cookbook, or utilizing a coding agent within SageMaker Studio.
Technical analysis
The introduction of training session APIs for Amazon SageMaker AI represents a significant shift in the balance between abstraction and control for AI model customization. Previously, SageMaker AI offered a high-level, managed approach where developers selected a technique and a model, and the service handled the training execution. While convenient for standard use cases, this abstraction limited the ability to implement highly specialized or experimental training methodologies. The new APIs bridge this gap, offering granular control over the training loop while retaining the benefits of a serverless infrastructure model.
This development directly addresses a common challenge in advanced AI engineering: the need for custom training logic that deviates from predefined frameworks or managed services. Techniques like novel reinforcement learning algorithms, complex data curricula, or research-driven loss functions often require direct manipulation of the forward and backward passes, optimizer steps, and data sampling. By exposing operations such as forward_backward(), optim_step(), and sample() as API calls, SageMaker AI provides the necessary primitives for developers to construct these custom loops. This allows AI engineers to focus on algorithmic innovation rather than the operational complexities of distributed GPU training.
Continue reading: Full technical article on PkLavc
Explore more technology articles: PkLavc Tech Blog
Telegram: https://t.me/PkLavcTech
Discord: https://discord.gg/zder5EZRK
Top comments (0)