Solid overview of the async job pattern. One thing I'd push back on though - the article doesn't mention step distillation or consistency models for reducing sampling steps. In practice that's where most teams get their biggest latency wins before touching infra at all.
Solid overview of the async job pattern. One thing I'd push back on though - the article doesn't mention step distillation or consistency models for reducing sampling steps. In practice that's where most teams get their biggest latency wins before touching infra at all.
I agree with your point