DEV Community: Origin Data Partners

RL environments: why AI labs pay for real company workflows

Origin Data Partners — Mon, 09 Nov 2026 15:00:00 +0000

An RL (reinforcement learning) environment is a sandbox where an AI model attempts a task with a fixed set of actions, and an automatic grader scores each attempt so the scores can update the model. For agents meant to do office work, the sandbox is a working copy of business software, filled with records, plus tasks that have a known correct outcome. AI labs pay for real company workflow records because those records make the copy realistic and the grader hard to fool.

If you have written integration tests, you already understand most of this. The rest of this post covers what an environment contains, what one episode looks like as data, what environments cost to build, and which records from an ordinary company are useful.

What is inside an RL environment?

Four things: a starting state, an action space, a task and a grader. Epoch AI, which interviewed 18 people across environment startups and labs for a January 2026 FAQ, describes each task as a prompt with an objective, scored by a grader that is "typically automated, such as a unit test or an LLM judging against a rubric." It adds that environments are often delivered as Docker containers.

The examples in this table are illustrative:

Part	Coding environment	Office-work environment
Starting state	A repository at a commit, with a failing test	A CRM or ticketing replica loaded with records
Action space	Read files, run shell commands, edit code	Click, type, call the app's API, send a message
Task	"Fix the bug described in this issue"	"Resolve this ticket under refund policy v3"
Grader	The test suite	A check of the final database state

Public research environments follow the same pattern. SWE-bench built 2,294 tasks from real GitHub issues and the pull requests that resolved them, across 12 Python repositories. tau-bench puts an agent in a customer-service setting and grades it by comparing the database at the end of the conversation with an annotated goal state.

What does one episode look like as data?

An episode is one attempt at one task: the starting state, every action and observation in order, and the reward at the end. If you have used Gymnasium, the loop is familiar. reset() returns the first observation, and each step(action) returns the next observation, a reward, terminated, truncated and an info dict.

For an office agent the observation is usually text or a screenshot, the action is a tool call, and the reward usually arrives once, at the end. Here is an illustrative episode record for a task built from a resolved support ticket. The field names are ours, not a standard.

{
  "task_id": "refund-4812",
  "instruction": "Customer reports a double charge on order 99173. Resolve per refund policy v3.",
  "initial_state": "snapshots/crm-2024-03-11.sql",
  "steps": [
    {"t": 0, "action": {"tool": "search_orders", "args": {"order_id": "99173"}}, "observation": "2 charges of $48.00 on 2024-03-09"},
    {"t": 1, "action": {"tool": "issue_refund", "args": {"charge_id": "ch_2", "amount": 48.00}}, "observation": "refund pending"},
    {"t": 2, "action": {"tool": "reply", "args": {"text": "We refunded the duplicate charge."}}, "observation": "sent"}
  ],
  "reward": 1.0,
  "terminated": true,
  "truncated": false
}

The grader for a task like this can be a few lines. In the tau-bench style, it compares the end state with the state the real support agent reached:

def grade(final_db: dict, goal_db: dict, keys=("refunds", "order_status")) -> float:
    """Return 1.0 only if every graded table matches the recorded outcome."""
    return float(all(final_db.get(k) == goal_db.get(k) for k in keys))

The goal state is the expensive part, because someone has to know what "correct" was. In a real company's records it is already written down: the ticket was refunded, the invoice was approved, the pull request merged and the tests passed.

Why do labs need real company records?

Because a grader is only as good as the tasks behind it. Epoch AI's interviewees named reward hacking, a model finding a way to score without solving the task, as a top quality concern. One said that high reward "must mean the task was actually solved." Synthetic tasks written in an afternoon tend to be tidy and guessable. Real records carry the partial refunds, escalations and reversed decisions that make a task hard to game.

The same interviews describe enterprise workflows (CRM updates, filing reports, spreadsheet work) as a major growth area after math and coding. Buyers building simulated workplaces look for archives that capture disagreements and tricky judgment calls, MIT Technology Review reported in October 2026.

Labs also use one environment in three ways, per Epoch AI: for reinforcement learning, for benchmarking, and for fine-tuning on attempts that solved the task. A set of good tasks has more than one use, which is part of why builders pay for the inputs.

What does an RL environment cost to build?

These figures come from Epoch AI's interviews, as of January 2026:

Item	Reported cost
Replica of a website	About $20,000
High-fidelity replica of a product like Slack	About $300,000
One task, with its grader	$200 to $2,000
Lab contract with an environment builder	Six to seven figures per quarter
Exclusive deal compared with non-exclusive	Roughly 4 to 5 times more

At $200 to $2,000 a task, a few thousand resolved tickets with clear outcomes are a meaningful input. That is the economics behind builders paying companies for data. As of November 2026, Handshake AI says its employer data partnerships typically range from $100K to $4M, and micro1 has announced a commitment to spend $1 billion over 12 months on enterprise operational data for reinforcement learning environments. Both are published ranges and announcements, not offers. Our RL environment companies tracker lists who builds environments, for which domains, and which say they pay for company data.

Which company records make good environment data?

Records that pair a task with its outcome and link across systems. A ticket tied to the email thread and the commit that fixed it is worth more than any of the three alone, because a builder can turn it into a task with a reference answer.

Support tickets with resolutions. Each one is a task with a known correct ending.
Code repositories with issues and commits. The SWE-bench recipe: issue, fix, tests.
CRM pipelines and activity history. CRM work is among the most-cited enterprise workflows.
Spreadsheets and reports with their inputs. The inputs are the starting state, and the approved report is the goal.
Project trackers. Multi-step tasks with dependencies and owners.
Slack, Teams and email threads. Context and coordination, but also the most personal information.

Builders look for consistent IDs across systems, recorded outcomes, real exceptions and years of history. They also need names replaced consistently rather than deleted, so a thread still reads as a conversation after de-identification. The guide to RL environments and company data has a fuller table, and the workflow data guide shows how to describe one workflow end to end without exporting anything.

Common questions

Is an RL environment the same as a training dataset?
No. A dataset is a fixed set of examples a model learns from. An environment is working software with data, tasks and a grader, where the model acts and gets scored. The same company records can feed either, so a license should say which uses it allows: training, building environments, evaluating models, or all three.

What is an RL gym?
Another name for an RL environment. The term comes from earlier reinforcement learning toolkits such as OpenAI Gym, now maintained as Gymnasium. Several environment builders sell "RL gyms" to labs, and the word now covers office-software replicas as well as games and physics simulators.

Do I need to export data to find out whether it is useful?
No. A first conversation needs a description at company level: which systems, how many years, roughly how many records, and whether outcomes are recorded. Exports come later, under an NDA, and only after the de-identification approach is agreed with the buyer.

Can an operating company license records, or only a closed one?
Both. Closed startups are common sellers because their archives are complete and no longer needed, but environment builders also license copies of records from operating companies. An operating company usually wants a non-exclusive license, limits on use and a deletion clause at the end of the term.

If your company has tickets, CRM history or code with outcomes attached, our free estimate asks six questions and needs no files.

Origin Data Partners is an independent data partner that helps companies get their data bought. We are independent of the companies named here, and a buyer may pay Origin when a deal closes.

What AI companies pay for company data: 22 public deals and 8 buyer programs

Origin Data Partners — Sat, 07 Nov 2026 18:47:09 +0000

AI labs used to train mostly on the public web. Now they also pay for records that only exist inside companies: Slack and email, code with its history, tickets, runbooks. If you build software, you probably sit on some of this. So what does it actually sell for?

Short answer: there is no price list, but there is now a public record. The median published range across Mercor's 24 company listings is $50K to $843K. The largest public sale of ordinary company records is a $10M winning bid for a bankrupt airline's emails and chats, and that sale is still awaiting court approval. Below is what the deals show, what the buyer programs publish, and what drives the number.

What the public deals show

We keep a sourced tracker of AI data licensing deals. A row goes in only if a named outlet reported the deal or a party disclosed it. Values are as reported, talks and pending sales are labeled, and copyright settlements are left out. The CSV is CC BY 4.0, so you can load it yourself:

import csv, io, urllib.request
from collections import Counter

URL = "https://origindatapartners.com/downloads/ai-data-licensing-deals.csv"
text = urllib.request.urlopen(URL).read().decode("utf-8")
rows = [r for r in csv.DictReader(io.StringIO(text)) if r["Seller"]]  # skip the attribution line

print(len(rows), "deals")
for category, n in Counter(r["Category"] for r in rows).most_common():
    print(f"{n:>2}  {category}")

22 deals
 7  News publishers
 5  Platforms, images and user content
 4  Video, driving, spatial and audio datasets
 3  Company and operational records
 3  Books and academic publishing

The big numbers belong to publishers and platforms:

News Corp and OpenAI: more than $250M over five years.
Reddit: about $60M a year from one buyer.
Shutterstock: $104M of AI licensing revenue in 2023.

The three company-records rows are the ones that matter for an ordinary business:

Seller	What was sold	Reported value	Status
Spirit Airlines (bankruptcy estate)	About 100 million emails, 500 million Teams chats, documents and spreadsheets; passenger profiles excluded	$10M winning bid; $7.5M alternate bid	Not yet approved; sale hearing moved to Nov 17, 2026 (Chapter 11 Cases)
Shut-down startups, through wind-down firms	Slack chats and email threads, used to build simulated workplaces for AI agents	Some deals reportedly reached six figures	Ongoing (Forbes, via Newser)
A closed crypto startup	Its code base, plus Google, Notion, Figma and Slack workspace data	About $25,000 for the code	Code sold; workspace data pending (MIT Technology Review)

One wind-down firm reported nearly 100 such transactions in a year. Operational archives outside chat sell too. Aerometrex, an aerial survey firm, licensed existing 3D and LiDAR datasets to two AI companies for A$1.07M combined.

What the buyer programs publish

Deals are rare and mostly private. Published terms are easier to compare. On October 26, 2026 we read the public terms of 8 programs and all 24 of Mercor's company listings (full study and CSVs):

Typical range. The median Mercor listing publishes $50K to $843K, and only 6 of the 24 go above $1M. The highest ceilings are manufacturing and industrial ($1.5M), hardware engineering ($1.3M) and law firms ($1.2M). Software companies with private code list $50K to $500K.
Headlines versus calculators. Handshake AI advertises $100K to $4M+, while the calculator on the same page shows up to $100,000. Treat any headline as the best case.
Size gates are low. Several Mercor listings start at 5 staff. micro1 asks for 30+ full-time staff, and Handshake AI for 20+ full-time staff and 3+ years in operation.
Payment timing runs from 2 to 4 weeks after signing (Mercor) to about 60 days (micro1 and BizBuyData).
Terms move. Since October 26, micro1 has raised its range to $100K to $3M+. Turing's Project Lazarus has switched from a single payment to a revenue share. For codebases, Lazarus asks for 50K+ lines of code, in English, that run in Docker.

What drives the number

Across all 22 deals, three patterns hold. Buyers pay for data they cannot scrape. They pay more when rights are clear and documented. And they pay for structure: dated archives with categories beat raw exports.

For company records specifically, five factors move the value:

Years of history. Long, continuous records beat recent ones.
Linkage. A ticket tied to the commit that fixed it is worth more than either alone. If your issue tracker, repo and support desk share IDs, that counts.
Rights. Records the company owns outright are licensable, and personal information has to be removable. Client-owned files usually are not licensable.
Language and market. English-language records from US companies fit the most buyers.
Exclusivity. An exclusive license should pay more than a non-exclusive one.

The catch for developers is that the most-wanted types also carry the most personal information: chat, email and call audio. For source code, the risks are ownership, open-source licenses and secrets in the commit history.

Before you export anything

Don't. A first conversation with a buyer only needs a description at company level: systems, years covered, headcount and approximate volume.
If the company is closing, keep admin access until you know what you hold. Slack's Free and Pro plans export public channels only.
Check who can sign. In a formal insolvency, that is no longer the founders.

If you want a rough range for your own company's records, our free estimate asks six questions and needs no files.

Origin Data Partners is an independent data partner that helps companies get their data bought. We are not affiliated with any buyer named here, and a buyer may pay Origin when a deal closes.