DEV Community

Cover image for Your AI Meeting Assistant Is Taking Notes. Who Is Doing the Work?
Zurab Shakhbanov
Zurab Shakhbanov

Posted on Originally published at whisperer.one

Your AI Meeting Assistant Is Taking Notes. Who Is Doing the Work?

The real value of meeting AI isn't the transcript. It's what happens after everyone leaves the call.

TL;DR

  • Transcripts and summaries now ship inside Meet, Teams and Zoom. They're table stakes.
  • The value of meeting AI is moving to what happens after the call: decisions, owned tasks, and context that survives from one meeting to the next.
  • The hard engineering problem is trust: silent failures, invented tasks, fuzzy dates and permissions. Below is a real extraction bug we hit and how we fixed it.

The call ends at 3:47.

Before you've closed the tab, the artifacts arrive. A full transcript, labeled by speaker and stamped to the second. A summary with clean headings. Five action items in bold. A link to the recording. If your tool is on the newer side, maybe a mind map.

It's genuinely impressive. Not long ago, this took a human note-taker and most of an afternoon.

Then Thursday comes.

Someone asks whether the revised proposal went to the client. Nobody is sure. The action item exists, in a document nobody reopened. The person it was assigned to remembers the conversation differently. The deadline was said out loud but never became a calendar entry. The customer complaint that surfaced in minute 31 never reached the CRM, and the "quick follow-up next week" was never scheduled.

The meeting was captured perfectly. Then it was left behind.

This is the quiet paradox of today's AI meeting assistants. They have become remarkably good at describing a conversation at exactly the point where describing stopped being the problem. The notes are done. The work isn't.

The meeting notes arms race

The market got here in recognizable phases, each solving the previous one's problem.

Phase 1: Recording. "Let's record the meeting." Useful for people who missed it, rarely rewatched. An hour of video is still an hour of video.

Phase 2: Transcription. "Let's turn speech into text." Suddenly a conversation was searchable.

Phase 3: Summarization. "Let's ask AI what happened." Language models compressed a 5,000-word transcript into a page people actually read.

Phase 4: Meeting intelligence. "Let's identify decisions, topics, risks and action items." Instead of a paragraph, you get structure: what was decided, who owns what, what's still open.

Phase 5: Agentic work. "Now let AI actually help carry out what was decided."

Five phases of meeting AI: recording, transcription, summary, intelligence, and execution.

The first four phases produce documents. The fifth produces outcomes.

The first four phases now ship inside the tools most people already use. Google Meet's "Take notes for me" puts a summary, action items and a full transcript into a Google Doc, and since June 2026 it has been available to consumer Google AI Pro and Ultra subscribers, not just business accounts. Microsoft's Facilitator agent in Teams "summarizes key decisions and open questions." Notion added AI Meeting Notes to its workspace in 2025.

The vendors are already saying phase five out loud. Zoom described its December 2025 launch of AI Companion 3.0 as part of "our transformation from a meeting company into a pioneer of AI-first intelligent work orchestration." Otter launched a meeting agent that, in Otter's words, can answer questions from an organization's entire meeting history, "schedule follow-ups, and draft emails." Granola framed its $125 million raise in March 2026 around context, calling transcripts "the richest source of context for what's happening across your company."

Nobody is disputing the direction. The open question is what it takes to get there.

Why aren't the first four phases enough? Because every one of them ends in a document. And a document, however well structured, is a passive object. It waits to be read. It has no idea whether the thing it describes ever happened.

Why transcription became a commodity

It's worth being careful here, because "commodity" is easy to hear as "unimportant." It isn't.

Accurate transcription is hard engineering. Crosstalk, accents, domain vocabulary, bad microphones and people switching languages mid-sentence all break naive systems. Knowing who said something matters, because "we'll ship it Friday" means one thing from the engineering lead and another from a salesperson. Timestamps matter because they let you go back to the source instead of trusting a paraphrase. Multilingual support matters because more and more teams don't share a first language.

All of that is real. But a capability becomes a commodity when it's everywhere and bundled, not when it becomes easy. When the platform you already hold your meetings on writes the notes for you, a transcript stops being a reason to choose a product. It's table stakes.

And even a perfect transcript isn't a result. It's raw material.

Two distinctions are worth holding on to:

Information is not action. Knowing that a decision was made doesn't make it happen.

Capturing a conversation is not the same as managing the work that conversation created.

A meeting is, among other things, a machine for producing obligations. People promise things, set dates, raise problems and push questions to later. The transcript records those obligations being created. It does nothing to see them through.

The real problem starts after the meeting

Take an ordinary product meeting. In forty minutes:

  • the team agrees to move a launch by two weeks;
  • an engineer says she'll look into a performance issue;
  • someone says the pricing page "needs updating before then";
  • a customer problem comes up that sales hadn't heard about;
  • a design doc is referenced, but nobody links it;
  • "let's sync with legal next week" is said, and everyone nods.

Now follow those six things out of the room.

The new launch date lives in someone's head until it surfaces in a Slack thread. The performance investigation becomes a ticket, if the engineer remembers. The pricing page has no owner, because "someone" said it. The customer problem goes into an email to the account manager, or doesn't. The legal sync waits for one person to find a free slot across three calendars.

One meeting scattering into Slack, email, calendar, task manager, docs, CRM, and someone's memory.
One conversation, six destinations, no shared thread.

This is fragmentation, and it isn't a failure of discipline. It's structural. The meeting produced one connected piece of understanding (these six things are related, they belong to the same launch, some depend on others) and the tools downstream can only accept it in disconnected pieces.

The research suggests this is a common complaint, not a niche one. In Microsoft's 2023 Work Trend Index survey, 55% of people said next steps after meetings were unclear. A Harvard Business Review study of 137 workers at three Fortune 500 companies found them switching between applications about 1,200 times a day, which added up to just under four hours a week spent getting reoriented. Microsoft's 2025 data found employees interrupted every two minutes during core work hours. Meetings create the work, and then the work is scattered across the same tools that keep interrupting people.

Which brings us to the question at the center of this essay:

If the AI understood the meeting, why should that understanding disappear when the meeting ends?

In most setups today, it does. The assistant builds a rich model of the conversation (who, what, when, why), flattens it into text and hands it over. Everything it understood about how those items relate to each other is lost at the export step.

From notes to decisions

The first thing that has to change is what gets extracted.

A summary answers "what was discussed?" That's the wrong question for work. The useful questions are narrower:

  • Decisions: what was actually agreed, as opposed to floated?
  • Open questions: what came up and wasn't resolved?
  • Commitments: who promised what, and to whom?
  • Owners: who is responsible, and did they accept it?
  • Deadlines: what dates were stated or implied?
  • Dependencies: what has to happen before something else can?
  • Risks: what could derail it?
  • Follow-ups: what future conversations were promised?

Here's the difference in practice.

A summary says:

Maya suggested moving the feature launch to next month. The team discussed marketing readiness.

An actionable reading says:

Decision (tentative): launch moves to next month. Proposed by Maya, no objections, not formally confirmed.

Owner: Maya, for implementation.

Dependency: marketing needs launch materials. No owner yet.

Open question: does the pricing change ship with it?

Follow-up: a review before launch was mentioned. Not scheduled.

The second version is longer and less pleasant to read. It's also the one you can act on. It separates suggested from decided, flags work nobody owns, and notices that a meeting was implied but never booked.

That first distinction, suggestion versus decision, is harder than it looks, and it's where a lot of meeting AI quietly goes wrong. Real conversations are full of hedges: "we could," "probably," "let's aim for." A system that turns every "we could" into a decision produces confident, well-formatted fiction. A system that preserves uncertainty produces something you can trust.

From decisions to actions

Once decisions and commitments have structure, a new possibility opens up. The assistant can help move them through a lifecycle:

Lifecycle: conversation, decision, task, execution.
Most meeting tools stop at the first arrow.

Most tools stop at the first arrow. The interesting work is in the other three.

Take a sentence said in thousands of meetings every day:

"Let's review the proposal on Thursday."

A summary might list "Review proposal Thursday" as an action item. An assistant that actually understands it notices several things at once:

  • it's a follow-up, a future meeting rather than a finished task;
  • Thursday is a constraint that needs resolving: which Thursday, in whose time zone;
  • a specific document is involved, and it lives somewhere;
  • the people on this call are presumably the reviewers;
  • a reminder beforehand would help;
  • all of it belongs to a particular project or client.

From that understanding, a useful assistant can propose a calendar event on Thursday with these participants and the proposal attached, filed under the client it's about.

Note the word propose.

AI should not blindly execute everything a meeting implies. People say "let's review Thursday" and then cancel. Owners decline. The next meeting changes the plan. An assistant that automatically creates every task and books every event doesn't reduce work. It creates a new kind of cleanup. Even the largest platforms design for this: Google's "suggested next steps" in Meet are something you "review and edit … and even assign", not a list that executes itself.

The right design is the one good executive assistants have always used: prepare everything, then ask. The AI extracts, resolves and drafts. The human spends a second confirming. Permissions, context and judgment stay with the person whose name is on the work.

Context is more valuable than another summary

Now zoom out beyond a single call.

On Monday, the product team discusses a launch. On Thursday, the same launch comes up in a customer call, where the customer mentions a blocker. The following week, marketing meets about the launch without the product lead in the room.

A conventional meeting assistant gives you three summaries. Each one is accurate. Together they're nearly useless, because the valuable information isn't in any one of them. It's in the differences:

The launch date moved on Monday. On Thursday, the customer raised a blocker that affects it. Marketing is still planning against the original date.

No single meeting can produce that sentence. It takes persistent context: memory that outlives the individual call and connects it to everything around it.

Persistent context, in plain terms, means the system remembers how things relate: which meetings are about the same thing, which people own what (and who hasn't been told), which project a conversation belongs to, which commitments became tasks, what's on the calendar and what was promised but never booked, which documents are involved, and which earlier decisions are being quietly reversed.

This is where the real intelligence lives. Not "what was said in this meeting," but "what changed, and what does that mean for the work already in motion?"

The rise of the AI workspace

All of this points to a different shape of product.

For most of the last decade, each kind of work lived in its own tool. The meeting tool produced transcripts. The calendar held events, the task manager held tasks, the knowledge base held documents, and the AI chatbot produced answers.

Each tool is good at its job. None knows what the others know. The human is the integration layer, copying, pasting and remembering.

An AI workspace is a system where conversations, knowledge, tasks, calendar and an AI agent share one context, so what's understood in one place is available in all the others.

Left: separate tools, each with its own output. Right: conversations, knowledge, tasks, calendar, and documents feeding one shared context used by an AI agent.

From tools that each know one thing to one context the agent can reason across.

The difference isn't the number of features. Plenty of suites have plenty of features. The difference is whether the AI can reason across them: whether a commitment from a meeting can become a task, whether that task knows which project it belongs to, and whether the agent answering your question on Friday knows what was decided on Monday.

Open standards make this more practical. Anthropic introduced the Model Context Protocol (MCP) in November 2024 as "an open standard that enables developers to build secure, two-way connections between their data sources and AI-powered tools." In practice, it's a common plug that lets an AI agent reach tools and data without a custom connector for each one. MCP doesn't create shared context on its own. Someone still has to decide what's worth remembering and how it connects. But it lowers the cost of letting an agent reach the places where work actually happens.

The AI workspace isn't one company's idea or a finished category. Large platforms are approaching it from the suite side, smaller tools from the meeting side. Both have concluded that a smart transcript is not a destination.

Six questions to ask of any meeting AI

If the goal is continuity between conversations and work, here's the stack, with a question to ask of any tool, including the one you use now.

1. Capture

Does it hear the conversation accurately: who spoke, when, and in what language?
Everything downstream inherits the errors made here.

2. Understand

Can it tell a decision from a suggestion, and a commitment from a comment?
This is where summaries become structure, and where overconfident extraction does the most damage.

3. Connect

Does it know which project, client or earlier conversation this meeting belongs to?
A decision without context is just a sentence.

4. Act

Can it turn a commitment into a task, a reminder or a calendar event, with your confirmation?
Acting without confirmation is a liability. Confirmation without the ability to act is a to-do list you still have to type.

5. Remember

Next month, will it still know what was agreed today, and notice if that changes?
Memory is what turns a series of meetings into a history.

6. Assist

Before your next conversation, can it tell you what's open, what's due and what's changed?
The loop closes when the output of one meeting becomes the preparation for the next.

Most tools on the market are strong at the first two. The competition that matters now is over the last four.

Where Whisperer fits

Whisperer was built around a simple observation: work doesn't happen inside isolated applications. It happens across them, and a lot of it starts in a conversation. So instead of building a better notetaker, we set out to build the workspace the notes flow into.

Capture, without a bot in the room. The desktop apps for macOS and Windows record the microphone and system audio on your own machine, so they work with Zoom, Google Meet, Teams and other call apps without a bot joining. The transcript is live and timestamped. You can screenshot a slide or an error message and have the AI read it, and real-time translation helps when the meeting isn't in everyone's first language.

Understanding that shows its sources. After the call, Whisperer extracts decisions, commitments, risks and open questions, and each decision and commitment keeps its source: which meeting, which moment, who said it.

A transcript becomes more useful when it can become a task. A commitment can go onto a kanban board with a due date, and two-way sync with Google, Microsoft and CalDAV calendars turns a follow-up into an actual event.

A task becomes more useful when it belongs to a project. Work is organized into hubs, such as a client, a project or a hiring round. Meetings are routed to them by signals like the calendar series and participants, and when the match is unclear, Whisperer asks instead of guessing. A hub shows what's slipping: obligations coming due, open decisions, work nobody owns.

A project becomes more useful when its context survives across meetings. Leo, Whisperer's AI agent, can trace a topic across meetings, find past decisions and search the knowledge base, and it keeps a long-term memory you can review and edit.

And an AI assistant becomes more useful when it can reason across all of them. Leo drafts the task, the event or the reminder, and you confirm it before anything changes. An MCP server lets Claude, ChatGPT or Cursor work with the same context, under permissions you approve.

None of this makes the hard problems go away. Which brings us to them.

The hard part isn't building another AI notetaker

It's worth being honest about where the difficulty is, because it's not where most product demos suggest.

Connecting a speech-to-text model to a large language model and printing a summary is, by now, a weekend project. The problems that separate a demo from something people rely on are less photogenic:

  • Hallucinated tasks. A model that invents an action item nobody agreed to is worse than no model, because now someone has to notice it and delete it. False positives erode trust faster than misses do.
  • Identity and ownership. Is "I'll take a look" a commitment? Whose, if three people were talking over each other? Assigning an owner depends on knowing who's who, and names in transcripts are messy.
  • Temporal reasoning. "Next Thursday," said on a Wednesday. "End of quarter," at a company whose fiscal year doesn't match the calendar. "After the launch," when the launch has moved twice. Dates in speech are relative, ambiguous and often revised.
  • Cross-meeting memory. Remembering is easy. Remembering the right things, noticing when a later meeting overrides an earlier decision, and letting stale facts fade is hard.
  • Permissions. Not everyone in a workspace should see every meeting. An agent that reasons across your conversations has to respect the boundaries implied by who was invited.
  • Reliable actions. Every write is a place where the system can be wrong in public. The confirmation step has to be fast enough that people use it and clear enough that they actually read it.
  • Privacy. Meetings hold some of the most sensitive information a company produces. Users deserve plain answers about what's stored, for how long, and who processes it, including when the answer is "an external model provider."
  • Integrations. Context is only as good as its reach, and every connection to another tool is a new place for things to fail and a new permission to manage.

The failure that looks like a quiet meeting

Here's one we learned the hard way.

Whisperer reads a long transcript in chunks and asks a language model to pull decisions, commitments and risks out of each one. Every so often, the model provider answered with a perfectly normal success response and an empty body. Our pipeline parsed nothing, recorded that the chunk contained nothing, and reported success.

From the outside, "nobody decided anything in that stretch of the meeting" and "the extraction silently broke" looked exactly the same.

We caught it by replaying real recorded meetings through the extractor and comparing runs. The empty answers turned out to be random: two runs of the same meeting lost different chunks. That meant a single retry would fix most of the damage, and it did. On three of our own meetings, the number of extracted items went from 20 to 45 once each empty answer got one retry. In one meeting of 149 speaker turns, it went from 4 to 22. Now a chunk that still comes back empty is counted and reported, not passed off as silence.

A related bug had our agent answering "no decisions in that period" against a full archive, because the decisions were stored without the date the search filtered on. Nothing crashed, and every answer sounded confident.

The lesson carries beyond our product. For an assistant that acts on meetings, the most dangerous error isn't a wrong answer. It's a missing answer that looks like a real one. "Nothing was decided" is a claim too, and the system has to earn it.

What ties these together is trust. An assistant that summarizes can afford to be roughly right. An assistant that acts has to be right, or visibly unsure, every time. That's a different engineering discipline, and it's where the next generation of these products will be won or lost.

What AI meeting assistants may become

It's tempting to make big predictions here. It's more useful to describe a direction.

Meeting assistants appear to be moving from passive recorders toward AI work companions. The difference is easy to state.

Passive:

Here is what happened.

Active:

Here is what happened, what changed since last time, what matters, what you committed to, and what needs your attention next.

The passive assistant looks backward at one conversation. The active one looks forward across all of them: it brings the three open items from the last meeting to the next one, and it reminds you of a promise before it's late, not after.

None of this requires the AI to take over. The best version is closer to a chief of staff than an autopilot: it prepares, connects and reminds, and people decide.

The meeting is only one moment

For a few years, the story of meeting AI was about capture: record everything, transcribe everything, summarize everything. That story has mostly been told. The notes are good now.

The future of meeting intelligence isn't better notes. It's better continuity between conversations and work, so that what gets decided in a room doesn't have to be carried out of it by hand.

The meeting is only one moment.

The real value begins after it ends.

Whisperer is an AI workspace where conversations, context and work are connected: whisperer.one.


Sources & Further Reading

  1. "Gemini can now take notes in Google Meet for Google AI Pro and Ultra subscribers", Google (The Keyword), June 29, 2026. https://blog.google/products-and-platforms/products/workspace/take-notes-for-me/
  2. "'Take notes for me' in Google Meet now captures next steps", Google Workspace Updates, February 18, 2025. https://workspaceupdates.googleblog.com/2025/02/google-meet-take-notes-for-me-next-steps.html
  3. "Facilitator in Microsoft Teams meetings", Microsoft Support (product documentation). https://support.microsoft.com/en-us/teams/copilot/facilitator-in-microsoft-teams-meetings
  4. "Zoom launches AI Companion 3.0 with agentic workflows, transforming conversations into action", Zoom Newsroom, December 15, 2025. https://news.zoom.com/zoom-launches-ai-companion-3-0/
  5. "Otter.ai Breaks $100M ARR Barrier and Transforms Business Meetings Launching Industry-First AI Meeting Agent Suite", Otter.ai, March 25, 2025. https://otter.ai/blog/otter-ai-breaks-100m-arr-barrier-and-transforms-business-meetings-launching-industry-first-ai-meeting-agent-suite
  6. "Granola raises $125M to put your company's context to work", Granola, March 25, 2026. https://www.granola.ai/blog/series-c
  7. "Will AI Fix Work?" (Work Trend Index 2023), Microsoft WorkLab, May 2023. https://www.microsoft.com/en-us/worklab/work-trend-index/will-ai-fix-work
  8. "Breaking down the infinite workday" (Work Trend Index special report), Microsoft WorkLab, June 17, 2025. https://www.microsoft.com/en-us/worklab/work-trend-index/breaking-down-infinite-workday
  9. "How Much Time and Energy Do We Waste Toggling Between Applications?", Rohan Narayana Murty, Sandeep Dadlani and Rajath B. Das, Harvard Business Review, August 29, 2022. https://hbr.org/2022/08/how-much-time-and-energy-do-we-waste-toggling-between-applications

10. "Introducing the Model Context Protocol", Anthropic, November 25, 2024. https://www.anthropic.com/news/model-context-protocol

Top comments (0)