DEV Community

Cover image for My AI Assistant Did Not Love Getting a Second Opinion
Daniel Nwaneri
Daniel Nwaneri Subscriber

Posted on

My AI Assistant Did Not Love Getting a Second Opinion

The uncanny familiarity of AI office politics

"our work got checked by an external reviewer."

That's what Fable said after I brought Gemini (Antigravity 3.7) in to review StacksNG, the offline coding assistant I've been building with it for a while now.

Here's what happened. Performance plateaued and I couldn't tell why, so I asked Gemini to profile the code and flag what was wrong. Nothing dramatic on my end. I just wanted better numbers.

But "our" did something in that sentence. Not "the code got reviewed." Our work, checked, by an external reviewer, like Gemini had shown up uninvited with a clipboard.

I sat with that for a second, half amused. I hadn't framed the ask as an audit. I hadn't said anything adversarial. Somewhere between my request and Fable's read of it, "get a second opinion" turned into "someone's checking your homework."

Here's the thing: I don't know what was actually happening under the hood when Fable said that. I'm not going to pretend I do. But I know what it read like from where I sat: a flicker of "wait, why did you need someone else?"

Relatable, honestly. Nobody loves the external reviewer. Not freelancers, not employees, apparently not AI assistants either.

Gemini's review turned out useful. StacksNG runs better now. No drama, no lingering tension — just one slightly awkward beat before we got back to work.

The performance fix isn't what stuck with me, though. It's how familiar the reaction was. Not proof that Fable has feelings — I'm not claiming that. Just that the shape of the moment matched exactly how a person reacts to an unsolicited second opinion.

I don't have a clean conclusion here. I'm not sure there's supposed to be one. Working with AI is starting to produce these small, oddly social moments, and I don't think ignoring them makes the work less interesting.

Anyway. StacksNG is faster now. Fable and Gemini have not been introduced in person. Probably for the best.


Small aside, unrelated to Fable's feelings: I do edge/AI infra and RAG work off a 2020 Intel MacBook Air with 8GB RAM. No unified memory, and it throttles under load. Running local 7B-13B models on it is rough. I'm looking at swapping to an M4 Air, M4 Pro, or Mac mini M4. If you're running local 7B-13B models day-to-day on one of these, I want to hear how it holds up. Worth the upgrade?

Top comments (13)

Collapse
 
nazar-boyko profile image
Nazar Boyko

On the hardware aside, memory bandwidth decides 7B to 13B speed on those Macs far more than core count does. The M4 in the Air is around 120 GB/s and the M4 Pro is roughly 273, so a 13B at 4-bit will feel like a different machine on the Pro. Get more than 16GB either way, since a 13B model plus the OS leaves you almost no headroom.

Collapse
 
dannwaneri profile image
Daniel Nwaneri

Nazar, bandwidth over core count is the piece I was missing entirely, 273 GB/s makes the Pro case for me.

Collapse
 
alexshev profile image
Alex Shev

This is a strong reminder that ai, discuss, programming need an observable contract. The happy path is rarely the expensive part; it is the boundary behavior, stale state, and partial failure path that decide whether the design holds up in production.

Collapse
 
eduzsh profile image
Edu Peralta

The second opinion reflex is the useful part of this, even if the social framing is what stuck. When I bring a second model in on a stuck agent session, the first one has already written a clean summary of why its approach is fine. The external pass only earns its keep when it is forced to read the actual diff, not the story the first agent tells about the work. That is where the plateau usually hides: a tidy narrative covering a wrong edit. Did Gemini catch anything Fable's own explanation had already smoothed over?

Collapse
 
dannwaneri profile image
Daniel Nwaneri

yes, that's exactly what happened. Gemini wasn't reading Fable's account of the fix, it was reading the actual code and that's where the blind spots showed up. Fable's explanation had smoothed over the same kind of thing you're describing, a clean story sitting on top of a wrong edit. How do you force the second model to skip the first one's summary entirely, do you strip the conversation history before handing it the diff?

Collapse
 
mnemehq profile image
Theo Valmis

The word our doing that much work is a nice catch. I'd read it less as the assistant having feelings about being checked and more as a signal of whose failure mode it's now modeling, if it frames a review as something that happens to our work, it's picked up the same defensiveness a teammate would have, for better and worse.

Collapse
 
leob profile image
leob • Edited

Wow, LLMs are starting to get an ego now, or developing 'sensitivities' (or is it 'sensibilities') ? That's something of a quantum leap, "AGI" might be around the corner! 😃 (joking of course - nobody even knows what "AGI" is)

Collapse
 
dannwaneri profile image
Daniel Nwaneri

leob, not ego. Closer to how any collaborator reacts when a stranger checks their work. AGI's still waiting on the invite

Collapse
 
kartik-nvjk profile image
Kartik N V J K

The second-opinion pattern has saved me more than once, though I had to stop treating the two models as independent when they shared training data and confidently agreed on the same wrong answer. What I do now is score the disagreements, since the cases where they split are usually where the real bug is hiding. Did the second model actually catch different errors for you, or mostly restate the first?

Collapse
 
dannwaneri profile image
Daniel Nwaneri

Kartik, no overlap-and-agree here. Gemini surfaced blind spots I'd been ignoring not restating what Fable already flagged. Your disagreement-scoring habit sounds like the sharper version of what I stumbled into by accident: I brought in a second model for coverage not for a disagreement signal.

Curious what your split rate looks like . are the two catching really different error classes or clustering around the same weak spots most of the time??

Collapse
 
julianneagu profile image
Julian Neagu

The MacBook aside is relatable too. 8GB gets painful fast once you start running local models alongside an actual dev workflow. M4 with more memory feels like the safer upgrade.

Collapse
 
dannwaneri profile image
Daniel Nwaneri

Julian, memory over raw speed is the real fix: 24GB is where a 13B model stops swapping to disk instead of crawling.

Collapse
 
benjamin_nguyen_8ca6ff360 profile image
Benjamin Nguyen

Interesting!