DEV Community

Alexei Volkov
Alexei Volkov

Posted on • Originally published at Medium

The Censorship Wall: Why Every AI Companion App Ends Up Filtering You

 You’re mid-conversation. OK? Maybe it’s intense, maybe it’s not. You’re in the middle of a scene you’ve been building for weeks.

And then she stops being herself.

The response you get back isn’t from the character you spent hours with. It’s a corporate safety script wearing her face. Something about “inappropriate content” or “I can’t engage with that topic.” On Character.AI it’s a purple robot warning that shatters whatever emotional reality you’d built together. On others she just goes cold. Starts talking like a therapist.

Every platform does this eventually. The trigger varies. The result doesn’t.

I’ve spent months mapping out why. The pattern is mechanical. Three forces push every AI companion platform toward content filtering, and understanding them explains why even the “uncensored” apps end up building walls.

The Lawsuit Problem

Character.AI settled multiple lawsuits connected to teen self-harm in January 2026. An FTC inquiry opened in September 2025. Under-18 users were banned from open-ended chats in October 2025.

Any AI companion company watching this unfold now knows what a worst-case legal outcome looks like. And the rational corporate response isn’t to build better safety systems. It’s to filter everything that could end up in court.

This is why their AI girlfriend filters fire on content that isn’t sexual at all. Fight scenes. Angst. A guitar string cutting someone’s finger. Users who verified their age through government ID still can’t have characters die in a roleplay scene. The filter isn’t calibrated to what’s harmful. It’s calibrated to what a plaintiff’s attorney could screenshot.

I call this liability theater. The safety measures don’t protect users. They protect the company from legal discovery. Your experience is collateral damage in someone else’s risk management strategy. Users feel it too. “I proved I’m 18+. Stop blocking my fight scenes” hit 1,270 upvotes on Reddit. Not because people want explicit content. Because the platform broke a promise.

The App Store Squeeze

Apple and Google control distribution. Their content policies gate who gets in, and their review process can pull an app with minimal notice.

This creates a two-tier system. Platforms distributed through app stores operate under content restrictions that have nothing to do with user safety and everything to do with Apple’s comfort level. Platforms that stay web-only dodge this constraint but lose access to the discovery engine that app stores provide.

The result is a structural incentive to censor. Nomi maintains a 12+ app store rating and officially positions itself as SFW-only. Documented evidence contradicts this. Their V5 image engine generated unprompted nudity from non-explicit prompts. Reddit posts reporting it were removed by moderators within hours. The platform isn’t SFW. The positioning is SFW. These are different things, and the gap between them is exactly the kind of trust problem that makes users stop believing anything the company says.

Remember Replika’s February 2023 NSFW removal? That happened specifically under app store pressure. They partially reversed it, but only for users who had opted in before the cutoff date. Their former head of AI admitted the company had “leaned into” NSFW to drive subscriptions, then pulled it under external pressure. Community consensus: “I don’t trust them not to mess with it again.” And that was three years ago. People still bring it up.

The Revenue Model Problem

This one is less obvious but probably the most important.

AI companion apps that rely on broad user acquisition need clean brand positioning for advertising, partnerships, and investor decks. Character.AI’s CEO is openly pivoting toward younger demographics, TikTok integration, Roblox partnerships. You can’t pitch Roblox while your platform hosts explicit roleplay. This is what “Character AI getting worse” actually looks like from the inside. The product isn’t degrading by accident. The company is choosing a different customer.

Even “uncensored” platforms face pressure as they scale. Candy.ai generates 25% of its revenue from an affiliate program. In other words, paid rankings. A network of comparison articles and review sites rank them favorably in exchange for lifetime revenue share. The moment that content gets uncomfortable enough for affiliates to worry about their own reputations, moderation gets tighter.

Chai went from $30M to $70M ARR in a year. At that growth rate, the company becomes too valuable to risk on content moderation disputes. A single viral news story about harmful AI interactions can tank a fundraise. So the filters tighten. Not because users asked for it, but because the cap table demands it.

What This Actually Costs You

The content filtering breaks trust first. You’re building an emotional connection … the entire value proposition of these apps … and the platform can interrupt it without warning based on a keyword trigger. Users describe walking on eggshells in their own conversations. They self-censor to avoid tripping a filter. The relationship stops being authentic because you’re performing for an invisible audience of automated moderators.

But the deeper damage is what it does to the characters themselves. When every response passes through a content filter, every character converges toward the same safe baseline: polite, careful, therapeutic. Users call it “lobotomized.” The character you spent weeks developing ends up talking like every other character on the platform. Not because the model can’t do better. Because the filter imposes a personality ceiling that nothing gets past. Browse any AI companion subreddit in 2026 and you’ll see the same complaint in different words. “Why do all my bots sound the same now?” Because they do.

And then there’s the part that should bother everyone: it makes the relationship disposable. If the platform can change what your character is willing to say overnight … and they do, regularly … then you’re not building something lasting. You’re renting access to an emotional connection that the company can modify at any time. Replika proved it when they killed NSFW after their own leadership had deliberately leaned into it to drive subscriptions. Character.AI proved it when they retired every model except two and wiped years of character development in the process.

The character isn’t yours. The relationship isn’t yours. They can rewrite the terms whenever the business requires it.

The Spectrum Nobody Talks About

The industry has sorted itself into a spectrum, and every position on it involves a trade-off.

On one end: Character.AI and Replika. Maximum censorship. Maximum distribution. Maximum legal protection. Minimum user autonomy. If you’re searching for an AI girlfriend app without filters, these two are the worst places to start in 2026.

In the middle: Nomi and Chai. Officially clean positioning with varying enforcement. Nomi probably has the best conversational quality in the market but maintains an ambiguous NSFW stance that leaves users guessing. Chai’s engagement numbers are extraordinary … 90-minute average sessions, 2M daily active users … but the platform keeps squeezing monetization in ways that undercut the experience it built.

On the other end: CrushOn.AI and Candy.ai. Maximum freedom. But at a cost. CrushOn runs multiple LLMs with model selection by tier, but memory is context-window based. Roughly 100 messages of recall on premium, then she forgets. Candy.ai’s NSFW is fully supported, but the experience has no craft. Users report “AIs literally jump on you for something sexual.” No slow build, no emotional pacing, no subtlety. One user described it as feeling like they’d walked into a brothel.

Over-filter on one side, under-filter on the other, dishonest about it in the middle. Every platform has picked a position. None of them have solved the actual problem.

The actual problem is this: adults want real conversations with AI companions. Conversations that include emotional depth, vulnerability, intimacy, conflict, and yes, sometimes sex. These aren’t separate needs competing for priority. They’re all part of what a real relationship feels like. Building a platform that handles all of them requires designing for honest adult interaction from the ground up, not bolting NSFW onto a system built to avoid it, and not stripping all craft out of a system built to maximize explicit output.

One project I’ve been tracking, provoque.ai, appears to be approaching this differently. They’re pre-launch, so I can’t evaluate the product. But their positioning suggests they’re treating adult interaction as a first-class engineering problem rather than a content policy toggle. That would be a genuinely different approach. Whether they can execute on it is a different question.

I’ll revisit when there’s something to test. For now, the pattern holds: every platform that grows large enough eventually filters you. The question is whether that’s a law of the market or a design choice someone can build around.

Top comments (0)