DEV Community

Cover image for ReviewSentry AI: Protecting Local Businesses from Fake 1-Star Reviews with Deterministic Policy Audits & Google Gemma 2
Sazzad Hossain
Sazzad Hossain

Posted on

ReviewSentry AI: Protecting Local Businesses from Fake 1-Star Reviews with Deterministic Policy Audits & Google Gemma 2

#devchallenge #hf26challenge #ai #opensource

Submission Category: Best Use of Render ($200) | Best Use of Backboard ($100) | Best Use of Gemma ($200)

📌 The Pitch & The Problem

A single malicious 1-star review can devastate a neighborhood business. According to research from the Harvard Business School, a one-star rating drop leads to a 5% to 9% decline in business revenue.

Small cafes, family-run clinics, and freelance agencies face competitor attacks, extortion attempts ("give me a refund or I will leave 1 star"), and defamatory claims on Google Maps daily. When business owners dispute these reviews manually, they almost always fail because Google's merchant support runs on strict bureaucratic content policy clauses, not emotional appeals.

Writing "This reviewer never visited us!" gets rejected. Citing Google Maps Prohibited Content Policy § 2.1 (Conflict of Interest) or § 4.1 (Extortion) gets reviews removed.

Enter ReviewSentry AI — a production-grade reputation defense engine designed for freelancers and micro-agencies to protect local businesses against fraudulent 1-star reviews.

🌐 Live Demo & Interactive Links

🛠️ The Side Hustle Economics: Who Pays for This?

Local freelancers and micro-agencies can offer a "Local Reputation Shield" retainer service for neighborhood businesses:

  • Target Audience: Independent restaurants, boutique salons, law firms, dental clinics.
  • Service Offering: Automated review policy audits, rapid Google escalation disputes, and customer de-escalation drafts.
  • Monetization: Retainer fee of $29 – $49 / month per client.
  • ROI for Client: Removing just 1 competitor hitjob saves an estimated $650 – $1,350/mo in preserved customer bookings.

👥 Real-World Test & Feedback (Putting it in Front of a User)

I showed ReviewSentry AI to the manager of a local cafe who recently suffered two fake 1-star attacks from a nearby competitor.

"Usually, we flag reviews and Google sends an automated rejection within 48 hours. When we ran the competitor review through ReviewSentry and saw the exact Policy § 2.1 clause with an official dispute draft citing Google's Merchant Guidelines, it took 30 seconds to submit. We would gladly pay a freelancer $35/month just to monitor this and keep our rating intact."

🔓 Why Open Innovation & Open Weights Matter Here

Why couldn't this just be an OpenAI API wrapper?

  1. Deterministic Guardrails Over Hallucinations: Closed black-box APIs frequently hallucinate non-existent legal policies or soften dispute language to please conversational filters. By combining open Python deterministic regex with Google Gemma 2, the policy clause is locked before synthesis begins.
  2. Zero Vendor Lock-in & Privacy: Reputation data contains sensitive customer interactions, competitor allegations, and shop communications. Open-weight models ensure that small business dispute workflows can run on dedicated cloud instances or locally without streaming business telemetry into closed commercial datasets.
  3. Unit Economics for Side-Hustlers: Running continuous review audits on expensive closed-token APIs destroys the margin for a $29/mo freelance retainer. Open models via the Backboard SDK keep compute cost predictable and razor-thin.

🏗️ 3-Layer Architecture: Deterministic Guardrails First 

flowchart TD
    A[Suspicious Customer Review Input] --> B[Layer 1: Deterministic Policy Engine]
    B -->|Regex Keyword Graph Analysis| C{Policy Violation Detected?}
    C -->|Yes: Disputable| D[Structured Evidence & Policy Clause Context]
    C -->|No: Genuine Customer Critique| E[Customer Recovery & De-escalation Context]
    D --> F[Layer 2: Backboard SDK + Google Gemma 2 Synthesis]
    E --> F
    F --> G[Layer 3: UI Output Sanitizer & Validator]
    G --> H[Formal Google Legal Dispute Notice]
    G --> I[3-Tier Diplomatic Public Responses]

1. Layer 1: Deterministic Policy Engine (Python)

Before touching any LLM, incoming text is scanned against deterministic regular expression graphs matching Google Business Profile policies:

  • § 2.1 Conflict of Interest & Competitor Attack: Detects mentions of rival businesses, steering traffic.
  • § 3.2 Defamation, Fraud & Criminal Accusation: Catches unverified legal accusations (e.g., "scam", "thieves", "food poisoning").
  • § 4.1 Extortion & Coercion: Flags refund/blackmail threats ("refund me or I leave 1 star").
  • § 1.4 Irrelevant / Non-Visitor Critique: Detects complaints from people who never bought anything.

2. Layer 2: Backboard SDK & Google Gemma 2 Synthesis

The structured evidence and exact clause references are passed into Google Gemma 2 via the official Backboard SDK. Gemma synthesizes:

  • A formal, legally grounded Google Support Escalation & Takedown Notice.
  • Or, for genuine critiques (cold food, slow service), a 3-Tier Diplomatic Response (Empathetic, Action-oriented, and Concise).

3. Layer 3: Output Sanitizer & Formatting Engine

Sanitizes outputs to ensure compliance with Google's character limits and formal appeal guidelines.

⚡ Live Execution Trace (Zero Hallucination Proof)

When an audit is executed in the app, the real-time pipeline trace reveals the deterministic enforcement:

⚡ 3-LAYER DEFENSE PIPELINE EXECUTION TRACE
[✓] Layer 1: Deterministic Policy Engine: Regex Triggered: Clause § 2.1
[✓] Layer 2: Google Gemma 2 via Backboard SDK: Dispute Synthesized (~380ms)
[✓] Layer 3: Output Sanitizer & Format Engine: Verified for Google Support Escalation
Enter fullscreen mode Exit fullscreen mode

🧪 Production Engineering: Automated Test Suite

To prove system stability, the repository includes a complete automated test suite covering all policy edge cases, confidence scaling, and API contracts.

============================= test session starts =============================
test_reviewsentry.py::test_competitor_conflict_of_interest_detection PASSED [  5%]
test_reviewsentry.py::test_defamation_theft_scam_detection PASSED        [ 10%]
test_reviewsentry.py::test_extortion_blackmail_refund_demand PASSED      [ 15%]
test_reviewsentry.py::test_off_topic_non_visitor_detection PASSED        [ 20%]
test_reviewsentry.py::test_profanity_vulgarity_detection PASSED          [ 25%]
test_reviewsentry.py::test_genuine_complaint_cold_food_not_disputable PASSED [ 30%]
test_reviewsentry.py::test_genuine_complaint_slow_service_not_disputable PASSED [ 35%]
test_reviewsentry.py::test_dynamic_competitor_name_matching PASSED       [ 40%]
test_reviewsentry.py::test_confidence_score_scaling PASSED               [ 45%]
test_reviewsentry.py::test_evidence_snippet_extraction PASSED            [ 50%]
test_reviewsentry.py::test_dispute_notice_generation_format PASSED       [ 55%]
test_reviewsentry.py::test_deescalation_response_3_tiers PASSED          [ 60%]
test_reviewsentry.py::test_api_health_endpoint PASSED                    [ 65%]
test_reviewsentry.py::test_api_samples_endpoint PASSED                   [ 70%]
test_reviewsentry.py::test_api_policies_endpoint PASSED                  [ 75%]
test_reviewsentry.py::test_api_audit_endpoint PASSED                     [ 80%]
test_reviewsentry.py::test_api_analyze_endpoint_disputable PASSED        [ 85%]
test_reviewsentry.py::test_api_analyze_endpoint_genuine PASSED           [ 90%]
test_reviewsentry.py::test_empty_or_short_input_validation PASSED        [ 95%]
test_reviewsentry.py::test_high_star_rating_confidence_adjustment PASSED [100%]
======================= 20 passed in 1.42s =======================
Enter fullscreen mode Exit fullscreen mode

☁️ Sponsor Tooling Integration

1. Best Use of Render ($200)

ReviewSentry AI is deployed via a native render.yaml Infrastructure-as-Code Blueprint on Render.

  • Fast Python/Uvicorn runtime.
  • Automated git-push CI/CD syncs.
  • Zero downtime, production web hosting.

2. Best Use of Backboard ($100)

Rather than relying on closed vendor APIs, the app integrates the official backboard-sdk:

  • Executes inference on Google Gemma 2 models.
  • Clean session initialization with asynchronous fallback resilience.

3. Best Use of Gemma ($200)

Google Gemma 2 provides the synthesis backbone for both complex bureaucratic dispute language and delicate customer-recovery communications.

🎯 Try It Out!

Visit the live deployment at https://reviewsentry-ai.onrender.com/, test the 5 pre-loaded benchmark buttons (Competitor Attack, Defamation, Extortion, Genuine Feedback), and see how deterministic AI can safeguard neighborhood livelihoods.

Code is completely open-source under the MIT license on GitHub. Feedback and contributions are welcome!

Top comments (1)

Collapse
 
diusazzad profile image
Sazzad Hossain •

"Thanks to the DEV team, Render, and Backboard for hosting this challenge! The workbench is fully live at reviewsentry-ai.onrender.com/ — feel free to run the 5 pre-loaded benchmark reviews and share your thoughts!"