DEV Community: Matt Joshi

How I Used Python Fuzzy Matching to Detect Duplicate Content for SEO

Matt Joshi — Wed, 03 Jun 2026 04:32:54 +0000

Struggling with duplicate content across your site? I wrote a Python script that uses fuzzy matching to find near-duplicate pages. It's been a lifesaver for my SEO audits:

python
from difflib import SequenceMatcher
import requests
from bs4 import BeautifulSoup

def get_page_text(url):
response = requests.get(url)
soup = BeautifulSoup(response.text, 'html.parser')
return soup.get_text()

def similarity_ratio(text1, text2):
return SequenceMatcher(None, text1, text2).ratio()

urls = ['https://example.com/page1', 'https://example.com/page2']
texts = [get_page_text(url) for url in urls]
ratio = similarity_ratio(texts[0], texts[1])
print(f'Similarity: {ratio:.2%}')

if ratio > 0.8:
print('Warning: Possible duplicate content!')

For more advanced analysis, tools like SERPSpur's content audit feature can identify duplicates across large sites. But this script is great for quick checks. How do you handle duplicate content issues?

How to Check Google Penalties Automatically Using SERPSpur API and Python Scripts

Matt Joshi — Tue, 02 Jun 2026 11:29:59 +0000

I recently noticed a sudden drop in organic traffic for one of my sites, and I suspected a search engine penalty. Instead of guessing, I used SERPSpur’s Search Engine Penalty Radar to check for indexing issues and blacklist signals. Here’s how I integrated it into my monitoring workflow:

python
import requests

url = 'https://serpspur.com/tool/search-engine-penalty-radar/'
params = {
'domain': 'example.com'
}
response = requests.get(url, params=params)
data = response.json()
if data['penalty_detected']:
print(f'Penalty found: {data["details"]}')
else:
print('No penalty detected')

It flagged a manual action from Google that I hadn’t noticed in Search Console. The tool also checks for blacklist signals from sources like Safe Browsing and Spamhaus. Since adding this to my weekly checks, I’ve caught two potential issues before they impacted rankings. Highly recommend for anyone managing multiple sites. #python #seo #monitoring