DEV Community

Cover image for StrataScan is a gray-hat hackers reconstruction engine that transforms web history into actionable security intelligence.

StrataScan is a gray-hat hackers reconstruction engine that transforms web history into actionable security intelligence.

StrataScan is a reconnaissance and attack-surface reconstruction framework built around a simple but under-exploited insight: most security posture leaks through history, not through the present moment. A target's current website might be clean. Its archived versions — snapshotted by the Wayback Machine, Common Crawl, and archive.today over years of crawls — routinely are not.

StrataScan treats the public web archive ecosystem as a forensic timeline of an organization's infrastructure, layering live-internet verification on top of it. It walks every historical snapshot of a domain, every subdomain that was ever archived, every JavaScript bundle that was ever crawled, every .env, wp-config.php, source map, and document that an archive crawler ever touched — and cross-references all of it against what is still true today.

The result is a single engine that performs:

Attack-surface cartography — every subdomain, endpoint, API route, and form that ever existed for a target, whether it is still live or not.
Historical secret archaeology — credentials, tokens, and keys that were briefly exposed and then "fixed," but remain frozen forever in an archive snapshot.
Infrastructure drift analysis — how DNS, TLS, headers, and CMS fingerprints changed over the target's lifetime, exposing migration windows and legacy exposure.
Deletion forensics — content that was deliberately taken down, when it disappeared, and whether it disappeared because of a security incident.
Live-state verification — every historical finding is checked against the present-day target, separating theoretical risk from exploitable, current risk.
StrataScan is simultaneously an offensive reconnaissance accelerator (it answers "what is this target's real, historical, and current attack surface?") and a defensive audit instrument (it answers "what has my organization ever leaked, and is it still leaking?"). The two framings are not in tension — they are the same engine pointed at the same data, read by different people with different intent.

Operating principle: StrataScan performs zero exploitation. It does not deliver payloads, does not attempt authentication bypass, does not brute-force credentials against live services, and does not modify any remote system. Every active capability it performs — port checks, header pulls, zone-transfer attempts, subdomain brute-forcing — is a read-only verification of something already discoverable through public archives, public DNS, or a target's own public-facing configuration.

┌──────────────────────────────────────────────────────────────────────┐
│ PAST PRESENT FUTURE │
│ ════ ═══════ ══════ │
│ Wayback / CDX ─────▶ Live Verification ─────▶ Risk Score │
│ Common Crawl DNS / TLS / HTTP Severity │
│ archive.today Header Diffing Report │
│ Certificate Logs Secret Scanning Evidence │
└──────────────────────────────────────────────────────────────────────┘

🎯 Why StrataScan Exists
Traditional reconnaissance tooling answers: "What does this target look like right now?"

StrataScan answers a different, usually more revealing question: "What has this target ever looked like, and which of those exposures are still reachable, still resolvable, or still cached somewhere an attacker can retrieve?"

Traditional Recon StrataScan
Crawls the live site once Reconstructs every historical state of the site
Finds what's exposed today Finds what was ever exposed, and checks if it still matters
Misses rotated/deleted secrets Secrets frozen in archive snapshots are permanent findings
Subdomain lists from brute-force only Subdomains sourced from 10+ years of crawl history plus brute-force
No concept of "deletion" as a signal Deliberate deletions are fingerprinted and dated — a signal in themselves
Point-in-time Longitudinal, diffable, baseline-able across scans
This asymmetry — defenders forget, but archives don't — is the core thesis of the tool.

🧭 Design Philosophy
StrataScan is built on five non-negotiable engineering principles:

  1. Passive before active
    Every scan begins with archive-only reconnaissance. Nothing is sent to the live target until historical acquisition is complete. This means a full attack-surface map can be built with zero packets sent to the target at all, if the operator chooses to disable live-verification phases.

  2. Everything is evidence-graded
    No finding is presented as a bare string. Every secret, every subdomain, every deleted path carries provenance — first-seen timestamp, last-seen timestamp, source archive, and a severity score derived from context, entropy, and rotation likelihood.

  3. Idempotent, cache-first execution
    A local SQLite cache means a scan can be interrupted, resumed, or re-run without re-fetching unchanged data. Partial reports are flushed automatically on interrupt (Ctrl+C).

  4. Composable, not monolithic
    205+ capabilities map onto 47 phases, and both are independently selectable. An operator can run only secret-scanning phases, only DNS phases, or the full pipeline — the engine degrades gracefully to whatever subset is selected, including automatic dependency resolution (selecting a capability pulls in the phases it depends on).

  5. Archive-respectful by default
    Because the primary data source — the Wayback Machine — is a shared public good run by a nonprofit, StrataScan enforces adaptive jitter and conservative concurrency against archive.org endpoints by default. Aggressive scanning against the live target is opt-in; being a good citizen of the archive ecosystem is not.

The Capability Catalog
StrataScan ships 198 individually selectable capabilities, organized into 8 functional domains. Every capability can be toggled independently via the select command, and selecting any capability automatically pulls in whatever pipeline phases it depends on.

The Capability Catalog

StrataScan ships 198 individually selectable capabilities, organized into 8 functional domains. Every capability can be toggled independently via the select command, and selecting any capability automatically pulls in whatever pipeline phases it depends on.

pie
    title Capability Distribution by Domain
    "Client-Side and App Intelligence" : 57
    "Network DNS and Transport" : 34
    "Secret and Credential Detection" : 26
    "Correlation and Temporal Analytics" : 22
    "Archive and Historical Intelligence" : 20
    "Content and Binary Forensics" : 16
    "Subdomain and Surface Expansion" : 11
    "Reporting and Evidence" : 11

5.1 Archive & Historical Intelligence

Everything that mines the Wayback Machine, Common Crawl, and independent archives for a domain's complete historical footprint — the raw material every other layer builds on.

Expand 20 capabilities

# Capability What it does Key
1 CDX index fetch Pull every snapshot record for the target domain cdx
2 CDX full-field query urlkey, offset, filename, redirect fields cdx_full
3 CDX filter language statuscode/mimetype/regex filters cdx_filter
4 CDX prefix query matchType=prefix path enumeration cdx_prefix
5 CDX timeline per URL Full status history per URL timeline
6 Calendar captures API Per-day snapshot density calendar
7 Anchor text search Which URLs referenced a term anchor
8 Availability API Nearest-snapshot lookup availability
9 Snapshot sparkline Per-year snapshot density sparkline
10 Memento TimeMap (link) Machine-readable snapshot list timemap
11 Memento TimeMap (JSON) JSON-format TimeMap timemap_json
12 Memento aggregator Multi-archive TimeMap memento_agg
13 Archive.today lookup Independent snapshot lookup archive_today
14 Common Crawl query Independent crawl history common_crawl
15 Archive exclusion detection X-Robots-Tag noarchive/noindex exclusions
16 X-Archive-Src extraction WARC collection identifier archive_src
17 Revisit detection warc/revisit records revisit
18 Capture timeline Snapshots by month timeline_monthly
19 Capture gap detection Periods with no snapshots gaps
20 First/last seen Earliest and latest snapshot first_last_seen

5.2 Network, DNS & Transport Security

Live and historical probing of DNS, TLS, and transport-layer configuration — the infrastructure fingerprint of the target, past and present.

Expand 35 capabilities

# Capability What it does Key
1 Certificate Transparency (crt.sh) Subdomain lookup crt
2 RDAP WHOIS Modern JSON WHOIS rdap
3 WHOIS via port 43 Legacy WHOIS with referral whois
4 Live status probing HEAD every archived URL live_status
5 Live header harvest Full HTTP response headers headers
6 Header summary Aggregate servers, security, CDN, cookies header_summary
7 Archived header extraction X-Archive-Orig-* headers per snapshot archived_headers
8 Archived header diff Historical Server/CSP/cookie changes archived_header_diff
9 Cookie flag analysis Secure, HttpOnly, SameSite cookie_flags
10 TLS certificate info Subject, issuer, SANs, validity tls
11 TLS version enumeration TLS 1.0/1.1/1.2/1.3 support tls_versions
12 TLS cipher enumeration Weak/strong cipher support tls_ciphers
13 Certificate chain validation Broken/incomplete chains tls_chain
14 OCSP/CRL check Revocation support ocsp
15 HSTS preload check Preload list membership hsts_preload
16 DNS resolution Live IPv4 + IPv6 dns
17 DNS full record lookup A/AAAA/CNAME/MX/NS/SOA/TXT/CAA dns_full
18 DNS SRV enumeration Service location records srv
19 DNS TLSA lookup DANE cert fingerprints tlsa
20 DNS SMIMEA lookup S/MIME cert fingerprints smimea
21 DKIM selector enumeration Reveals mail provider dkim
22 BIMI records Brand Indicators for Message Identification bimi
23 DNSSEC validation Signing status dnssec
24 Zone transfer attempt AXFR test axfr
25 Reverse DNS lookup PTR from IP ptr
26 Wildcard DNS detection Random subdomain probe wildcard
27 ASN lookup Network ownership asn
28 TCP port scan Open ports on resolved IPs ports
29 HTTP/2 detection Protocol version http2
30 WAF fingerprinting Cloudflare, Akamai, Sucuri waf
31 CORS misconfiguration Access-Control-Allow-Origin: * cors
32 Rate limit header parsing API quota hints ratelimit
33 Robtex passive DNS Free passive DNS history robtex
34 Mnemonic Passive DNS Free passive DNS mnemonic_pdns
35 HackerTarget API Reverse IP, DNS lookup hackertarget

5.3 Subdomain & Surface Expansion

Techniques for discovering the full breadth of a target's hostnames and URL-space, combining archive-sourced names with pattern-based and wordlist-based expansion.

Expand 11 capabilities

# Capability What it does Key
1 Subdomain enumeration Every subdomain in CDX subdomains
2 Subdomain first/last seen Timeline stats per subdomain subdomain_stats
3 Subdomain takeover probe Dead subdomains claimable takeover
4 Subdomain permutation dev-, staging-, api- patterns subdomain_perm
5 Subdomain brute-force Wordlist-based DNS enumeration subdomain_brute
6 Case variant enumeration /About vs /about vs /ABOUT case_variant
7 Slash variant enumeration /page vs /page/ slash_variant
8 Scheme variant enumeration http vs https scheme_variant
9 Port variant enumeration :80 vs :8080 port_variant
10 Subdomain cross-reference First/last seen per subdomain subdomain_crossref
11 External domain graph External hosts seen external_domain_graph

5.4 Content, Document & Binary Forensics

Deep parsing of non-HTML artifacts — documents, images, archives, keys, and dumps — that archives happened to capture.

Expand 16 capabilities

# Capability What it does Key
1 Document harvesting Every archived document documents
2 PDF metadata extraction Author, XMP, producer pdf_meta
3 Office metadata extraction Author, company office_meta
4 Office macro detection VBA macro presence office_macros
5 Image EXIF extraction GPS, camera, software exif
6 PNG chunk extraction Text chunks png_chunks
7 SVG embedded JS detection XSS vectors svg_js
8 ZIP internal listing Contained files zip_listing
9 TAR internal listing Contained files tar_listing
10 SQL dump parsing Tables, columns, sample rows sql_dump
11 Log file parsing Usernames, IPs, paths log_parse
12 PEM/CRT/KEY parsing Cert/key material pem_parse
13 PGP key parsing UID, email, fingerprint pgp
14 SSH key fingerprinting SHA-256 fingerprint ssh_key
15 Torrent file parsing Trackers, file list torrent
16 ICS calendar parsing Events, attendees ics

5.5 Client-Side & Application Intelligence

Everything extractable from HTML, JavaScript, and application metadata: structure, frameworks, hidden state, and third-party integrations.

Expand 57 capabilities

# Capability What it does Key
1 RSS/Atom feed parsing Content feed extraction rss
2 robots.txt parsing User-agents, disallow, allow, sitemaps robots_parsed
3 robots.txt historical diff New disallow rules over time robots_diff
4 sitemap.xml parsing URLs, nested sitemaps, lastmods sitemap_parsed
5 sitemap.xml historical diff New/removed URLs over time sitemap_diff
6 Special file probing well-known sensitive paths special_files
7 Special file content scan Fetch + scan every hit for secrets special_scan
8 Framework endpoint enumeration framework-specific paths framework_endpoints
9 Page intelligence Title, generator, canonical, meta, headings page_intel
10 Email extraction Every email found emails
11 Phone extraction Context-anchored phones phones
12 Social link extraction Every social profile social_links
13 Internal/external links Link graph per page links
14 JS file discovery Every script src js_files
15 CSS file discovery Every stylesheet css_files
16 Image discovery Every img src images
17 Iframe discovery Every iframe src iframes
18 Form + input extraction Every form + input forms
19 API endpoint discovery Every /api/... string api_endpoints
20 GraphQL endpoint discovery /graphql, /gql, /query graphql_endpoints
21 CMS fingerprinting CMS signatures cms
22 Analytics ID extraction GA, GA4, GTM, FB Pixel analytics
23 Hidden element extraction display:none, aria-hidden, hidden inputs hidden
24 HTML comment extraction Every comment with context comments
25 CSS comment extraction Every CSS comment css_comments
26 JS comment extraction Every JS comment js_comments
27 Data attribute extraction data-* attributes data_attrs
28 ARIA label extraction aria-label, aria-description aria
29 Title attribute extraction title= tooltips title_attr
30 Image alt text extraction alt= attributes alt_text
31 Placeholder text extraction placeholder= attributes placeholder
32 window.INITIAL_STATE parsing App state from JS initial_state
33 NEXT_DATA parsing Next.js SSR state next_data
34 NUXT parsing Nuxt SSR state nuxt_data
35 Base64 data URI decoding Decode base64 data URIs data_uri
36 Nonce/CSRF extraction Nonces and CSRF tokens nonce
37 Pingback/webmention links Pingback, webmention endpoints pingback
38 Preconnect/prefetch domains Third-party domains preconnect
39 Analytics event extraction Track/send/log calls analytics_events
40 JS error message extraction throw new Error strings js_errors
41 WebSocket URL extraction wss:// endpoints ws_urls
42 GraphQL query extraction query/mutation strings gql_queries
43 Environment name extraction production/staging/dev env_names
44 Version number extraction Semantic versions versions
45 Console log extraction console.log strings console_logs
46 JSON-LD extraction Structured data blocks jsonld
47 Feed link discovery RSS/Atom feeds feeds
48 Manifest discovery PWA manifest manifest
49 Hreflang extraction i18n alternates hreflang
50 SRI hash extraction Subresource Integrity sri
51 CSP parsing Directive-by-directive csp_parse
52 Source-map reference extraction sourceMappingURL refs sourcemaps
53 Source map fetching Fetch .js.map and scan source_maps
54 JS bundle harvesting Fetch every .js and scan js_bundles
55 JS deobfuscation Basic walk on minified JS js_deobfuscate
56 Google/Bing dork generation Search engine dorks dorks
57 Disallow cross-reference robots.txt paths that were archived disallow_xref

5.6 Secret, Credential & Leak Detection

Pattern- and entropy-based detection of credentials, keys, and tokens, with provenance and severity scoring attached to every hit.

Expand 26 capabilities

# Capability What it does Key
1 Secret scanning secret patterns secrets
2 Base64 auto-decode Decode + rescan base64 b64
3 Hex auto-decode Decode + rescan hex hex
4 Email permutation generation Corporate email guesses email_perm
5 Email MX validation Mail server check email_mx
6 Catch-all email detection Wildcard mail behavior catchall
7 Secret age estimation First/last seen per secret secret_age
8 Entropy gate Filter low-entropy secret matches entropy
9 Structural env parser .env KEY=VALUE extraction env_parser
10 WP config parser wp-config.php constants wp_parser
11 Django settings parser PASSWORD fields django_parser
12 Docker env block parser docker-compose environment docker_parser
13 JSON tree walker Recursive JSON secret extraction json_walker
14 Source map sourcesContent Extract per-file source source_content
15 atob/Buffer.from decoder Decode JS-embedded base64 atob
16 JWT claim extractor iss/aud/sub/role/exp jwt_claims
17 URL param credential scan token=, key=, password=, pwd= url_param_creds
18 Cookie JWT detection Session cookies carrying JWTs cookie_jwt
19 Header secret extraction X-Api-Key, Authorization echoes header_secrets
20 Basic auth URL extraction user:pass@host basic_auth_url
21 Stack trace parser Error pages leaking config stack_trace
22 phpinfo parser Table-structured phpinfo output phpinfo_parse
23 Cloud metadata leak 169.254.169.254 references cloud_meta
24 Credential provenance First/last seen, context, rotation cred_provenance
25 Credential severity scoring severity x context x rotation cred_score
26 Ignore allowlist .stratascan_ignore file ignore_file

5.7 Correlation, Diffing & Temporal Analytics

Cross-snapshot and cross-scan analytics that turn raw historical data into trends, deltas, and anomalies.

Expand 22 capabilities

# Capability What it does Key
1 Deletion classification removed/gone/legal/blocked/redirected/offline deletion_class
2 Deletion window detection Bracket when each URL disappeared deletion_window
3 Mass deletion clustering Group URLs deleted in same window mass_deletion
4 First vs last diff Diff earliest and latest snapshot body first_last_diff
5 Adjacent snapshot diffs Diff every adjacent snapshot pair adjacent_diff
6 Wayback vs live diff Compare last archive with live wayback_live_diff
7 Redirect history 301/302/303/307/308 events redirects
8 Content-type breakdown Mimetype frequency content_types
9 Status code breakdown HTTP status frequency status_codes
10 URL depth distribution Path segments per URL url_depths
11 Query parameter frequency Query params across URLs query_params
12 File extension frequency File extensions across URLs file_extensions
13 Digest change rate Content churn ratio churn
14 Digest clustering Duplicate content graph digest_cluster
15 URLKey analysis SURT-form dedup urlkey
16 Snapshot count ranking Importance proxy snapshot_rank
17 Resurrection map Removed URL -> last live snapshot resurrection
18 Link rot quantification Ratio of dead outbound links link_rot
19 Query param evolution Query params over time per path query_param_evolution
20 Form endpoint history Forms aggregated per action form_endpoint_history
21 Duplicate site detection Digest clusters duplicate_site
22 Cross-scan baseline diff Compare current vs previous report baseline_diff

5.8 Reporting & Evidence Management

Operational plumbing — concurrency control, evidence persistence, and multi-format report synthesis.

Expand 11 capabilities

# Capability What it does Key
1 User-agent rotation real UAs ua
2 Proxy rotation Rotate outbound requests through proxies proxy
3 Rate limiting Token bucket per host rate_limit
4 Adaptive jitter Randomized 5-8s throttle for archive.org jitter
5 CLI mode Scriptable batch scan cli
6 TUI mode Interactive console tui
7 JSON report Machine-readable dump report_json
8 CSV report One row per URL report_csv
9 HTML report Dark-themed with severity report_html
10 TXT report Full detailed text report report_txt
11 JSONL checkpoint Append-only record log per scan jsonl

⚔️ Offensive Capability Profile

This section describes StrataScan's value to an authorized Gray-Team operator — a researcher who moves fluidly between offensive discovery and defensive audit on the same engagement, whether that's bug-bounty work, penetration testing, or organizational self-assessment. Every capability listed here is passive-source or read-only-active; none of it performs exploitation.

6.1 Attack-surface cartography

StrataScan's primary offensive value is producing a more complete attack surface than any single live scan can. Because subdomains, endpoints, and forms are sourced from years of archive crawls in addition to brute-force and permutation, an operator routinely discovers:

  • Decommissioned-but-still-resolving subdomains (dev-, staging-, old-, test-) that were never properly retired.
  • API and GraphQL endpoints that only ever appeared in a JS bundle that was archived once, years ago.
  • Forms and parameters that existed on a since-redesigned page, useful for understanding legacy backend behavior.
  • Subdomains eligible for takeover — a DNS record still points at a de-provisioned cloud resource (S3 bucket, Heroku app, Azure endpoint, etc.).

📦 Installation

StrataScan is a single-file, dependency-light Python 3.9+ tool built entirely on the standard library (curses, sqlite3, ssl, socket, urllib, concurrent.futures) — there is no package footprint to install.

# Clone
git clone https://github.com/sylhetyhackvenger/stratascan.git
cd stratascan

# (Optional) create an isolated environment
python3 -m venv .venv
source .venv/bin/activate

# No third-party dependencies required — standard library only
python3 stratascan.py --help
Enter fullscreen mode Exit fullscreen mode

Requirements

Requirement Why
Python 3.9+ f-strings, modern ssl.TLSVersion, concurrent.futures
A real terminal (for TUI mode) curses requires a TTY; CLI mode works anywhere, including CI
Outbound internet access Archive APIs (Wayback/CDX, Common Crawl, CT logs) and optional live-target verification
Optional: a proxy list For proxy rotation (proxy load all.txt)

🚀 Usage

Quick start (TUI)

python3 stratascan.py
Enter fullscreen mode Exit fullscreen mode

Then, inside the dashboard:



target example.com
Enter fullscreen mode Exit fullscreen mode

Top comments (0)