DEV Community: Christian Cassarly The latest articles on DEV Community by Christian Cassarly (@jesusnewapp). https://dev.to/jesusnewapp https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4078252%2F2bbcd86c-66be-4b1d-8103-a5f1525afae4.png DEV Community: Christian Cassarly https://dev.to/jesusnewapp en Web Sweeper: Building Provenance-Protected Libraries for Future AI Training Christian Cassarly Fri, 14 Aug 2026 22:12:00 +0000 https://dev.to/jesusnewapp/web-sweeper-building-provenance-protected-libraries-for-future-ai-training-4nka https://dev.to/jesusnewapp/web-sweeper-building-provenance-protected-libraries-for-future-ai-training-4nka <p>Web Sweeper is an open-source library builder created by Christian Cassarly through Jesus New OS for future AI training models and research.</p> <p>It is designed to move complete, policy-approved works through a protected pipeline:</p> <ol> <li>Source discovery</li> <li>Policy screening</li> <li>Acquisition</li> <li>Protected staging</li> <li>Publication</li> <li>Live verification</li> </ol> <p>The system preserves provenance, resumability, exact duplicate protection, serialized production writes, and permanent verification receipts. Its goal is not simply to download files. Its goal is to build trustworthy, auditable digital libraries that future AI systems and researchers can use responsibly.</p> <h2> Why it matters </h2> <p>Future AI training requires more than volume. It requires clear sources, reliable processing, recoverable work, and evidence showing exactly what became part of a library. Web Sweeper brings those safeguards into one repeatable workflow.</p> <h2> Open-source project </h2> <p>Explore the source code and current documentation on GitHub:</p> <p><strong><a href="https://github.com/jesusnewapp/web-sweeper" rel="noopener noreferrer">github.com/jesusnewapp/web-sweeper</a></strong></p> <p>Web Sweeper is under active development. Capabilities and library totals should be evaluated from the latest public documentation and authoritative verification receipts.</p> showdev opensource ai data