DEV Community

Cover image for FastIngest: Zero-Allocation Bulk Ingestion Pipeline for .NET
Paul Abib S. Camano
Paul Abib S. Camano

Posted on

FastIngest: Zero-Allocation Bulk Ingestion Pipeline for .NET

Every time I built data-intensive systems in .NET, handling bulk data ingestion always felt fragmented. Different databases required completely different boilerplate, performance quirks, and error-handling strategies.

So I spent the week solving it cleanly from first principles.

I’m excited to introduce FastIngest: a modular, high-throughput bulk ingestion framework for .NET. Published completely open source under the permissive MIT license.

Instead of writing provider-specific bulk copy hacks for every new project, FastIngest gives developers a unified, highly optimized API designed for heavy write loads and streaming pipelines.

šŸ“¦ Available today on NuGet (v0.3.2):

Core Pipeline Engine: FastIngest.Core

Relational Providers: SQL Server, PostgreSQL, MySQL, SQLite

Document & Cloud Stores: Azure Cosmos DB, MongoDB

Search & Indexing: Elasticsearch

Extensions: Pipeline utilities & dependency injection helpers

Without an official announcement, the suite organically crossed 1,600+ downloads across 9 packages in its first 48 hours.

The project is free for both commercial and non-commercial use:

šŸ“– Documentation: https://lnkd.in/gVKAs-Qt

šŸ’» GitHub (MIT License): https://lnkd.in/gRgqzF3S

šŸ“¦ NuGet: Search FastIngest or find the packages under aebibtech

If you are building data migration tools, event processors, or high-throughput write services in .NET, I’d love for you to take it for a spin. Feedback, issues, and PRs are welcome!

Top comments (0)