DEV Community

Mariano Barcia
Mariano Barcia

Posted on

Introducing The Pipeline Framework

https://pipelineframework.org

The Pipeline Framework is a powerful tool for building reactive pipeline processing systems. It simplifies the development of distributed systems by providing a consistent way to create, configure, and deploy pipeline steps.

Key Features
Reactive Programming: Built on top of Mutiny for non-blocking operations
Annotation-Based Configuration: Simplifies adapter generation with @PipelineStep
gRPC and REST Support: Automatically generates adapters for both communication protocols
Modular Design: Clear separation between runtime and deployment components
Auto-Generation: Generates necessary infrastructure at build time
Observability: Built-in metrics, tracing, and logging support
Error Handling: Comprehensive error handling with DLQ support
Concurrency Control: Virtual threads and backpressure management

Top comments (0)