Hello fellow Gophers, data enthusiasts, and security engineers! I'm excited to share a project that I've been leading for multiple years with the DEV community: Substation is an open-source data pipeline and transformation toolkit written in Go.
With Substation you can:
- Deploy serverless data pipelines or microservices to AWS in minutes using infrastructure as code (Terraform)
- Evaluate, process, and deliver data in real-time using configurations as code (Jsonnet)
- Create custom data processing applications written in Go
Substation is an affordable alternative to products like Cribl (~10x cost savings) and is easier to manage than similar open-source projects such as Logstash and fluentd. It's been used in production by the security team at Brex for 2+ years and is ready for any scale, even beyond 100,000 events per second!
If you'd like to learn more, then please read the documentation, try the recipes, and let me know if you have any questions!
Top comments (0)