Context
Whether you're a Developer or SRE or DevOps - when you're tasked with setting up logging, there are essentially two options:
Search Engines
Setup an indexing based search engine, masquerading as log storage. Such products are difficult to deploy and run in longer term - manage indexes, local and remote storage, different node types and so on.
Additionally, indexing in the ingestion flow causes high CPU and Memory consumption, while denying very high ingestion rates.
SaaS Platforms
Alternatively, pay for an exorbitantly costly SaaS platform that is very easy to get started with. As time grows, data volumes and costs increase.
But data gravity means getting out of this platform is difficult and you end up storing a fraction of log data to save costs.
We dealt with both these options in our work and we know both these options are not ideal. This pushed us to think what would a modern, cloud native, log storage and observability platform look like.
It is clear that log storage of future won't be another index based search engine in a new language.
We set out to build a completely indexing free log storage platform. This led to Parseable.
Introduction
Parseable is a simple, efficient and fast log storage and observability platform. Think the simplicity of Prometheus but for Logs. Written in Rust, Parseable leverages Apache Arrow, Parquet and widely available object storage platforms for efficiency, cost effectiveness and performance.
It is compatible with standard logging agents like FluentBit, LogStash etc. Parseable also offers a builtin, intuitive GUI for log query and analysis.
Conclusion
As we launched Parseable, we see tremendous interest in the community to try this out. We'd love for you to try out Parseable and we're all ears for any questions, feedback, and comments.
Get Started: https://www.parseable.io/docs/quick-start
Slack: https://launchpass.com/parseable
Github: https://github.com/parseablehq/parseable
Documentation: https://www.parseable.io/docs/introduction
Top comments (0)