loading...

DataOps For Streaming Systems With Lenses.io - Episode 140

blarghmatey profile image Tobias Macey Originally published at dataengineeringpodcast.com ・1 min read

There are an increasing number of use cases for real time data, and the systems to power them are becoming more mature. Once you have a streaming platform up and running you need a way to keep an eye on it, including observability, discovery, and governance of your data. That's what the Lenses.io DataOps platform is built for. In this episode CTO Andrew Stevenson discusses the challenges that arise from building decoupled systems, the benefits of using SQL as the common interface for your data, and the metrics that need to be tracked to keep the overall system healthy. Observability and governance of streaming data requires a different approach than batch oriented workflows, and this episode does an excellent job of outlining the complexities involved and how to address them.

Listen Now!

Posted on by:

blarghmatey profile

Tobias Macey

@blarghmatey

I'm a systems oriented cloud and data engineer with a propensity for Python.

Discussion

markdown guide