DEV Community

Ravikanth Kowdeed
Ravikanth Kowdeed

Posted on

1

Big data with Software Systems

Ever wondered how much data is generated by the Software systems day in day out ? Answer could be enormous !
Let's take an example of software patches every week.
Let's consider an example of software development life cycle which comprises of analyzing the tool to pick for software development, build tasks, resolving compilation errors, resolving code compatibility issues, resolving the defects, resolve security vulnerabilities, deploy to production, address defects that surface in production systems due to platform dependencies etc. All these stages and phases generate data !
So, we are talking about huge structured data in terms of relationship of the assets, versions, known software defects, compatibility issues, cost associated to build and operate etc.
Also, there is a lot of unstructured data in terms of system performance logs, system patching exercise, system upgrade tasks, system failover tasks etc.
This is the big data we all need to understand, be aware of so we know the dependencies, impacts to already running software and age old systems in the process of upgrades.
Please comment and share your experiences with legacy software applications, their build and operate errors you have experienced, would love to hear and let us learn together in this community.

Image of Timescale

🚀 pgai Vectorizer: SQLAlchemy and LiteLLM Make Vector Search Simple

We built pgai Vectorizer to simplify embedding management for AI applications—without needing a separate database or complex infrastructure. Since launch, developers have created over 3,000 vectorizers on Timescale Cloud, with many more self-hosted.

Read full post →

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

AWS GenAI Live!

GenAI LIVE! is a dynamic live-streamed show exploring how AWS and our partners are helping organizations unlock real value with generative AI.

Tune in to the full event

DEV is partnering to bring live events to the community. Join us or dismiss this billboard if you're not interested. ❤️