DEV Community

Cover image for The need to monitor json data quality in the database
tkhadir
tkhadir

Posted on • Edited on

1

The need to monitor json data quality in the database

With the use of json-type data as an exchange model between applications within an information system, it is now more than necessary to check the quality of the data that circulates.

To avoid ending up with unusable data, I used the jsonschema library for example to check the consistency of the data circulating in an information system.

Alt Text

From this principle emerges the need to have real-time monitoring tools which make it possible to verify the quality of the data present in an information system.

For this I developed a small prototype using nodejs, but this need to check the quality of the data that circulates also applies to xml and other type documents.

current data consistency status

Alt Text

input data analyzed

Alt Text

You can contribute, my github :
https://github.com/tkhadir

By this way we can imagine for example a mongodb plugin that can detect incoherent documents for some personal criteria, the same plugin can be used for the rest of nosql solutions database.

Thank you

API Trace View

How I Cut 22.3 Seconds Off an API Call with Sentry

Struggling with slow API calls? Dan Mindru walks through how he used Sentry's new Trace View feature to shave off 22.3 seconds from an API call.

Get a practical walkthrough of how to identify bottlenecks, split tasks into multiple parallel tasks, identify slow AI model calls, and more.

Read more →

Top comments (0)

nextjs tutorial video

📺 Youtube Tutorial Series

So you built a Next.js app, but you need a clear view of the entire operation flow to be able to identify performance bottlenecks before you launch. But how do you get started? Get the essentials on tracing for Next.js from @nikolovlazar in this video series 👀

Watch the Youtube series

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay