De-cluttering your screenshot images in the gallery with AI

Tauseef — Thu, 24 Feb 2022 18:27:50 +0000

Overview of My Submission

Ever taken a screenshot of an important transaction to share with your friend? Or maybe to capture an important map, articles, invoice, medical report, funny meme, or a conversation. Be it anything, eventually, after a while, we tend to forget to remove these images from our phones and as they gather dust and clutter our gallery, they also become dangerous weapons when in the wrong hands.

At times, these can contain personal information which when in the wrong hands can cause us inconvenience or big problems- Think virtual credit card information

So here's quick solution to de-clutter your gallery -

Custom Vision in Azure

This Azure service allows users to push bunch of images as sample data for image classification or object detection.

DIY Guidelines -

Create your own project on the custom vision portal and upload sample data that summarizes your gallery. (choose project type as classification)
Label/tag the images into major categories that you observe consuming most space in your screenshots album/gallery folder.
Add negatives label to handle images that don't categorize into any of the major categories
Train the sample data with classification model as a single tag per sample and publish that iteration to generate a prediction endpoint

I have classified the images into Personally identifiable information(PII), Maps, and stock market. The sample data is small for representation in this example. However, with time and each prediction, we expect the data to grow and the AI predictor to be more and more precise.

Now, we have an AI model, and all we need is this service to be exposed to be used in Android/iOS apps or simple console applications. Even better to integrate this service in an existing gallery app to categories PII data.

The image is identified based on sample data which includes invoices, payment transactions, contact details etc.
The sample application can be improvised to run on entire directory of images to categorise and tag the images at one go.

Submission Category:

AI Aces

Link to Code on GitHub

github

In-Action

Training iteration result -

Unsampled test image -

Prediction -

Azure Functions logging with log levels

Tauseef — Mon, 21 Feb 2022 17:25:45 +0000

Overview of My Submission

Logging with log-levels and to different sink targets in Azure Functions

Problem

In most Server-less boilerplate template, generally a log context is provided which logs to default log service of the respective Cloud provider i.e. Azure Application metric.

However, they do not provide the ability to log messages with different log levels which is really necessary for large distributed micro-service based systems where-in you need to drill down to a particular warning or debug message.
Without a log-level, it becomes tedious to filter out the types of message that really interests us.

Use Serilog in your Azure Functions

There are lot of readily available libraries which provide a means to perform structured event logging with context and push event message in custom formatted template. We will explore one such open-source library called Serilog.

Serilog provides a mechanism to perform structured logging and way to switch between different log-levels. It also supports a bunch of different target sinks.

Checkout the sample code in the github link. Once up and running trigger your function app with a query paramater and see Serilog in action.

Check the App Insights Logs to view the logs in real-time. Notice how the logs are colored based on the log severity i.e. warning, info or error etc.

DEV Community: Tauseef

De-cluttering your screenshot images in the gallery with AI

Overview of My Submission

Submission Category:

Link to Code on GitHub

In-Action

Azure Functions logging with log levels

Overview of My Submission

Problem

Use Serilog in your Azure Functions

Submission Category:

Link to Code on GitHub

In-Action