<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Balram Prasad</title>
    <description>The latest articles on DEV Community by Balram Prasad (@balramprasad).</description>
    <link>https://dev.to/balramprasad</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F971567%2Fc31f6c13-3591-40ae-8331-2d446c98eaed.png</url>
      <title>DEV Community: Balram Prasad</title>
      <link>https://dev.to/balramprasad</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/balramprasad"/>
    <language>en</language>
    <item>
      <title>Elevate Your REST API: Add Robust Validation with Fluent Validation in Azure App Service</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Mon, 18 Mar 2024 06:00:39 +0000</pubDate>
      <link>https://dev.to/balramprasad/elevate-your-rest-api-add-robust-validation-with-fluent-validation-in-azure-app-service-2ek</link>
      <guid>https://dev.to/balramprasad/elevate-your-rest-api-add-robust-validation-with-fluent-validation-in-azure-app-service-2ek</guid>
      <description>&lt;p&gt;In the digital era, REST APIs are the backbone of web services, powering web and mobile applications alike. Ensuring data integrity and security through robust validation is not just recommended; it's essential. This tutorial guides you through adding powerful validation to your REST API using Fluent Validation and deploying your application to Azure App Service for a seamless, cloud-based solution.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Why Choose Fluent Validation?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Fluent Validation is a .NET library that allows for the creation of strongly-typed validation rules. Its popularity stems from its flexibility, ease of use, and integration capabilities with ASP.NET. Unlike traditional data annotations, Fluent Validation rules are centralized, easily reusable, and can be tested independently from your UI.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Setting Up Your Project&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Start by creating a new ASP.NET Core Web API project in Visual Studio or VS Code. Ensure your project targets .NET 5 or later for the best compatibility with Fluent Validation.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Installing Fluent Validation&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Add Fluent Validation to your project via NuGet Package Manager or the CLI:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;dotnet add package FluentValidation.AspNetCore

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;Creating Your First Validator&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Assume we have a simple Movie model. Let's create a validator for it:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;using FluentValidation;

public class MovieValidator : AbstractValidator&amp;lt;Movie&amp;gt;
{
    public MovieValidator()
    {
        RuleFor(movie =&amp;gt; movie.Title).NotEmpty().WithMessage("Title is required.");
        RuleFor(movie =&amp;gt; movie.ReleaseYear).InclusiveBetween(1900, DateTime.Now.Year);
        // Add more rules as needed
    }
}

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;Integrating Fluent Validation with ASP.NET Core&lt;/strong&gt;&lt;br&gt;
In your Startup.cs or Program.cs (for .NET 6+), add the following line to configure services:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;services.AddControllers().AddFluentValidation(fv =&amp;gt; fv.RegisterValidatorsFromAssemblyContaining&amp;lt;MovieValidator&amp;gt;());

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This automatically applies Fluent Validation to your models when they're bound to a request.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Testing Validation Locally&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Before deploying, test your API locally. Use tools like Postman or Swagger to ensure your validation rules are triggered as expected when you make requests to your API endpoints.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Deploying to Azure App Service&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Azure App Service offers a fully managed platform for deploying and scaling web applications. Deploy your API to Azure App Service directly from Visual Studio or use the Azure CLI:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;az webapp up --name &amp;lt;your-app-name&amp;gt; --resource-group &amp;lt;your-resource-group&amp;gt; --runtime "DOTNET|5.0" --plan &amp;lt;your-app-service-plan&amp;gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Replace placeholders with your actual app name, resource group, and service plan details.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Exploring Fluent Validation Documentation&lt;/strong&gt;&lt;br&gt;
Dive deeper into Fluent Validation by exploring the &lt;a href="https://docs.fluentvalidation.net/en/latest/"&gt;official documentation&lt;/a&gt;. It offers extensive guides, best practices, and advanced scenarios to further enhance your API validation logic.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Watch the Tutorial for More Insights&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Prefer a visual guide? Watch our detailed tutorial, "Elevate Your REST API: Add Robust Validation with Fluent Validation in Azure App Service," where we cover everything from setting up Fluent Validation to deploying on Azure, with real-world examples and best practices.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Watch the Full Tutorial Here&lt;/strong&gt;&lt;br&gt;
&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/Cw_709DaAsA"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;This video complements the guide, offering step-by-step visuals to ensure you have all the tools you need to implement robust validation in your REST APIs and deploy confidently with Azure App Service.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Conclusion&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Validating input data is a cornerstone of secure and reliable API development. With Fluent Validation and Azure App Service, you're equipped to elevate your APIs, ensuring they're not only robust and scalable but also secure and compliant with industry standards.&lt;/p&gt;

&lt;p&gt;Got questions or feedback? Drop a comment below or in the video comments section. Happy coding!&lt;/p&gt;

</description>
      <category>azure</category>
      <category>api</category>
      <category>dotnet</category>
      <category>cloudcomputing</category>
    </item>
    <item>
      <title>Master Real-Time Fraud Detection with Azure Stream Analytics</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Tue, 05 Mar 2024 01:43:02 +0000</pubDate>
      <link>https://dev.to/balramprasad/master-real-time-fraud-detection-with-azure-stream-analytics-38d9</link>
      <guid>https://dev.to/balramprasad/master-real-time-fraud-detection-with-azure-stream-analytics-38d9</guid>
      <description>&lt;p&gt;In the digital age, real-time fraud detection isn't just a luxury—it's a necessity. That's why I'm thrilled to share a step-by-step tutorial on harnessing Azure Stream Analytics and Event Hubs for detecting fraud in phone call metadata.&lt;/p&gt;

&lt;p&gt;What You'll Learn:&lt;/p&gt;

&lt;p&gt;Setting up Azure Event Hub for real-time data ingestion&lt;br&gt;
Creating and configuring an Azure Stream Analytics job&lt;br&gt;
Writing effective queries using tumbling windows for fraud detection&lt;br&gt;
Outputting results to Azure Blob Storage for further analysis&lt;br&gt;
This guide is designed for developers and IT professionals looking to leverage Azure for advanced data processing tasks. I've included plenty of code snippets, configuration tips, and insights into Azure's powerful analytics capabilities.&lt;/p&gt;

&lt;p&gt;Dive into the tutorial here: &lt;iframe width="710" height="399" src="https://www.youtube.com/embed/izoFlRZDjGc"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;Your feedback and experiences with Azure for real-time processing would be great to hear!&lt;/p&gt;

</description>
      <category>azure</category>
      <category>analytics</category>
      <category>azurestreamanalytics</category>
      <category>cloud</category>
    </item>
    <item>
      <title>How to Deploy a RESTful API with .NET Core to Azure App Service Using Azure SQL and Entity Framework</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Mon, 04 Mar 2024 05:43:54 +0000</pubDate>
      <link>https://dev.to/balramprasad/how-to-deploy-a-restful-api-with-net-core-to-azure-app-service-using-azure-sql-and-entity-framework-45kn</link>
      <guid>https://dev.to/balramprasad/how-to-deploy-a-restful-api-with-net-core-to-azure-app-service-using-azure-sql-and-entity-framework-45kn</guid>
      <description>&lt;p&gt;Hey &lt;strong&gt;Dev.to community!&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;I'm excited to share with you all a comprehensive guide that walks through the process of building and deploying a RESTful API using .NET Core, integrated with Azure SQL via Entity Framework, and then deploying it to Azure App Service — all within Visual Studio.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;What You'll Learn&lt;/strong&gt;:&lt;/p&gt;

&lt;p&gt;Creating a RESTful API with .NET Core, detailed from scratch.&lt;br&gt;
Integrating Azure SQL Database using Entity Framework for smooth and efficient data management.&lt;br&gt;
Effortless Deployment from Visual Studio to Azure App Service, making your API live and accessible to the world.&lt;br&gt;
Testing Your API both locally using Swagger UI and in the cloud post-deployment.&lt;br&gt;
This tutorial is aimed at developers of all levels who are interested in stepping into the world of cloud services with Azure, or those looking to consolidate their knowledge by applying it to a practical project.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Why This Matters&lt;/strong&gt;:&lt;/p&gt;

&lt;p&gt;Deploying applications to the cloud is a critical skill for modern developers. This guide aims not only to teach you how to deploy an application but also to give you a clear understanding of working with Azure services and .NET Core.&lt;/p&gt;

&lt;p&gt;Check out the full video tutorial here: &lt;iframe width="710" height="399" src="https://www.youtube.com/embed/AHEbBaGG_RA"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;I'm looking forward to your feedback, questions, or insights in the comments below! Let's make the cloud our playground. 🚀&lt;/p&gt;

&lt;h1&gt;
  
  
  NETCore #Azure #RESTfulAPI #CloudComputing #DeveloperTutorial
&lt;/h1&gt;

</description>
      <category>restapi</category>
      <category>azure</category>
      <category>api</category>
      <category>azureappservice</category>
    </item>
    <item>
      <title>Unlock the Power of Azure: A Video Playlist for Aspiring Data Engineers and Analysts</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Thu, 29 Feb 2024 05:56:59 +0000</pubDate>
      <link>https://dev.to/balramprasad/unlock-the-power-of-azure-a-video-playlist-for-aspiring-data-engineers-and-analysts-1n0m</link>
      <guid>https://dev.to/balramprasad/unlock-the-power-of-azure-a-video-playlist-for-aspiring-data-engineers-and-analysts-1n0m</guid>
      <description>&lt;p&gt;&lt;a href="https://media.dev.to/cdn-cgi/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fgxqyj8fntpiygyq175rs.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media.dev.to/cdn-cgi/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fgxqyj8fntpiygyq175rs.png" alt="Image description" width="800" height="451"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Dive into the world of Azure with our comprehensive video playlist designed for data engineers and analysts. From real-time analytics to data wrangling and beyond, this series provides you with the knowledge to leverage Azure's full suite of data services. Enhance your skills, whether you're a beginner or looking to expand your expertise with Azure.&lt;/p&gt;

&lt;h2&gt;
  
  
  Explore Our Curated Azure Video Series
&lt;/h2&gt;

&lt;p&gt;Our playlist includes in-depth tutorials and demos across various Azure services. Here are 20 must-watch videos from our collection:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;&lt;a href="https://youtu.be/jm4wmQPt0sc"&gt;&lt;strong&gt;Twitter Sentiment Analysis with Azure Synapse Analytics | Real time Stream | E2E Big Data Pipeline&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/s1ukOr6yzS8"&gt;&lt;strong&gt;Real-time Vehicle Telemetry stream processing with Azure Stream Analytics, Event Hub, and Synapse&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/izoFlRZDjGc"&gt;&lt;strong&gt;Real-time fraudulent call detection with Azure Stream Analytics and Azure Event Hub&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/7cfe1vdnDLE"&gt;&lt;strong&gt;Weather Forecast from sensor data, Azure IOT Hub, Stream analytics and Machine Learning Studio&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/J5VI-cZKZMM"&gt;&lt;strong&gt;What Is Web Scraping And how to do with azure Synapse and Python and Spark Pool&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/tft8JP4lz3w"&gt;&lt;strong&gt;How to use PySpark and Spark SQL, MatPlotLib and Seaborn in Azure Synapse Analytics and Spark Pool&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/gYHLD5aNOZo"&gt;&lt;strong&gt;Streaming Analytics with Azure Databricks, Event Hub, and Delta Lake: A Step-by-Step Demo&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/si4gZSU6qEU"&gt;&lt;strong&gt;How to Read Stream Data from Azure Event Hub using Azure Synapse Analytics&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/_Ce-b6Dz1Wg"&gt;&lt;strong&gt;Azure Data Factory - Incrementally load data from Azure SQL to Azure Data Lake using Watermark&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/VU5LDEeITtU"&gt;&lt;strong&gt;Azure Data Factory - Incremental Load From SQL Managed Instance to Lake using Change data Capture&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/sPTERXmYnBs"&gt;&lt;strong&gt;Azure Data factory Data wrangling | How to do Data wrangling in Azure Data Factory&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/ySvg0lTmdlY"&gt;&lt;strong&gt;How to create and use data flow in Azure Data Factory&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/wimhWlBq9gk"&gt;&lt;strong&gt;How to use Azure Data Factory with managed virtual network and private endpoints&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/SVpobjQdQxU"&gt;&lt;strong&gt;How to Run an SSIS package in Azure Data Factory&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/qPpm3X4wgEI"&gt;&lt;strong&gt;How to Connect Azure Data Factory with Log Analytics and setup alerts&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/SLM2nAG_Zjk"&gt;&lt;strong&gt;Unload Data from Snowflake to Azure Data Lake Gen2 using Azure Synapse Analytics&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/qtU5UMR1H-M"&gt;&lt;strong&gt;How to create Self-hosted Integration runtime in Azure Data Factory and Azure Synapse analytics&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/_x7tHUHxCR4"&gt;&lt;strong&gt;Copy Data from Azure Data Lake gen2 to Snowflake using Azure Synapse Analytics&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/uFw3FL7eaO0"&gt;&lt;strong&gt;Run R scripts as part of a pipeline through Azure Data Factory using Azure Batch&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;li&gt;&lt;a href="https://youtu.be/2fvLqIWfAmI"&gt;&lt;strong&gt;Azure Data Lake Assets(Parquet, Delta, Json, CSV) Discovery using Microsoft Purview | Data Catalog&lt;/strong&gt;&lt;/a&gt;&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Why This Playlist?
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Diverse Azure Solutions&lt;/strong&gt;: From analytics to data processing, explore a wide range of Azure's capabilities.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Hands-On Learning&lt;/strong&gt;: Each video includes practical demonstrations, making learning engaging and effective.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;For All Skill Levels&lt;/strong&gt;: Whether you're just starting out or looking to deepen your Azure knowledge, there's something for everyone.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Join Our Azure Learning Community
&lt;/h2&gt;

&lt;p&gt;Dive into our playlist and start your Azure mastery journey today. Share your progress, insights, and questions in the comments below. Let's grow together in harnessing the power of Azure for data engineering and analytics.&lt;/p&gt;

</description>
      <category>dataengineering</category>
      <category>azure</category>
      <category>bigdata</category>
      <category>database</category>
    </item>
    <item>
      <title>Master the Art of Azure Data Factory</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Mon, 20 Feb 2023 02:23:02 +0000</pubDate>
      <link>https://dev.to/balramprasad/master-the-art-of-azure-data-factory-423c</link>
      <guid>https://dev.to/balramprasad/master-the-art-of-azure-data-factory-423c</guid>
      <description>&lt;p&gt;&lt;a href="https://res.cloudinary.com/practicaldev/image/fetch/s--xyoszDY2--/c_limit%2Cf_auto%2Cfl_progressive%2Cq_auto%2Cw_880/https://dev-to-uploads.s3.amazonaws.com/uploads/articles/34tw985kf8ed98ox7c2z.jpg" class="article-body-image-wrapper"&gt;&lt;img src="https://res.cloudinary.com/practicaldev/image/fetch/s--xyoszDY2--/c_limit%2Cf_auto%2Cfl_progressive%2Cq_auto%2Cw_880/https://dev-to-uploads.s3.amazonaws.com/uploads/articles/34tw985kf8ed98ox7c2z.jpg" alt="Image description" width="880" height="495"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Excited to share  latest video series on Azure Data Factory! Learn the basics of ADF, how to debug pipelines and activities, and various techniques to copy data from different sources to different destinations. Whether you're a beginner or an experienced user, you're sure to learn something new! Check out the full playlist here&lt;/p&gt;

&lt;p&gt;The playlist is focused on teaching various aspects of Azure Data Factory, which is a cloud-based data integration service that allows you to create, schedule and manage data pipelines. It includes videos covering the basics of Azure Data Factory, how to create data pipelines, how to debug pipelines and activities, how to do data wrangling, how to use data flows, how to create and use a self-hosted integration runtime, and how to copy data from various sources to destinations like Azure Blob Storage, Snowflake, and Azure Cosmos DB. There are also videos on how to connect Azure Data Factory with other services like Log Analytics and Azure DevOps, and how to run SSIS packages and R scripts using Azure Data Factory. The playlist covers a range of topics that will be useful for those looking to learn more about data integration in the cloud with Azure Data Factory.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Introduction to azure data factory | What is Azure Data Factory | Create Data Factory First Pipeline&lt;/strong&gt;&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/k2EugJ4MLDU"&gt;
&lt;/iframe&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;How to Debug Pipeline and Activity in Azure Data Factory&lt;/strong&gt;&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/8B-mlUunQqg"&gt;
&lt;/iframe&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;Azure Data Factory - Incrementally load data from Azure SQL to Azure Data Lake using Watermark&lt;/strong&gt;&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/_Ce-b6Dz1Wg"&gt;
&lt;/iframe&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;How to create and use data flow in Azure Data Factory&lt;/strong&gt;&lt;br&gt;
    &lt;iframe width="710" height="399" src="https://www.youtube.com/embed/ySvg0lTmdlY"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Azure Data factory Data wrangling | How to do Data wrangling in Azure Data Factory&lt;/strong&gt;&lt;br&gt;
    &lt;iframe width="710" height="399" src="https://www.youtube.com/embed/sPTERXmYnBs"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Azure Data Factory - Incremental Load From SQL Managed Instance to Lake using Change data Capture&lt;/strong&gt;&lt;br&gt;
    &lt;iframe width="710" height="399" src="https://www.youtube.com/embed/VU5LDEeITtU"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Azure Data Factory-Incrementally copy files based on LastModifiedDate by using the Copy Data tool&lt;/strong&gt;&lt;br&gt;
    &lt;iframe width="710" height="399" src="https://www.youtube.com/embed/qL2koYlXRFw"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;How to create Self-hosted Integration runtime in Azure Data Factory and Azure Synapse analytics&lt;/strong&gt;&lt;br&gt;
    &lt;iframe width="710" height="399" src="https://www.youtube.com/embed/qtU5UMR1H-M"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Copy data from a On Premise SQL Server database to Azure Blob storage using azure data factory&lt;/strong&gt;&lt;br&gt;
    &lt;iframe width="710" height="399" src="https://www.youtube.com/embed/cOy9DIumrO8"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Azure Data Factory-Incrementally copy files based on time partitioned file name using Copy Data tool&lt;/strong&gt;&lt;br&gt;
&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/z6n9nuApGdI"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;How to use Azure Data Factory with snowflake | Copy data from Snowflake to Azure Blob using ADF&lt;/strong&gt; &lt;br&gt;
&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/dBQsX-i5K5k"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Microsoft Azure SQL Server Database to Snowflake using azure data factory in minutes&lt;/strong&gt;&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/5rLbBpu1f6E"&gt;
&lt;/iframe&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;Copy Data from Snowflake to Azure Cosmos DB using azure data factory&lt;/strong&gt;&lt;br&gt;
    &lt;iframe width="710" height="399" src="https://www.youtube.com/embed/1FleIffmUZU"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Load data from Azure Blob to Snowflake using Azure Data Factory&lt;/strong&gt;&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/ODNSKLv68tI"&gt;
&lt;/iframe&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;How to Connect Azure Data Factory with Log Analytics and setup alerts&lt;/strong&gt;&lt;br&gt;
    &lt;iframe width="710" height="399" src="https://www.youtube.com/embed/qPpm3X4wgEI"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Create an Azure Data Factory, Storage ,Linked Service , Datasets , Pipeline using Bicep&lt;/strong&gt;&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/aHBogGiR0rw"&gt;
&lt;/iframe&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;Create an Azure Data Factory, Linked Services, Datasets, Pipeline , Run and Monitor using PowerShell&lt;/strong&gt;&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/zwicKbBQn_w"&gt;
&lt;/iframe&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;How to use Azure Data Factory with managed virtual network and private endpoints&lt;/strong&gt;&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/wimhWlBq9gk"&gt;
&lt;/iframe&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;How to connect azure devops repo with azure data factory&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/a-FJ5Ra9GWM"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Create an Azure-SSIS integration runtime in Azure Data Factory or Azure Synapse Analytics&lt;/strong&gt;&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/9LO9z-3uZWo"&gt;
&lt;/iframe&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;How to Run an SSIS package in Azure Data Factory&lt;/strong&gt;&lt;br&gt;&lt;br&gt;
&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/SVpobjQdQxU"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Run R scripts as part of a pipeline through Azure Data Factory using Azure Batch&lt;/strong&gt;&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/uFw3FL7eaO0"&gt;
&lt;/iframe&gt;

&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;How to Run an Azure Databricks Notebook with Azure Data Factory&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/w_neG_E_mzI"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

&lt;h1&gt;
  
  
  AzureDataFactory #CloudDataIntegration #DataWrangling #DataEngineering
&lt;/h1&gt;

</description>
      <category>azure</category>
      <category>azuredatafactory</category>
      <category>tutorial</category>
      <category>beginners</category>
    </item>
    <item>
      <title>Create an Azure Data Factory, Storage ,Linked Service , Datasets , Pipeline using Bicep</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Tue, 27 Dec 2022 05:44:27 +0000</pubDate>
      <link>https://dev.to/balramprasad/create-an-azure-data-factory-storage-linked-service-datasets-pipeline-using-bicep-2hhh</link>
      <guid>https://dev.to/balramprasad/create-an-azure-data-factory-storage-linked-service-datasets-pipeline-using-bicep-2hhh</guid>
      <description>&lt;p&gt;This Demo describes how to use Bicep to create an Azure data factory. The pipeline you create in this data factory copies data from one folder to another folder in an Azure blob storage.&lt;br&gt;
&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/aHBogGiR0rw"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

</description>
      <category>azure</category>
      <category>azuredatafactory</category>
      <category>azuredataengineer</category>
      <category>azurebicep</category>
    </item>
    <item>
      <title>Basic Role and User Management using SQL in snowflake</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Mon, 21 Nov 2022 20:08:06 +0000</pubDate>
      <link>https://dev.to/balramprasad/basic-role-and-user-management-using-sql-in-snowflake-27j7</link>
      <guid>https://dev.to/balramprasad/basic-role-and-user-management-using-sql-in-snowflake-27j7</guid>
      <description>&lt;p&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/rZOhU2pzJZs"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

</description>
      <category>python</category>
      <category>flask</category>
      <category>webdev</category>
      <category>api</category>
    </item>
    <item>
      <title>IoT remote monitoring and notifications using Azure IotHub, Service Bus and Raspberry and Logic Apps</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Mon, 21 Nov 2022 19:49:48 +0000</pubDate>
      <link>https://dev.to/balramprasad/iot-remote-monitoring-and-notifications-using-azure-iothub-service-bus-and-raspberry-and-logic-apps-4ldd</link>
      <guid>https://dev.to/balramprasad/iot-remote-monitoring-and-notifications-using-azure-iothub-service-bus-and-raspberry-and-logic-apps-4ldd</guid>
      <description>&lt;p&gt;IoT remote monitoring and notifications with Azure Logic using IotHub, Service Bus and Raspberry &lt;/p&gt;

&lt;p&gt;Azure IoT Hub provides a cloud-hosted solution back end to connect virtually any device. Extend your solution from the cloud to the edge with per-device authentication, built-in device management, and scaled provisioning. Security-enhanced communication channel for sending and receiving data from IoT devices.&lt;/p&gt;

&lt;p&gt;Azure Service Bus is a fully managed enterprise message broker with message queues and publish-subscribe topics (in a namespace). Service Bus is used to decouple applications and services from each other, providing the following benefits:&lt;/p&gt;

&lt;p&gt;Load-balancing work across competing workers&lt;br&gt;
Safely routing and transferring data and control across service and application boundaries&lt;br&gt;
Coordinating transactional work that requires a high-degree of reliability&lt;/p&gt;

&lt;p&gt;The Azure IoT explorer is a graphical tool for interacting with devices connected to your IoT hub. This article focuses on using the tool to test your IoT Plug and Play devices. After installing the tool on your local machine, you can use it to connect to a hub. You can use the tool to view the telemetry the devices are sending, work with device properties, and invoke commands.&lt;/p&gt;

&lt;p&gt;Azure Logic Apps is a cloud-based platform for creating and running automated workflows that integrate your apps, data, services, and systems. With this platform, you can quickly develop highly scalable integration solutions for your enterprise and business-to-business (B2B) scenarios. As a member of Azure Integration Services, Azure Logic Apps simplifies the way that you connect legacy, modern, and cutting-edge systems across cloud, on premises, and hybrid environments.&lt;/p&gt;

&lt;p&gt;The Raspberry Pi is a low cost, credit-card sized computer that plugs into a computer monitor or TV, and uses a standard keyboard and mouse. It is a capable little device that enables people of all ages to explore computing, and to learn how to program in languages like Scratch and Python. It’s capable of doing everything you’d expect a desktop computer to do, from browsing the internet and playing high-definition video, to making spreadsheets, word-processing, and playing games.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Introduction to IoT remote monitoring and notifications&lt;/li&gt;
&lt;li&gt;Use case of IoT remote monitoring and notifications&lt;/li&gt;
&lt;li&gt;Benefit of IoT remote monitoring and notifications&lt;/li&gt;
&lt;li&gt;Create IOT Hub In Azure Portal&lt;/li&gt;
&lt;li&gt;Create Devices in Azure Iot Hub&lt;/li&gt;
&lt;li&gt;Azure  Iot Hub Explorer&lt;/li&gt;
&lt;li&gt;Raspberry Pi Simulator&lt;/li&gt;
&lt;li&gt;Connect Device to Azure  Iot Hub&lt;/li&gt;
&lt;li&gt;Create Service Bus Namespace&lt;/li&gt;
&lt;li&gt;Create Service Bus Queue&lt;/li&gt;
&lt;li&gt;Add Custom Endpoint in Azure Iot Hub&lt;/li&gt;
&lt;li&gt;Add Routes in Azure Iot Hub&lt;/li&gt;
&lt;li&gt;Explore message with Service Bus Explorer&lt;/li&gt;
&lt;li&gt;Create Logic App&lt;/li&gt;
&lt;li&gt;Create Service Bus Connection in Logic App&lt;/li&gt;
&lt;li&gt;Create Gmail Connection in Logic APP&lt;/li&gt;
&lt;li&gt;Create Storage Account&lt;/li&gt;
&lt;li&gt;Link Storage to Logic App&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/YKxTgPQxcos"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

</description>
      <category>community</category>
    </item>
    <item>
      <title>Weather Forecast from sensor data , Azure IOT Hub, Stream analytics and Machine Learning Studio</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Fri, 18 Nov 2022 18:14:41 +0000</pubDate>
      <link>https://dev.to/balramprasad/weather-forecast-from-sensor-data-azure-iot-hub-stream-analytics-and-machine-learning-studio-5efa</link>
      <guid>https://dev.to/balramprasad/weather-forecast-from-sensor-data-azure-iot-hub-stream-analytics-and-machine-learning-studio-5efa</guid>
      <description>&lt;p&gt;Weather Forecast from sensor data , Azure IOT Hub, Stream analytics and ML Studio&lt;br&gt;
Machine learning is a technique of data science that helps computers learn from existing data to forecast future behaviors, outcomes, and trends. ML Studio (classic) is a cloud predictive analytics service that makes it possible to quickly create and deploy predictive models as analytics solutions. In this article, you learn how to use ML Studio (classic) to do weather forecasting (chance of rain) using the temperature and humidity data from your Azure IoT hub. The chance of rain is the output of a prepared weather prediction model. The model is built upon historic data to forecast chance of rain based on temperature and humidity.&lt;/p&gt;

&lt;p&gt;Complete the Raspberry Pi online simulator tutorial or one of the device tutorials. For example, you can go to Raspberry Pi with Node.js or to one of the Send telemetry quickstarts. These articles cover the following requirements:&lt;br&gt;
An active Azure subscription.&lt;br&gt;
An Azure IoT hub under your subscription.&lt;br&gt;
A client application that sends messages to your Azure IoT hub.&lt;br&gt;
An ML Studio (classic) account.&lt;br&gt;
An Azure Storage account, A General-purpose v2 account is preferred, but any Azure Storage account that supports Azure Blob storage will also work.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Introduction to Weather Forecasting using azure services &lt;/li&gt;
&lt;li&gt;Use case of Weather Forecasting using azure services &lt;/li&gt;
&lt;li&gt;Create IOT Hub In Azure Portal&lt;/li&gt;
&lt;li&gt;Create Devices in Azure Iot Hub&lt;/li&gt;
&lt;li&gt;Azure Iot Hub Explorer&lt;/li&gt;
&lt;li&gt;Raspberry Pi Simulator&lt;/li&gt;
&lt;li&gt;Connect Device to Azure Iot Hub&lt;/li&gt;
&lt;li&gt;Create Azure Stream Analytics Job &lt;/li&gt;
&lt;li&gt;Connect IOT to Azure Stream Analytics&lt;/li&gt;
&lt;li&gt;Create Predictive Experiment in Azure Machine Learning Studio&lt;/li&gt;
&lt;li&gt;Add Machine Learning web service as function in Azure Stream Analytics&lt;/li&gt;
&lt;li&gt;Run Azure Stream Analytics Job
&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/7cfe1vdnDLE"&gt;
&lt;/iframe&gt;
&lt;/li&gt;
&lt;/ul&gt;

</description>
      <category>azure</category>
      <category>machinelearning</category>
      <category>iot</category>
      <category>steamanalytics</category>
    </item>
    <item>
      <title>How to enable Azure Cosmos DB Data Discovery using Microsoft Purview</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Sun, 13 Nov 2022 07:11:02 +0000</pubDate>
      <link>https://dev.to/balramprasad/how-to-enable-azure-cosmos-db-data-discovery-using-microsoft-purview-58aj</link>
      <guid>https://dev.to/balramprasad/how-to-enable-azure-cosmos-db-data-discovery-using-microsoft-purview-58aj</guid>
      <description>&lt;p&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/YEYwE62uPgo"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

</description>
      <category>azure</category>
      <category>purview</category>
      <category>bigdata</category>
    </item>
    <item>
      <title>How to use PySpark and Spark SQL , MatPlotLib and Seaborn in Azure Synapse Analytics and Spark Pool</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Sun, 13 Nov 2022 07:05:29 +0000</pubDate>
      <link>https://dev.to/balramprasad/how-to-use-pyspark-and-spark-sql-matplotlib-and-seaborn-in-azure-synapse-analytics-and-spark-pool-2gfp</link>
      <guid>https://dev.to/balramprasad/how-to-use-pyspark-and-spark-sql-matplotlib-and-seaborn-in-azure-synapse-analytics-and-spark-pool-2gfp</guid>
      <description>&lt;p&gt;How to use PySpark and Spark SQL , MatPlotLib and Seaborn in Azure Synapse Analytics&lt;/p&gt;

&lt;p&gt;PySpark is an interface for Apache Spark in Python. It not only allows you to write Spark applications using Python APIs, but also provides the PySpark shell for interactively analyzing your data in a distributed environment. PySpark supports most of Spark’s features such as Spark SQL, DataFrame, Streaming, MLlib (Machine Learning) and Spark Core.&lt;/p&gt;

&lt;p&gt;Spark SQL lets you query structured data inside Spark programs, using either SQL or a familiar DataFrame API. Usable in Java, Scala, Python and R.&lt;/p&gt;

&lt;p&gt;Matplotlib is a comprehensive library for creating static, animated, and interactive visualizations in Python. Matplotlib makes easy things easy and hard things possible.&lt;/p&gt;

&lt;p&gt;Create publication quality plots.&lt;br&gt;
Make interactive figures that can zoom, pan, update.&lt;br&gt;
Customize visual style and layout.&lt;br&gt;
Export to many file formats.&lt;br&gt;
Embed in JupyterLab and Graphical User Interfaces.&lt;br&gt;
Use a rich array of third-party packages built on Matplotlib.&lt;/p&gt;

&lt;p&gt;Seaborn is a Python data visualization library based on matplotlib. It provides a high-level interface for drawing attractive and informative statistical graphics.&lt;/p&gt;

&lt;p&gt;Azure Synapse Analytics is a limitless analytics service that brings together data integration, enterprise data warehousing, and big data analytics. It gives you the freedom to query data on your terms, using either serverless or dedicated options—at scale. Azure Synapse brings these worlds together with a unified experience to ingest, explore, prepare, transform, manage, and serve data for immediate BI and machine learning needs.&lt;/p&gt;

&lt;p&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/tft8JP4lz3w"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

</description>
      <category>azure</category>
      <category>azuresynapse</category>
      <category>bigdata</category>
      <category>dataengineering</category>
    </item>
    <item>
      <title>What Is Web Scraping And how to do with azure Synapse and Python and Spark Pool</title>
      <dc:creator>Balram Prasad</dc:creator>
      <pubDate>Sun, 13 Nov 2022 07:02:23 +0000</pubDate>
      <link>https://dev.to/balramprasad/what-is-web-scraping-and-how-to-do-with-azure-synapse-and-python-and-spark-pool-16m8</link>
      <guid>https://dev.to/balramprasad/what-is-web-scraping-and-how-to-do-with-azure-synapse-and-python-and-spark-pool-16m8</guid>
      <description>&lt;p&gt;What is Web Scraping And how to do with azure Synapse and Python?&lt;/p&gt;

&lt;p&gt;Web scraping is the process of gathering information from the Internet. Even copying and pasting the lyrics of your favorite song is a form of web scraping! However, the words “web scraping” usually refer to a process that involves automation.Automated web scraping can be a solution to speed up the data collection process. You write your code once, and it will get the information you want many times and from many pages.&lt;/p&gt;

&lt;p&gt;&lt;iframe width="710" height="399" src="https://www.youtube.com/embed/J5VI-cZKZMM"&gt;
&lt;/iframe&gt;
&lt;/p&gt;

</description>
      <category>azure</category>
      <category>azuresynapse</category>
      <category>bigdata</category>
      <category>dataengineering</category>
    </item>
  </channel>
</rss>
