DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How proficient is generated AI in transforming text or natural language into SQL?

How proficient is generated AI in transforming text or natural language into SQL?

Comments
4 min read
VS Code Extensions for Data Engineering - Part 1

VS Code Extensions for Data Engineering - Part 1

19
Comments
2 min read
"Day 12: Excel Essentials Unveiled - Sharing Today's Insights on My Learning Adventure! 📊🚀 #ExcelSkills #LearningJourney"

"Day 12: Excel Essentials Unveiled - Sharing Today's Insights on My Learning Adventure! 📊🚀 #ExcelSkills #LearningJourney"

1
Comments
2 min read
"Day 11: Excel Essentials Unveiled - Sharing Today's Insights on My Learning Adventure! 📊🚀 #ExcelSkills #LearningJourney"

"Day 11: Excel Essentials Unveiled - Sharing Today's Insights on My Learning Adventure! 📊🚀 #ExcelSkills #LearningJourney"

1
Comments
2 min read
Solving Pandas .to_sql Double Quotes Issue When Writing to Database

Solving Pandas .to_sql Double Quotes Issue When Writing to Database

Comments
1 min read
Amazon Quicksight vs Microsoft PowerBI

Amazon Quicksight vs Microsoft PowerBI

3
Comments
3 min read
Saving Dataframes into Oracle Database with Python

Saving Dataframes into Oracle Database with Python

7
Comments
1 min read
Generating Avro Schemas from Go types

Generating Avro Schemas from Go types

5
Comments
5 min read
Leaking sensitive data via membership inference attacks on machine learning models

Leaking sensitive data via membership inference attacks on machine learning models

Comments
2 min read
Breaking Free from Proprietary Clouds (Snowflake, RedShift, BigQuery): Top Open Source Alternatives to OLAP Databases

Breaking Free from Proprietary Clouds (Snowflake, RedShift, BigQuery): Top Open Source Alternatives to OLAP Databases

1
Comments
2 min read
How to Use Pyinstaller to Generate an EXE File

How to Use Pyinstaller to Generate an EXE File

2
Comments
3 min read
"Day 5: Excel Essentials Unveiled - Sharing Today's Insights on My Learning Adventure! 📊🚀 #ExcelSkills #LearningJourney"

"Day 5: Excel Essentials Unveiled - Sharing Today's Insights on My Learning Adventure! 📊🚀 #ExcelSkills #LearningJourney"

1
Comments
2 min read
Beginner's guide to Apache Flink

Beginner's guide to Apache Flink

1
Comments
3 min read
¿Quieres ser un Data Engineer certificado por AWS? ¡No te puedes perder esta certificación!

¿Quieres ser un Data Engineer certificado por AWS? ¡No te puedes perder esta certificación!

Comments
2 min read
Build a federated query solution with Apache Doris, Apache Flink, and Apache Hudi

Build a federated query solution with Apache Doris, Apache Flink, and Apache Hudi

5
Comments 2
5 min read
Transform your Pandas Dataframes: Styles, 🎨 Colors, and 😎 Emojis

Transform your Pandas Dataframes: Styles, 🎨 Colors, and 😎 Emojis

10
Comments
9 min read
MLOps project setup: Airbyte - Supabase connection

MLOps project setup: Airbyte - Supabase connection

7
Comments
1 min read
MLOps project setup: Supabase

MLOps project setup: Supabase

3
Comments
1 min read
My 2023 in Code - From Modern Data Platforms to the Full Stack

My 2023 in Code - From Modern Data Platforms to the Full Stack

Comments
9 min read
Introduction to Data Science

Introduction to Data Science

8
Comments 4
2 min read
Glue Data Brew- Data Profiling & Data Quality

Glue Data Brew- Data Profiling & Data Quality

1
Comments
3 min read
How is data warehousing adapting to accommodate the needs of Web3

How is data warehousing adapting to accommodate the needs of Web3

Comments
3 min read
Data Engineering Projects

Data Engineering Projects

Comments
1 min read
Im about to embark a journey into data engineering

Im about to embark a journey into data engineering

1
Comments
1 min read
Decoding a Data Model: Using SchemaSpy in Snowflake ❄️

Decoding a Data Model: Using SchemaSpy in Snowflake ❄️

Comments
4 min read
Test Driving Redshift AI-Driven Scaling

Test Driving Redshift AI-Driven Scaling

1
Comments
3 min read
What Is Data Analysis and How Can You Get Started?

What Is Data Analysis and How Can You Get Started?

6
Comments
4 min read
Flexibility in Integration Engineering

Flexibility in Integration Engineering

Comments
4 min read
Top 5 Modern ETL Tools from AWS

Top 5 Modern ETL Tools from AWS

Comments
3 min read
DATA ENGINEERING ROADMAP FOR BEGINNERS.

DATA ENGINEERING ROADMAP FOR BEGINNERS.

Comments
8 min read
Data Warehouse Concepts, focusing on the Kimball vs. Inmon methodologies

Data Warehouse Concepts, focusing on the Kimball vs. Inmon methodologies

3
Comments
9 min read
🎀 Domaine.nc data as Jupyter on Kaggle 📊

🎀 Domaine.nc data as Jupyter on Kaggle 📊

Comments 3
1 min read
Amazon EMR Summary

Amazon EMR Summary

1
Comments 1
2 min read
Data Virtualization: Working, Advantages, & Disadvantages Explained

Data Virtualization: Working, Advantages, & Disadvantages Explained

Comments
8 min read
Mais dados é melhor que um algoritmo mais eficiente

Mais dados é melhor que um algoritmo mais eficiente

6
Comments
3 min read
Data Science for Beginners: A 12-Month Complete Roadmap

Data Science for Beginners: A 12-Month Complete Roadmap

Comments
2 min read
How Vector Databases Work: A Hands-On Tutorial!

How Vector Databases Work: A Hands-On Tutorial!

11
Comments
9 min read
Big data models 📊 vs. Computer memory 💾

Big data models 📊 vs. Computer memory 💾

187
Comments 3
11 min read
How to Import Existing Resources in your CloudFormation Stacks

How to Import Existing Resources in your CloudFormation Stacks

7
Comments
4 min read
Unveiling the Robust Architecture of SQL Server A Comprehensive Overview

Unveiling the Robust Architecture of SQL Server A Comprehensive Overview

Comments
2 min read
Maximizing Database Efficiency Mastering Query Optimization in SQL

Maximizing Database Efficiency Mastering Query Optimization in SQL

2
Comments
2 min read
The easiest way to navigate through MongoDB, PySpark, and Jupyter Notebook

The easiest way to navigate through MongoDB, PySpark, and Jupyter Notebook

9
Comments
3 min read
8 Rusty open source data projects to watch in 2024 🤩

8 Rusty open source data projects to watch in 2024 🤩

14
Comments 11
7 min read
Data Engineer vs. Business Intelligence Data Analyst

Data Engineer vs. Business Intelligence Data Analyst

1
Comments
4 min read
Unveiling the Azure Data Lake for Bike Share Data Analytics

Unveiling the Azure Data Lake for Bike Share Data Analytics

Comments
1 min read
Data Quality

Data Quality

Comments
15 min read
Data Analysis with ChatGPT Plugin Noteable

Data Analysis with ChatGPT Plugin Noteable

1
Comments
2 min read
Batch Processing using PySpark on AWS EMR

Batch Processing using PySpark on AWS EMR

5
Comments
4 min read
Installing Python Packages in AWS Glue using AWS CodeArtifact

Installing Python Packages in AWS Glue using AWS CodeArtifact

13
Comments
6 min read
Data Engineering for Beginners: Navigating the Foundations of a Data-Driven World

Data Engineering for Beginners: Navigating the Foundations of a Data-Driven World

1
Comments
3 min read
Introducing Memphis Functions

Introducing Memphis Functions

2
Comments
3 min read
Data modelling: Understand the benefits and improve your business

Data modelling: Understand the benefits and improve your business

1
Comments
5 min read
Data Engineering For Beginners: A Step-By-Step Guide

Data Engineering For Beginners: A Step-By-Step Guide

19
Comments
8 min read
Optimizing Data Analysis: A Guide to Handling Missing Data Effectively

Optimizing Data Analysis: A Guide to Handling Missing Data Effectively

6
Comments
3 min read
Code reusability and CD with AWS Glue

Code reusability and CD with AWS Glue

Comments
3 min read
Data modelling techniques: Navigating the complexities

Data modelling techniques: Navigating the complexities

1
Comments
4 min read
Data Engineering Roadmap 2023

Data Engineering Roadmap 2023

4
Comments
4 min read
Amazon Kinesis Firehose

Amazon Kinesis Firehose

2
Comments
2 min read
Data Modeling

Data Modeling

6
Comments
5 min read
AWS Data Engineering Certification

AWS Data Engineering Certification

1
Comments 2
9 min read
loading...