# dataengineering

4 min read

muriuki muriungi erick

Feb 20 '23

Python functions and lambda functions in data engineering.

#dataengineering #python #lambda #functions

3 min read

franklinobasy

Feb 20 '23

Creating Data Pipelines as DAGs in Apache Airflow (Part 1)

#dataengineering #airflow #dags #python

6 min read

muriuki muriungi erick

Feb 19 '23

Using python dictionary in data engineering.

#dataengineering #python #tutorial #100daysofcode

2 min read

James

Feb 17 '23

prefect vs apache airflow

#dataengineering #workfloworchestration #prefect #airflow

4 min read

Marriane Akeyo

Feb 17 '23

SQL101: Introduction to SQL

#sql #datascience #database #dataengineering

2

14 min read

Pramit Marattha for Chaos Genius

Feb 2 '23

22 Best DataOps Tools To Optimize Your Data Management and Observability In 2023

#dataops #data #beginners #dataengineering

16

30 min read

Samuel Earl

Jan 31 '23

Data Pipelines with Great Expectations | Introduction

#datascience #dataengineering #datavalidation #greatexpectations

2 min read

Mike Houngbadji

Jan 20 '23

Building a Data Lakehouse for Analyzing Elon Musk Tweets using MinIO, Apache Airflow, Apache Drill and Apache Superset

#dataengineering #datascience #python #database

16

8 min read

PaulOpu

Jan 14 '23

Nesting Columns like a Pro: A Guide to Mastering Nested Structs in PySpark

#python #pyspark #bigdata #dataengineering

4 min read

Geazi Anc

Jan 11 '23

PySpark: A brief analysis to the most common words in Dracula, by Bram Stoker

#python #dataengineering #spark #datascience

18

5 min read

Parth soni

Jan 12 '23

AWS Data Engineering Services: Everything you need to know

#aws #cloudskills #dataengineering #awscommunity

9 min read

Ruma Sinha

Dec 25 '22

Working with Map() function in Python, Pyspark and Apache Beam

#python #pyspark #distributedcomputing #dataengineering

3 min read

Yogesh Dipankar for OCP

Dec 15 '22

Time Series Database and Analytics using Azure Data Explorer

#dataengineering #datascience #timeseries #azure

4 min read

Dipankar Medhi

Dec 28 '22

How I built a real-time Machine Learning system with Kafka, Elasticsearch, Kibana, and Docker

#streaming #machinelearning #dataengineering #datascience

4 min read

Aparna Aravind

Nov 25 '22

Handling schema changes in snowflake

#snowflake #dataengineering #spark #schemaevolution

5 min read

Sanjay Krishna

Oct 25 '22

Redshift Deep Dive

#aws #redshift #dataengineering #dataanalytics

5 min read

avital trifsik for Memphis.dev

Nov 9 '22

Data Engineering Trends for 2023

#dataengineering #datacontracts #eventsourcing #streamingdata

4 min read

avital trifsik for Memphis.dev

Nov 2 '22

The Changing Face Of ETL

#etl #dataengineering #datapipelines #elt

12 min read

James Oyanna

Oct 31 '22

Ultimate guide to becoming a Data Analyst/Data Scientist

#datascience #dataanalyst #dataengineering #machinelearning

4 min read

prasanth mathesh for AWS Community Builders

Oct 25 '22

Amazon SQS and serverless DataEngineering workloads

#sqs #amazon #dataengineering #serverless

3 min read

Mwenda Harun Mbaabu

Oct 10 '22

2022 Beginner Friendly Modern Data Engineering Career path With Learning Resources.

#python #datascience #dataengineering #machinelearning

20

2 min read

Kinyungu Denis

Oct 5 '22

Learn Ansible and how to Install it in Ubuntu 22.04.

#tutorial #install #dataengineering

3 min read

Geazi Anc

Sep 29 '22

Uma breve Introdução ao processamento de dados em tempo real com Spark Structured Streaming e Apache Kafka

#python #dataengineering #braziliandevs #spark

8 min read

Cesar Mostacero

Sep 29 '22

Apache-Spark introduction for SQL developers

#apachespark #dataengineering #beginners #bigdata

7 min read

Geazi Anc

Sep 24 '22

PySpark: uma breve análise das palavras mais comuns em Drácula, por Bram Stoker

#python #dataengineering #spark #braziliandevs

9

6 min read

Geazi Anc

Sep 15 '22

Introdução à análise de dados com PySpark utilizando os dados dos campeões de League of Legends

#pyspark #python #dataanalysis #dataengineering

8 min read

Geazi Anc

Sep 13 '22

Pokemons Flow: desenvolvendo uma pipeline de dados com apache airflow para extração de pokemon via API

#python #dataengineering #braziliandevs #airflow

10

6 min read

Kinyungu Denis

Sep 9 '22

Apache PySpark for Data Engineering

#beginners #python #dataengineering #sql

13

9 min read

Haji Rufai

Sep 1 '22

Introduction to Python for Data Engineering

#python #dataengineering #pythonfordataengineering #beginners

5 min read

Hyunho Richard Lee for Meadowrun

Sep 1 '22

Kubernetes Was Never Designed for Batch Jobs

#airflow #mlops #dataengineering #kubernetes

17 min read

Kinyungu Denis

Aug 31 '22

Data Engineering 102: Introduction to Python for Data Engineering.

#python #dataengineering #beginners

10 min read

muriuki muriungi erick

Aug 31 '22

Introduction to Python for Data Engineering

#python #dataengineering #aws #iot

7 min read

fatumakaliku

Aug 31 '22

INTRODUCTION TO PYTHON FOR DATA ENGINEERING

#python #data #dataengineering #beginners

4 min read

viola kinya kithinji

Aug 24 '22

DATA ENGINEERING 101:INTRODUCTION TO DATA ENGINNERING.

#codenewbie #dataengineering #beginners #programming

2 min read

Armando Tadeu

Aug 24 '22

Fundamentos da Engenharia de Dados

#dataengineering #database

9 min read

Emmanuel Kariithi

Aug 23 '22

Data Engineering 101: Introduction to Data Engineering

#newbie #dataengineering

2 min read

Pavlo Paska

Aug 21 '22

Online SQL Client for low code data management

#sql #database #dataengineering #lowcode

5 min read

Kinyungu Denis

Aug 19 '22

Data Engineering 101: Introduction to Data Engineering.

#dataengineering #beginners

6 min read

muriuki muriungi erick

Aug 19 '22

Introduction to data engineering

#datascience #dataengineering #python #sql

4 min read

Falk

Aug 16 '22

Create Jira Ticket on Prefect Task Failure

#python #dataengineering

2 min read

Falk

Aug 15 '22

Hash Personal Identifiable Information (PII) in your ELT pipelines

#python #dataengineering #database

3 min read

Muhammad Rameez

Aug 4 '22

Difference Between Data Engineer and Data Scientist?

#difference #pipeline #dataengineering #datascientist

3 min read

Ruikai Li

Jul 29 '22

Learning Workflow Schedulers (Oozie)

#bigdata #datascience #dataengineering

5 min read

Olakusibe Aremu-Oluwole

Jul 26 '22

Solving AttributeError: 'float' object has no attribute 'rint'

#python #etl #dataengineering #pandas

2 min read

Tiago Xavier

Jul 19 '22

[Spark-k8s] — Getting started # Part 1

#spark #kubernetes #dataengineering

4 min read

SAIFULLAH🇮🇳

Jul 17 '22

Websites to find Dataset for your Data Engineering projects.

#datascience #dataengineering #database #dataset

1 min read

DMetaSoul

Jun 26 '22

Data engineers must-see: The future trend of big data cloud services

#database #dataengineering #bigdata #opensource

8 min read

Ramses Alexander Coraspe

Jun 15 '22

Data Engineering Projects for Beginners

#database #dataengineering #python

24

2 min read

Albert Ulysses

Jun 13 '22

Data Pipelines with Apache Airflow - Book Review

#python #dataengineering #books #bigdata

2 min read

Monica Miller

Jun 13 '22

ETL vs Interactive Queries: The Case for Both

#database #dataengineering #datascience #etl

8 min read

Nkwam Philip

Jun 9 '22

Data Engineering - Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow

#database #googlecloud #dataengineering #cloud

10

4 min read

Bartosz Mikulski for Cube

Jun 8 '22

Parsing logs from multiple data sources with Ahana and Cube

#ahana #presto #dataengineering

14

24 min read

DMetaSoul

May 29 '22

Solved a practical business problem when using Hudi: LakeSoul supports null field non-override semanticssemantics

#opensource #database #dataengineering #bigdata

3 min read

DMetaSoul

May 14 '22

What is the Lakehouse, the latest Direction of Big Data Architecture?

#opensource #dataengineering #bigdata #database

9

10 min read

Team RudderStack for RudderStack

Apr 4 '22

Making Data Engineering Easier: Operational Analytics With Event Streaming and Reverse ETL

#datascience #eventstreaming #dataengineering #customerdataplatform

6 min read

Cem Keskin

May 2 '22

Using dbt for Transformation Tasks on BigQuery

#dezoomcamp #dataengineering

10

4 min read

Abdullah Paracha for AWS Community Builders

Apr 27 '22

Docker and Kubernetes

#devops #dataengineering #softwareengineer #programming

3 min read

Cem Keskin

Apr 24 '22

How to Use Apache Airflow to Get 1000+ Files From a Public Dataset

#dezoomcamp #dataengineering #airflow #publicdatasets