# dataengineering

5 min read

Hyunho Richard Lee for Meadowrun

Sep 1 '22

Kubernetes Was Never Designed for Batch Jobs

#airflow #mlops #dataengineering #kubernetes

17 min read

Kinyungu Denis

Aug 31 '22

Data Engineering 102: Introduction to Python for Data Engineering.

#python #dataengineering #beginners

10 min read

muriuki muriungi erick

Aug 31 '22

Introduction to Python for Data Engineering

#python #dataengineering #aws #iot

7 min read

fatumakaliku

Aug 31 '22

INTRODUCTION TO PYTHON FOR DATA ENGINEERING

#python #data #dataengineering #beginners

4 min read

viola kinya kithinji

Aug 24 '22

DATA ENGINEERING 101:INTRODUCTION TO DATA ENGINNERING.

#codenewbie #dataengineering #beginners #programming

2 min read

Armando Tadeu

Aug 24 '22

Fundamentos da Engenharia de Dados

#dataengineering #database

9 min read

Emmanuel Kariithi

Aug 23 '22

Data Engineering 101: Introduction to Data Engineering

#newbie #dataengineering

2 min read

Pavlo Paska

Aug 21 '22

Online SQL Client for low code data management

#sql #database #dataengineering #lowcode

5 min read

Kinyungu Denis

Aug 19 '22

Data Engineering 101: Introduction to Data Engineering.

#dataengineering #beginners

6 min read

muriuki muriungi erick

Aug 19 '22

Introduction to data engineering

#datascience #dataengineering #python #sql

4 min read

Falk

Aug 16 '22

Create Jira Ticket on Prefect Task Failure

#python #dataengineering

2 min read

Falk

Aug 15 '22

Hash Personal Identifiable Information (PII) in your ELT pipelines

#python #dataengineering #database

3 min read

Muhammad Rameez

Aug 4 '22

Difference Between Data Engineer and Data Scientist?

#difference #pipeline #dataengineering #datascientist

3 min read

Ruikai Li

Jul 29 '22

Learning Workflow Schedulers (Oozie)

#bigdata #datascience #dataengineering

5 min read

Olakusibe Aremu-Oluwole

Jul 26 '22

Solving AttributeError: 'float' object has no attribute 'rint'

#python #etl #dataengineering #pandas

2 min read

Tiago Xavier

Jul 19 '22

[Spark-k8s] — Getting started # Part 1

#spark #kubernetes #dataengineering

4 min read

SAIFULLAH🇮🇳

Jul 17 '22

Websites to find Dataset for your Data Engineering projects.

#datascience #dataengineering #database #dataset

1 min read

DMetaSoul

Jun 26 '22

Data engineers must-see: The future trend of big data cloud services

#database #dataengineering #bigdata #opensource

8 min read

Ramses Alexander Coraspe

Jun 15 '22

Data Engineering Projects for Beginners

#database #dataengineering #python

24

2 min read

Albert Ulysses

Jun 13 '22

Data Pipelines with Apache Airflow - Book Review

#python #dataengineering #books #bigdata

2 min read

Monica Miller

Jun 13 '22

ETL vs Interactive Queries: The Case for Both

#database #dataengineering #datascience #etl

8 min read

Nkwam Philip

Jun 9 '22

Data Engineering - Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow

#database #googlecloud #dataengineering #cloud

10

4 min read

Bartosz Mikulski for Cube

Jun 8 '22

Parsing logs from multiple data sources with Ahana and Cube

#ahana #presto #dataengineering

14

24 min read

DMetaSoul

May 29 '22

Solved a practical business problem when using Hudi: LakeSoul supports null field non-override semanticssemantics

#opensource #database #dataengineering #bigdata

3 min read

DMetaSoul

May 14 '22

What is the Lakehouse, the latest Direction of Big Data Architecture?

#opensource #dataengineering #bigdata #database

10 min read

Team RudderStack for RudderStack

Apr 4 '22

Making Data Engineering Easier: Operational Analytics With Event Streaming and Reverse ETL

#datascience #eventstreaming #dataengineering #customerdataplatform

6 min read

Cem Keskin

May 2 '22

Using dbt for Transformation Tasks on BigQuery

#dezoomcamp #dataengineering

10

4 min read

Abdullah Paracha for AWS Community Builders

Apr 27 '22

Docker and Kubernetes

#devops #dataengineering #softwareengineer #programming

3 min read

Cem Keskin

Apr 24 '22

How to Use Apache Airflow to Get 1000+ Files From a Public Dataset

#dezoomcamp #dataengineering #airflow #publicdatasets

10 min read

Rubens Barbosa

Apr 24 '22

ELT Data Pipeline with Kubernetes CronJob, Azure Data Lake, Azure Databricks (Part 1)

#etl #dataengineering #python #azure

5 min read

Matt Eland

Apr 22 '22

What is Azure Synapse Analytics?

#data #dataengineering #azure #cloud

7 min read

DMetaSoul

Apr 16 '22

Design concept of a best opensource project about big data and data lakehouse

#opensource #dataengineering #bigdata #datascience

9 min read

Team RudderStack

Apr 11 '22

When To Build vs. Buy Data Pipelines

#cdp #datascience #datapipeline #dataengineering

6 min read

Gabriel Luz

May 2 '22

How to prepare for the GCP Professional Data Engineer certification

#googlecloud #dataengineering #gcp #bigdata

31

8 min read

DMetaSoul

Apr 7 '22

Details of 4 best opensource projects about big data you should try out（Ⅰ）

#opensource #dataengineering #bigdata #spark

5 min read

Ludovic DEHON for Kestra

Apr 5 '22

Debezium Change Data Capture without Kafka Connect

#database #dataengineering #opensource #etl

10

8 min read

Cem Keskin

Apr 3 '22

Building GCS Buckets and BigQuery Tables with Terraform

#dezoomcamp #dataengineering #bigquery #gcp

4 min read

Rodel E. Dagumampan

Feb 22 '22

Released yuniql v1.2.25. Multi-tenant support, Oracle and largest set of bug fixes

#yuniql #database #devops #dataengineering

4 min read

DMetaSoul

Mar 25 '22

Quick use of CDC: A new demo from lakesoul makes it easier to set up the environment

#opensource #dataengineering #bigdata #spark

5 min read

Raphael Gutierrez

Mar 25 '22

Considerations when performing ETL

#dataengineering #etl

3 min read

DMetaSoul

Mar 24 '22

4 best opensource projects about big data you should try out

#opensource #dataengineering #bigdata #spark

16

3 min read

David Cox

Mar 23 '22

Preparing for Professional Cloud Data Engineer Certification (March 2022)

#googlecloud #cloud #dataengineering

12 min read

DMetaSoul

Mar 17 '22

A new unified streaming and batch table storage solution similar to iceberg/hudi/delta lake but with several new functions

#dataengineering #opensource #bigdata #programming

2 min read

Lis R. Barreto

Mar 9 '22

[OPINIÃO] Construindo uma Carreira como Data Engineer

#bigdata #dataengineering #tips

2 min read

Preeti Hemant

Mar 5 '22

What is Data Profiling?

#data #dataengineering #shortread #analyticsengineering

1 min read

Lis R. Barreto

Feb 24 '22

[DICA] Adentre o universo da Engenharia de Dados com profissionais brasileiros que se tornaram referência na área!

#bigdata #dados #dataengineering #career

2 min read

Preeti Hemant

Feb 23 '22

Data architecture models

#datamesh #data #dataengineering #etl

6 min read

Lis R. Barreto

Feb 18 '22

[ARTIGO] Data Warehouse, Data Lake e Data Lakehouse: Conceitos e Diferenças

#bigdata #data #dataengineering

3 min read

Team RudderStack for RudderStack

Feb 14 '22

Enabling the Customer Data Stack: RudderStack Series B Funding

#seriesb #cdp #rudderstack #dataengineering

1 min read

Ludovic DEHON for Kestra

Feb 2 '22

Kestra, infinitely scalable open source orchestration and scheduling platform.

#dataengineering #data #etl #opensource

6 min read

biellls

Jan 29 '22

Modern data warehouse patterns: ELT with Snowflake variants

#snowflake #dataengineering #etl #elt

6 min read

biellls

Jan 21 '22

Standing on the shoulders of giants. Part one: Airflow

#airflow #dataengineering #python #data

5 min read

Logan Kilpatrick

Jan 29 '22

Data Engineering in Julia

#machinelearning #julia #dataengineering #julialang

1 min read

Team RudderStack for RudderStack

Jan 3 '22

How Engineering Teams Use RudderStack to Support Marketing

#dataengineering #marketing #dataanalytics #datawarehouse

7 min read

Team RudderStack for RudderStack

Dec 28 '21

Why It’s Hard for Engineering to Support Marketing

#dataengineering #etl #marketing #dataanlytics

3 min read

OLABAYO BALOGUN

Dec 23 '21

Introduction to Data Engineering

#dataengineering #programming #datascience #database

5 min read

Jorge PM

Dec 22 '21

Extract csv data and load it to PostgreSQL using Meltano ELT

#python #meltano #dataengineering #elt

6 min read

Tomas

Dec 30 '21

Data Engineering Pipeline with AWS Step Functions, CodeBuild and Dagster

#aws #dagster #dataengineering #python

10 min read

Team RudderStack for RudderStack

Dec 17 '21

What Is Event-Driven Machine Learning?

#eventdriven #machinelearning #cdp #dataengineering