# dataengineering

4 min read

SAIFULLAH🇮🇳

Jul 17 '22

Websites to find Dataset for your Data Engineering projects.

#datascience #dataengineering #database #dataset

1 min read

DMetaSoul

Jun 26 '22

Data engineers must-see: The future trend of big data cloud services

#database #dataengineering #bigdata #opensource

8 min read

Ramses Alexander Coraspe

Jun 15 '22

Data Engineering Projects for Beginners

#database #dataengineering #python

24

2 min read

Albert Ulysses

Jun 13 '22

Data Pipelines with Apache Airflow - Book Review

#python #dataengineering #books #bigdata

2 min read

Monica Miller

Jun 13 '22

ETL vs Interactive Queries: The Case for Both

#database #dataengineering #datascience #etl

8 min read

Nkwam Philip

Jun 9 '22

Data Engineering - Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow

#database #googlecloud #dataengineering #cloud

10

4 min read

Bartosz Mikulski for Cube

Jun 8 '22

Parsing logs from multiple data sources with Ahana and Cube

#ahana #presto #dataengineering

14

24 min read

DMetaSoul

May 29 '22

Solved a practical business problem when using Hudi: LakeSoul supports null field non-override semanticssemantics

#opensource #database #dataengineering #bigdata

7

3 min read

DMetaSoul

May 14 '22

What is the Lakehouse, the latest Direction of Big Data Architecture?

#opensource #dataengineering #bigdata #database

10 min read

Team RudderStack for RudderStack

Apr 4 '22

Making Data Engineering Easier: Operational Analytics With Event Streaming and Reverse ETL

#datascience #eventstreaming #dataengineering #customerdataplatform

7

6 min read

Cem Keskin

May 2 '22

Using dbt for Transformation Tasks on BigQuery

#dezoomcamp #dataengineering

10

4 min read

Abdullah Paracha for AWS Community Builders

Apr 27 '22

Docker and Kubernetes

#devops #dataengineering #softwareengineer #programming

3 min read

Cem Keskin

Apr 24 '22

How to Use Apache Airflow to Get 1000+ Files From a Public Dataset

#dezoomcamp #dataengineering #airflow #publicdatasets

10 min read

Rubens Barbosa

Apr 24 '22

ELT Data Pipeline with Kubernetes CronJob, Azure Data Lake, Azure Databricks (Part 1)

#etl #dataengineering #python #azure

5 min read

Matt Eland

Apr 22 '22

What is Azure Synapse Analytics?

#data #dataengineering #azure #cloud

7 min read

DMetaSoul

Apr 16 '22

Design concept of a best opensource project about big data and data lakehouse

#opensource #dataengineering #bigdata #datascience

9 min read

Team RudderStack

Apr 11 '22

When To Build vs. Buy Data Pipelines

#cdp #datascience #datapipeline #dataengineering

6 min read

Gabriel Luz

May 2 '22

How to prepare for the GCP Professional Data Engineer certification

#googlecloud #dataengineering #gcp #bigdata

28

8 min read

DMetaSoul

Apr 7 '22

Details of 4 best opensource projects about big data you should try out（Ⅰ）

#opensource #dataengineering #bigdata #spark

5 min read

Ludovic DEHON for Kestra

Apr 5 '22

Debezium Change Data Capture without Kafka Connect

#database #dataengineering #opensource #etl

10

8 min read

Cem Keskin

Apr 3 '22

Building GCS Buckets and BigQuery Tables with Terraform

#dezoomcamp #dataengineering #bigquery #gcp

4 min read

Rodel E. Dagumampan

Feb 22 '22

Released yuniql v1.2.25. Multi-tenant support, Oracle and largest set of bug fixes

#yuniql #database #devops #dataengineering

4 min read

DMetaSoul

Mar 25 '22

Quick use of CDC: A new demo from lakesoul makes it easier to set up the environment

#opensource #dataengineering #bigdata #spark

5 min read

Raphael Gutierrez

Mar 25 '22

Considerations when performing ETL

#dataengineering #etl

3 min read

DMetaSoul

Mar 24 '22

4 best opensource projects about big data you should try out

#opensource #dataengineering #bigdata #spark

16

3 min read

David Cox

Mar 23 '22

Preparing for Professional Cloud Data Engineer Certification (March 2022)

#googlecloud #cloud #dataengineering

12 min read

DMetaSoul

Mar 17 '22

A new unified streaming and batch table storage solution similar to iceberg/hudi/delta lake but with several new functions

#dataengineering #opensource #bigdata #programming

2 min read

Lis R. Barreto

Mar 9 '22

[OPINIÃO] Construindo uma Carreira como Data Engineer

#bigdata #dataengineering #tips

2 min read

Preeti Hemant

Mar 5 '22

What is Data Profiling?

#data #dataengineering #shortread #analyticsengineering

1 min read

Lis R. Barreto

Feb 24 '22

[DICA] Adentre o universo da Engenharia de Dados com profissionais brasileiros que se tornaram referência na área!

#bigdata #dados #dataengineering #career

2 min read

Preeti Hemant

Feb 23 '22

Data architecture models

#datamesh #data #dataengineering #etl

6 min read

Lis R. Barreto

Feb 18 '22

[ARTIGO] Data Warehouse, Data Lake e Data Lakehouse: Conceitos e Diferenças

#bigdata #data #dataengineering

3 min read

Team RudderStack for RudderStack

Feb 14 '22

Enabling the Customer Data Stack: RudderStack Series B Funding

#seriesb #cdp #rudderstack #dataengineering

1 min read

Ludovic DEHON for Kestra

Feb 2 '22

Kestra, infinitely scalable open source orchestration and scheduling platform.

#dataengineering #data #etl #opensource

6 min read

biellls

Jan 29 '22

Modern data warehouse patterns: ELT with Snowflake variants

#snowflake #dataengineering #etl #elt

6 min read

biellls

Jan 21 '22

Standing on the shoulders of giants. Part one: Airflow

#airflow #dataengineering #python #data

7

5 min read

Logan Kilpatrick

Jan 29 '22

Data Engineering in Julia

#machinelearning #julia #dataengineering #julialang

1 min read

Team RudderStack for RudderStack

Jan 3 '22

How Engineering Teams Use RudderStack to Support Marketing

#dataengineering #marketing #dataanalytics #datawarehouse

7 min read

Tomas

Dec 30 '21

Data Engineering Pipeline with AWS Step Functions, CodeBuild and Dagster

#aws #dagster #dataengineering #python

10 min read

Team RudderStack for RudderStack

Dec 28 '21

Why It’s Hard for Engineering to Support Marketing

#dataengineering #etl #marketing #dataanlytics

3 min read

OLABAYO BALOGUN

Dec 23 '21

Introduction to Data Engineering

#dataengineering #programming #datascience #database

5 min read

Jorge PM

Dec 22 '21

Extract csv data and load it to PostgreSQL using Meltano ELT

#python #meltano #dataengineering #elt

6 min read

Team RudderStack for RudderStack

Dec 17 '21

What Is Event-Driven Machine Learning?

#eventdriven #machinelearning #cdp #dataengineering

4 min read

Cribber

Nov 10 '21

Host a fully persisted Apache NiFi service with docker

#docker #apache #nifi #dataengineering

1 min read

Barbara

Nov 29 '21

Relational data models

#sql #dataengineering #learn #sketchnote

2 min read

Team RudderStack for RudderStack

Nov 26 '21

Implementing Graceful Shutdown in Go

#go #dataengineering #sre #database

15

14 min read

Team RudderStack for RudderStack

Nov 25 '21

Open Source Analytics Stack: Bringing Control, Flexibility, and Data-Privacy to Your Analytics

#privacy #analytics #dataanalytics #dataengineering

10 min read

Team RudderStack for RudderStack

Nov 25 '21

RudderStack + Blendo: Better Together

#blendo #dataengineering #etl #cdp

7 min read

CincyBC

Nov 24 '21

Web Scraping Sprott U Fund with BS4 in 10 Lines of Code

#python #beautifulsoup #dataengineering

30

3 min read

Team RudderStack for RudderStack

Nov 24 '21

RudderStack’s Licensing Explained

#cdp #dataengineering #rudderstack #privacy

4 min read

Team RudderStack for RudderStack

Nov 22 '21

Introducing RudderStack's New, High-performance JavaScript SDK

#javascript #sdk #rudderstack #dataengineering

3 min read

Team RudderStack for RudderStack

Nov 19 '21

The Open Source Story - Open Sourcing RudderStack Blog and Docs

#opensource #gatsby #cdp #dataengineering

5 min read

Team RudderStack for RudderStack

Nov 15 '21

4 Reasons Why Data Engineers Hate Google Tag Manager

#dataengineering #googletagmanager #dataanlytics

6 min read

Team RudderStack for RudderStack

Nov 2 '21

Overcoming the Limitations of Client-Side Form Tracking With Webhooks

#webhook #javascript #dataengineering #jamstack

6 min read

Team RudderStack for RudderStack

Oct 28 '21

The Data Engineering Megatrend: A Brief History

#datascience #dataengineering #database #rudderstack

7 min read

Team RudderStack for RudderStack

Oct 19 '21

RudderStack Product News Vol. #013 - Destinations Re-design and New Integrations

#ui #dataengineering #privacy

2 min read

WanjohiChristopher

Oct 29 '21

Data Engineering:Extract, Transform,and Load Using Talend Open Studio.

#dataengineering #etl #python #talend

21

3 min read

Taron Foxworth

Sep 2 '21

Stream Your Database Changes with Change Data Capture: Part Two

#database #cdc #changedatacapture #dataengineering

10 min read

Team RudderStack for RudderStack

Aug 30 '21

Why the Cloud SaaS Tools Used by Marketing, Sales, and Product Teams Create Data Silos

#cloudsaas #dataengineering #datascience #cdp