Dataengineering

DMetaSoul

May 29 '22

Solved a practical business problem when using Hudi: LakeSoul supports null field non-override semanticssemantics

#opensource #database #dataengineering #bigdata

7

3 min read

DMetaSoul

May 14 '22

What is the Lakehouse, the latest Direction of Big Data Architecture?

#opensource #dataengineering #bigdata #database

9

10 min read

Team RudderStack for RudderStack

Apr 4 '22

Making Data Engineering Easier: Operational Analytics With Event Streaming and Reverse ETL

#datascience #eventstreaming #dataengineering #customerdataplatform

7

6 min read

Cem Keskin

May 2 '22

Using dbt for Transformation Tasks on BigQuery

#dezoomcamp #dataengineering

10

1

4 min read

Gabriel Luz

May 2 '22

How to prepare for the GCP Professional Data Engineer certification

#googlecloud #dataengineering #gcp #bigdata

19

1

8 min read

Abdullah Paracha for AWS Community Builders

Apr 27 '22

Docker and Kubernetes

#devops #dataengineering #softwareengineer #programming

6

3 min read

Cem Keskin

Apr 24 '22

How to Use Apache Airflow to Get 1000+ Files From a Public Dataset

#dezoomcamp #dataengineering #airflow #publicdatasets

8

10 min read

Rubens Barbosa

Apr 24 '22

ELT Data Pipeline with Kubernetes CronJob, Azure Data Lake, Azure Databricks (Part 1)

#etl #dataengineering #python #azure

7

5 min read

Matt Eland

Apr 22 '22

What is Azure Synapse Analytics?

#data #dataengineering #azure #cloud

4

7 min read

DMetaSoul

Apr 16 '22

Design concept of a best opensource project about big data and data lakehouse

#opensource #dataengineering #bigdata #datascience

9

9 min read

Team RudderStack

Apr 11 '22

When To Build vs. Buy Data Pipelines

#cdp #datascience #datapipeline #dataengineering

3

6 min read

DMetaSoul

Apr 7 '22

Details of 4 best opensource projects about big data you should try out（Ⅰ）

#opensource #dataengineering #bigdata #spark

8

5 min read

Ludovic DEHON for Kestra

Apr 5 '22

Debezium Change Data Capture without Kafka Connect

#database #dataengineering #opensource #etl

10

1

8 min read

Cem Keskin

Apr 3 '22

Building GCS Buckets and BigQuery Tables with Terraform

#dezoomcamp #dataengineering #bigquery #gcp

5

4 min read

Rodel E. Dagumampan

Feb 22 '22

Released yuniql v1.2.25. Multi-tenant support, Oracle and largest set of bug fixes

#yuniql #database #devops #dataengineering

5

4 min read

DMetaSoul

Mar 25 '22

Quick use of CDC: A new demo from lakesoul makes it easier to set up the environment

#opensource #dataengineering #bigdata #spark

8

5 min read

Raphael Gutierrez

Mar 25 '22

Considerations when performing ETL

#dataengineering #etl

4

3 min read

DMetaSoul

Mar 24 '22

4 best opensource projects about big data you should try out

#opensource #dataengineering #bigdata #spark

16

3

3 min read

David Cox

Mar 23 '22

Preparing for Professional Cloud Data Engineer Certification (March 2022)

#googlecloud #cloud #dataengineering

3

2

12 min read

DMetaSoul

Mar 17 '22

A new unified streaming and batch table storage solution similar to iceberg/hudi/delta lake but with several new functions

#dataengineering #opensource #bigdata #programming

8

2 min read

Lis R. Barreto

Mar 9 '22

[OPINIÃO] Construindo uma Carreira como Data Engineer

#bigdata #dataengineering #tips

2

2 min read

Preeti Hemant

Mar 5 '22

What is Data Profiling?

#data #dataengineering #shortread #analyticsengineering

2

1 min read

Lis R. Barreto

Feb 24 '22

[DICA] Adentre o universo da Engenharia de Dados com profissionais brasileiros que se tornaram referência na área!

#bigdata #dados #dataengineering #career

5

2 min read

Preeti Hemant

Feb 23 '22

Data architecture models

#datamesh #data #dataengineering #etl

2

6 min read

Lis R. Barreto

Feb 18 '22

[ARTIGO] Data Warehouse, Data Lake e Data Lakehouse: Conceitos e Diferenças

#bigdata #data #dataengineering

6

3 min read

Team RudderStack for RudderStack

Feb 14 '22

Enabling the Customer Data Stack: RudderStack Series B Funding

#seriesb #cdp #rudderstack #dataengineering

2

1 min read

Ludovic DEHON for Kestra

Feb 2 '22

Kestra, infinitely scalable open source orchestration and scheduling platform.

#dataengineering #data #etl #opensource

3

6 min read

biellls

Jan 29 '22

Modern data warehouse patterns: ELT with Snowflake variants

#snowflake #dataengineering #etl #elt

9

6 min read

Logan Kilpatrick

Jan 29 '22

Data Engineering in Julia

#machinelearning #julia #dataengineering #julialang

4

1 min read

biellls

Jan 21 '22

Standing on the shoulders of giants. Part one: Airflow

#airflow #dataengineering #python #data

7

5 min read

Team RudderStack for RudderStack

Jan 3 '22

How Engineering Teams Use RudderStack to Support Marketing

#dataengineering #marketing #dataanalytics #datawarehouse

6

7 min read

Tomas

Dec 30 '21

Data Engineering Pipeline with AWS Step Functions, CodeBuild and Dagster

#aws #dagster #dataengineering #python

9

3

10 min read

Team RudderStack for RudderStack

Dec 28 '21

Why It’s Hard for Engineering to Support Marketing

#dataengineering #etl #marketing #dataanlytics

2

3 min read

OLABAYO BALOGUN

Dec 23 '21

Introduction to Data Engineering

#dataengineering #programming #datascience #database

2

5 min read

Jorge PM

Dec 22 '21

Extract csv data and load it to PostgreSQL using Meltano ELT

#python #meltano #dataengineering #elt

5

6 min read

Team RudderStack for RudderStack

Dec 17 '21

What Is Event-Driven Machine Learning?

#eventdriven #machinelearning #cdp #dataengineering

6

4 min read

Cribber

Nov 10 '21

Host a fully persisted Apache NiFi service with docker

#docker #apache #nifi #dataengineering

3

1 min read

Barbara

Nov 29 '21

Relational data models

#sql #dataengineering #learn #sketchnote

5

2 min read

Team RudderStack for RudderStack

Nov 26 '21

Implementing Graceful Shutdown in Go

#go #dataengineering #sre #database

15

5

14 min read

Team RudderStack for RudderStack

Nov 25 '21

Open Source Analytics Stack: Bringing Control, Flexibility, and Data-Privacy to Your Analytics

#privacy #analytics #dataanalytics #dataengineering

4

1

10 min read

Team RudderStack for RudderStack

Nov 25 '21

RudderStack + Blendo: Better Together

#blendo #dataengineering #etl #cdp

2

7 min read

CincyBC

Nov 24 '21

Web Scraping Sprott U Fund with BS4 in 10 Lines of Code

#python #beautifulsoup #dataengineering

30

3 min read

Team RudderStack for RudderStack

Nov 24 '21

RudderStack’s Licensing Explained

#cdp #dataengineering #rudderstack #privacy

3

4 min read

Team RudderStack for RudderStack

Nov 22 '21

Introducing RudderStack's New, High-performance JavaScript SDK

#javascript #sdk #rudderstack #dataengineering

2

3 min read

Team RudderStack for RudderStack

Nov 19 '21

The Open Source Story - Open Sourcing RudderStack Blog and Docs

#opensource #gatsby #cdp #dataengineering

3

5 min read

Team RudderStack for RudderStack

Nov 15 '21

4 Reasons Why Data Engineers Hate Google Tag Manager

#dataengineering #googletagmanager #dataanlytics

3

6 min read

Team RudderStack for RudderStack

Nov 2 '21

Overcoming the Limitations of Client-Side Form Tracking With Webhooks

#webhook #javascript #dataengineering #jamstack

4

6 min read

WanjohiChristopher

Oct 29 '21

Data Engineering:Extract, Transform,and Load Using Talend Open Studio.

#dataengineering #etl #python #talend

17

3 min read

Team RudderStack for RudderStack

Oct 28 '21

The Data Engineering Megatrend: A Brief History

#datascience #dataengineering #database #rudderstack

2

7 min read

Team RudderStack for RudderStack

Oct 19 '21

RudderStack Product News Vol. #013 - Destinations Re-design and New Integrations

#ui #dataengineering #privacy

2

2 min read

Taron Foxworth

Sep 2 '21

Stream Your Database Changes with Change Data Capture: Part Two

#database #cdc #changedatacapture #dataengineering

6

10 min read

Team RudderStack for RudderStack

Aug 30 '21

Why the Cloud SaaS Tools Used by Marketing, Sales, and Product Teams Create Data Silos

#cloudsaas #dataengineering #datascience #cdp

3

5 min read

Swapnil Pawar

Aug 16 '21

Want To Learn MLOps?

#machinelearning #operations #dataengineering #mlops

13

4 min read

Taron Foxworth

Aug 11 '21

Stream Your Database Changes with Change Data Capture

#dataengineering #database #cdc #eventstreamprocessing

9

9 min read

Kimaru Thagana

Aug 4 '21

The Data Trinity

#dataengineering #etl #elt #datapipelines

5

4 min read

ng-conf

Jul 6 '21

Editing Tabular Data in Angular

#angular #typescript #dataengineering

5

11 min read

Eric P Green

Jul 5 '21

Evolution of a data system

#architecture #datascience #database #dataengineering

10

2

5 min read

Taron Foxworth

Jun 8 '21

Creating a Soft Delete Archive Table with PostgreSQL

#postgres #dataengineering #changedatacapture

4

2 min read

Ong Chin Hwee

May 15 '21

I Started Learning Scala as a Python Programmer. Here’s Why.

#python #scala #dataengineering

4

1

5 min read

Stefanie Davis

Mar 31 '21

Edgar Codd and The Modern Data Stack

#database #datascience #dataengineering #data

1

2 min read