DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Parsing logs from multiple data sources with Ahana and Cube
mikulskibartosz profile

Parsing logs from multiple data sources with Ahana and Cube

#ahana #presto #dataengineering
14
Comments
24 min read
Solved a practical business problem when using Hudi: LakeSoul supports null field non-override semanticssemantics
dmetasoul profile

Solved a practical business problem when using Hudi: LakeSoul supports null field non-override semanticssemantics

#opensource #database #dataengineering #bigdata
7
Comments
3 min read
What is the Lakehouse, the latest Direction of Big Data Architecture?
dmetasoul profile

What is the Lakehouse, the latest Direction of Big Data Architecture?

#opensource #dataengineering #bigdata #database
9
Comments
10 min read
Making Data Engineering Easier: Operational Analytics With Event Streaming and Reverse ETL
teamrudderstack profile

Making Data Engineering Easier: Operational Analytics With Event Streaming and Reverse ETL

#datascience #eventstreaming #dataengineering #customerdataplatform
7
Comments
6 min read
Using dbt for Transformation Tasks on BigQuery
cemkeskin84 profile

Using dbt for Transformation Tasks on BigQuery

#dezoomcamp #dataengineering
10
Comments 1
4 min read
Docker and Kubernetes
abdullahparacha profile

Docker and Kubernetes

#devops #dataengineering #softwareengineer #programming
6
Comments
3 min read
How to Use Apache Airflow to Get 1000+ Files From a Public Dataset
cemkeskin84 profile

How to Use Apache Airflow to Get 1000+ Files From a Public Dataset

#dezoomcamp #dataengineering #airflow #publicdatasets
8
Comments
10 min read
ELT Data Pipeline with Kubernetes CronJob, Azure Data Lake, Azure Databricks (Part 1)
rubnsbarbosa profile

ELT Data Pipeline with Kubernetes CronJob, Azure Data Lake, Azure Databricks (Part 1)

#etl #dataengineering #python #azure
10
Comments
5 min read
What is Azure Synapse Analytics?
integerman profile

What is Azure Synapse Analytics?

#data #dataengineering #azure #cloud
4
Comments
7 min read
Design concept of a best opensource project about big data and data lakehouse
dmetasoul profile

Design concept of a best opensource project about big data and data lakehouse

#opensource #dataengineering #bigdata #datascience
9
Comments
9 min read
When To Build vs. Buy Data Pipelines
teamrudderstack profile

When To Build vs. Buy Data Pipelines

#cdp #datascience #datapipeline #dataengineering
3
Comments
6 min read
Details of 4 best opensource projects about big data you should try out（Ⅰ）
dmetasoul profile

Details of 4 best opensource projects about big data you should try out（Ⅰ）

#opensource #dataengineering #bigdata #spark
8
Comments
5 min read
Debezium Change Data Capture without Kafka Connect
tchiotludo profile

Debezium Change Data Capture without Kafka Connect

#database #dataengineering #opensource #etl
10
Comments 1
8 min read
Building GCS Buckets and BigQuery Tables with Terraform
cemkeskin84 profile

Building GCS Buckets and BigQuery Tables with Terraform

#dezoomcamp #dataengineering #bigquery #gcp
4
Comments
4 min read
Released yuniql v1.2.25. Multi-tenant support, Oracle and largest set of bug fixes
rdagumampan profile

Released yuniql v1.2.25. Multi-tenant support, Oracle and largest set of bug fixes

#yuniql #database #devops #dataengineering
5
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.