DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building ETL/ELT Pipelines For Data Engineers.
wanjohichristopher profile

Building ETL/ELT Pipelines For Data Engineers.

#snowflake #dbt #airflow #dataengineering
5
Comments 2
2 min read
Automating Talend Jobs Using Apache Airflow .
wanjohichristopher profile

Automating Talend Jobs Using Apache Airflow .

#airflow #dataengineering #automation #data
7
Comments
3 min read
Data-aware Scheduling in Airflow: A Practical Guide with DAG Factory
cicerojmm profile

Data-aware Scheduling in Airflow: A Practical Guide with DAG Factory

#airflow #dagfactory #aws #dataengineering
9
Comments
6 min read
Automating Data Pipeline Deployment on AWS with Terraform: Utilizing Lambda, Glue, Crawler, Redshift, and S3
stefentaime profile

Automating Data Pipeline Deployment on AWS with Terraform: Utilizing Lambda, Glue, Crawler, Redshift, and S3

#softwareengineering #dataengineering #aws #terraform
1
Comments 1
8 min read
There is no Data Engineering roadmap
sdairs_86 profile

There is no Data Engineering roadmap

#dataengineering #beginners #career #database
2
Comments
5 min read
Feature Engineering Has a Language Problem
stereosky profile

Feature Engineering Has a Language Problem

#machinelearning #datascience #dataengineering #mlops
1
Comments
15 min read
What is data engineering and a B.I architecture
pedrohgoncalves profile

What is data engineering and a B.I architecture

#dataengineering #datascience #beginners #architecture
5
Comments
6 min read
How To Create Dataflow Job with Scio
edwardgunawan profile

How To Create Dataflow Job with Scio

#dataengineering #programming #code #scala
2
Comments
8 min read
Using pyspark to stream data from coingecko API and visualise using dash
24mwangi profile

Using pyspark to stream data from coingecko API and visualise using dash

#spark #python #dataengineering #codenewbie
3
Comments
6 min read
AWS Redshift: Robust and Scalable Data Warehousing
mage_ai profile

AWS Redshift: Robust and Scalable Data Warehousing

#aws #redshift #datawarehousing #dataengineering
3
Comments
6 min read
A mage on the Hero’s Journey: a fantasy epic on how a startup rose from the ashes
mage_ai profile

A mage on the Hero’s Journey: a fantasy epic on how a startup rose from the ashes

#startup #dataengineering #datapipelines #etl
6
Comments
9 min read
Stream data processing with Mage
mage_ai profile

Stream data processing with Mage

#streaming #data #dataengineering #kafka
6
Comments
8 min read
How to pivot data using Dynamic SQL in SQL Server
notte profile

How to pivot data using Dynamic SQL in SQL Server

#sql #database #dataengineering #mssql
5
Comments 4
3 min read
How to clone tables in BigQuery
mesmacosta profile

How to clone tables in BigQuery

#bigquery #bigdata #dataengineering
2
Comments
1 min read
kafka: event driven microservices
24mwangi profile

kafka: event driven microservices

#python #kafka #dataengineering
4
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.