Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
From Detection to Production: A PII-Safe Pipeline in Python and DuckDB
Nariman Baubekov
Nariman Baubekov
Nariman Baubekov
Follow
Sep 7
From Detection to Production: A PII-Safe Pipeline in Python and DuckDB
#
dataengineering
#
duckdb
#
dataprivacy
#
security
Comments
Add Comment
6 min read
Moderation
You Can't Protect What You Can't Find: Detecting and Classifying PII in Data Pipelines
Nariman Baubekov
Nariman Baubekov
Nariman Baubekov
Follow
Sep 7
You Can't Protect What You Can't Find: Detecting and Classifying PII in Data Pipelines
#
dataengineering
#
python
#
dataprivacy
#
gdpr
Comments
Add Comment
8 min read
Moderation
I Built a Data Quality Library Because Existing Tools Were Too Slow for My Pipelines
Vladislav Koval
Vladislav Koval
Vladislav Koval
Follow
Sep 11
I Built a Data Quality Library Because Existing Tools Were Too Slow for My Pipelines
#
dataengineering
#
python
#
dataquality
#
bigquery
Comments
1
comment
3 min read
Moderation
Replace Fivetran + Snowflake: MySQL to S3 Parquet Analytics, Self-Hosted
Luis M
Luis M
Luis M
Follow
Oct 11
Replace Fivetran + Snowflake: MySQL to S3 Parquet Analytics, Self-Hosted
#
dataengineering
#
snowflake
#
mysql
#
selfhosted
2
reactions
Comments
Add Comment
6 min read
Moderation
I filtered the FMCSA census (4.5M rows) down to carriers that look real
Haku
Haku
Haku
Follow
Oct 10
I filtered the FMCSA census (4.5M rows) down to carriers that look real
#
python
#
opensource
#
webdev
#
dataengineering
1
reaction
Comments
11
comments
2 min read
Moderation
Apache Data Lakehouse Weekly: September 3-9, 2026
Alex Merced
Alex Merced
Alex Merced
Follow
Sep 10
Apache Data Lakehouse Weekly: September 3-9, 2026
#
bigdata
#
database
#
dataengineering
#
rust
Comments
1
comment
25 min read
Moderation
Avro schemas for Kafka developers: the 10-minute practical guide
yuus_company
yuus_company
yuus_company
Follow
Sep 6
Avro schemas for Kafka developers: the 10-minute practical guide
#
kafka
#
avro
#
dataengineering
#
tutorial
Comments
Add Comment
2 min read
Moderation
Batch ETL vs Real-Time ETL Tools: Which One Your Team Needs
Alina Kovtun
Alina Kovtun
Alina Kovtun
Follow
Oct 9
Batch ETL vs Real-Time ETL Tools: Which One Your Team Needs
#
architecture
#
data
#
database
#
dataengineering
13
reactions
Comments
1
comment
7 min read
Moderation
SnowPro Core COF-C03 vs COF-C02: What Changed
Sajeev PS
Sajeev PS
Sajeev PS
Follow
Oct 10
SnowPro Core COF-C03 vs COF-C02: What Changed
#
snowflake
#
certification
#
dataengineering
#
sql
Comments
1
comment
2 min read
Moderation
My RAG pipeline died three nights in a row. So I rebuilt it to assume it would die.
Evelyn Caro
Evelyn Caro
Evelyn Caro
Follow
Oct 9
My RAG pipeline died three nights in a row. So I rebuilt it to assume it would die.
#
ai
#
python
#
tutorial
#
dataengineering
Comments
Add Comment
2 min read
Moderation
The hardest label in our dataset is the one where nothing happened
Aravind R
Aravind R
Aravind R
Follow
Sep 5
The hardest label in our dataset is the one where nothing happened
#
datascience
#
dataengineering
#
analytics
#
sql
Comments
Add Comment
14 min read
Moderation
Estrategias de Migración de Bases de Datos Relacionales: De AWS RDS a GCP Cloud SQL
Lenin Jose Meza Zarco
Lenin Jose Meza Zarco
Lenin Jose Meza Zarco
Follow
Oct 9
Estrategias de Migración de Bases de Datos Relacionales: De AWS RDS a GCP Cloud SQL
#
architecture
#
aws
#
cloudnative
#
dataengineering
1
reaction
Comments
Add Comment
6 min read
Moderation
Escalabilidad Geográfica: Implementación de Sistemas SQL Distribuidos con YugabyteDB
Lenin Jose Meza Zarco
Lenin Jose Meza Zarco
Lenin Jose Meza Zarco
Follow
Oct 9
Escalabilidad Geográfica: Implementación de Sistemas SQL Distribuidos con YugabyteDB
#
cloudnative
#
dataengineering
#
distributedsystems
#
postgres
Comments
Add Comment
5 min read
Moderation
Gestión de APIs Empresariales: Integrando Apigee, MuleSoft y Salesforce Data Cloud
Lenin Jose Meza Zarco
Lenin Jose Meza Zarco
Lenin Jose Meza Zarco
Follow
Oct 9
Gestión de APIs Empresariales: Integrando Apigee, MuleSoft y Salesforce Data Cloud
#
apifirst
#
cloudnative
#
dataengineering
#
gcp
Comments
Add Comment
5 min read
Moderation
FinOps y Gestión del Ciclo de Vida: Desmantelamiento Seguro de Infraestructura Serverless en GCP
Lenin Jose Meza Zarco
Lenin Jose Meza Zarco
Lenin Jose Meza Zarco
Follow
Oct 9
FinOps y Gestión del Ciclo de Vida: Desmantelamiento Seguro de Infraestructura Serverless en GCP
#
cloudnative
#
dataengineering
#
finops
#
gcp
Comments
Add Comment
5 min read
Moderation
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account