# dataengineering

3 min read

Madhav

Jan 6

The Columnar Approach: A Deep Dive into Efficient Data Storage for Analytics 🚀

#database #bigdata #dataengineering #analytics

4 min read

Matan Shidlov

Jan 5

Optimizing Data Pipelines for Fiix Dating App

#dataengineering #performance #datapipelines

3 min read

georgoulis

Jan 4

What kind of Data Team should I join?

#dataengineering #datascience #data

1 min read

Paulet Wairagu

Jan 4

Tech Interviews: The Hustle Behind Tech Interview Prep

#womenintech #datascience #dataengineering #softwaredevelopment

1 min read

Gervais Yao Amoah

Jan 3

Why Feature Scaling Should Be Done After Splitting Your Dataset into Training and Test Sets

#machinelearning #datascience #dataengineering #softwareengineering

3 min read

Pavel P.

Dec 28 '24

Exploring OSM changesets via DuckDB

#osm #dataengineering #duckdb #database

9 min read

Burak Karakan

Dec 23 '24

I built a data pipeline tool in Go

#data #datascience #dataengineering #golang

5 min read

Shreyash Singh

Dec 20 '24

Data Warehousing Architectures

#datascience #dataengineering #architecture #database

5 min read

Emmanuel Awa

Dec 18 '24

Cultivating a Data-Centric Culture at Work

#data #workplace #workculture #dataengineering

2 min read

adriens

Jan 7

🤯 #NODES24: a practical path to Cloud-Native Knowledge Graph Automation & AI Agents

#showdev #ai #management #dataengineering

2

2 min read

Quinton for Airbyte

Dec 19 '24

Can AI finally generate best practice code? I think so.

#ai #dataengineering #python

6 min read

Sridhar CR

Dec 13 '24

How to Migrate Massive Data in Record Time—Without a Single Minute of Downtime 🕑

#etl #spark #database #dataengineering

4 min read

ramya N

Dec 31 '24

Why Data Quality Dimensions Are the Secret Ingredient for Data-Driven Success

#data #dataquality #database #dataengineering

3 min read

ksanaka

Dec 20 '24

Easily Integrate Databend Test Environment with Testcontainers

#dataengineering #rust #testcontainers #opensource

4

4 min read

Eric Goldman for Sequin

Dec 6 '24

Choosing the right, real-time, Postgres CDC platform

#postgres #database #eventdriven #dataengineering

8 min read

Arum Puri

Nov 30 '24

Seaborn Cheat Sheet

#seaborn #datascience #cheatsheet #dataengineering

2 min read

HASNAA ESSOUNAINI

Nov 28 '24

Should I add Data Science or Analytics to my skills?

#webdev #datascience #dataengineering #analytics

1 min read

Mikalai

Nov 28 '24

Innowise is open for internships for Data Engineers and Data Analytics

#beginners #career #dataengineering

1 min read

Tim Huang

Dec 18 '24

Query 1B Rows in PostgreSQL >25x Faster with Squirrels!

#postgres #dataengineering #analytics #bigdata

8

5 min read

Alex Merced

Nov 25 '24

10 Future Apache Iceberg Developments to Look forward to in 2025

#database #datascience #dataengineering #dataanalytics

13 min read

Quinton for Airbyte

Dec 26 '24

Creating Stripe Test Data in Python

#stripe #python #dataengineering #airbyte

4 min read

Pablo

Dec 15 '24

📊 AI Dashboard Builder: Create Insightful Dashboards just Droppping your Data

#dataengineering #datascience #llm #python

2 min read

kination

Nov 22 '24

Setting up memory for Flink - Configuration

#dataengineering #flink #memory #tuning

3 min read

SkillBoostTrainer

Dec 25 '24

Are AWS Certifications Worth It in 2025?

#aws #awscertification #dataengineering #cloudservices

7

2 min read

Vaibhav Shirpurkar

Nov 17 '24

Mastering Dynamic Allocation in Apache Spark: A Practical Guide with Real-World Insights

#pyspark #spark #dataengineering #data

3 min read

Hana Sato

Nov 13 '24

Talend vs. Apache Kafka: Which Data Tool Drives Better Business Insights?

#datascience #devops #dataengineering #datastructures

6 min read

Omar Urbano | LightningChart

Nov 12 '24

LightningChart Python 1.0

#python #datascience #dataengineering #datavisualization

1 min read

Hiswill Thompson

Dec 14 '24

Introduction to Data lakes: The future of big data storage

#bigdata #dataengineering

2 min read

Yann Barrault for Onepoint

Dec 14 '24

Explorer l'API de 360Learning : de l'agilité de Power Query à la robustesse de la Modern Data Stack

#adventoftech2024 #dataengineering #airbyte #dbt

7

12 min read

Muhammad Mahdi Ramadhan

Nov 9 '24

Data Pipeline Filters 101: Choosing Between Static and Dynamic Approaches

#dataengineering #etl #dataanalyst #database

1 min read

Danica Fine

Dec 11 '24

The Apache Iceberg™ Small File Problem

#bigdata #apacheiceberg #datalakehouse #dataengineering

3 min read

BuzzGK

Nov 7 '24

Ensuring Data Quality: Best Practices and Automation

#data #dataengineering

6 min read

Vikas76

Nov 10 '24

Data Science Simplified: Tips for Aspiring Data Scientists in 2025

#datascience #dataengineering #data #roadmap

4 min read

Alex Merced

Dec 9 '24

2025 Guide to Architecting an Iceberg Lakehouse

#apacheiceberg #database #dataengineering #datascience

9

14 min read

Alex Merced

Nov 5 '24

Dremio, Apache Iceberg and their role in AI-Ready Data

#database #dataengineering #datascience #dataanalytics

7 min read

SNEHASISH DUTTA

Dec 9 '24

Data Engineer as a Real-Time Algo Trader – Turning Pipelines into Profit (or at Least Trying)!

#sql #python #dataengineering #eventdriven

13 min read

Alex Merced

Nov 4 '24

Leveraging Python's Pattern Matching and Comprehensions for Data Analytics

#python #datascience #dataengineering #database

12 min read

Lulu Cheng for jarrid.xyz

Dec 8 '24

One Off to One Data Platform: Design with Intent [Part 2]

#data #architecture #dataengineering #startup

5 min read

M. Abdullah Bin Aftab

Dec 6 '24

Case Study: Creating an ETL Data Pipeline using AWS Services - Real-World Problem

#aws #dataengineering #data #cloudcomputing

2 min read

Puneet Verma

Nov 16 '24

Understanding Star Schema vs. Snowflake Schema

#dataengineering #datascience #datamodeling #bigdata

1 min read

Anthony Clemons

Dec 5 '24

ChatGPT Launches Pro: What's it Mean for Data Professionals?

#openai #chatgpt #datascience #dataengineering

4 min read

Hiswill Thompson

Dec 5 '24

Introduction to Apache Kafka

#datapipeline #dataengineering #realtimedat

3

3 min read

Aditya Pratap Bhuyan

Oct 31 '24

Mastering Workflow Automation with Apache Airflow for Data Engineering

#dataengineering #apacheairflow

6 min read

kaito

Dec 3 '24

Mastering Twitter Data Collection: A Comprehensive Guide to Efficient Scraping Solutions

#twitter #datascience #dataengineering #development

3 min read

pawan deore

Dec 1 '24

Optimizing Large-Scale Data Processing in Python: A Guide to Parallelizing CSV Operations

#webdev #python #csv #dataengineering

3 min read

Hassan Aftab

Nov 29 '24

Jupyter Notebooks in Docker

#datascience #docker #dataengineering #programming

4

3 min read

SANKET PATIL

Nov 29 '24

🚀 Beyond Data Ingestion: Advanced Strategies for Optimizing API Data Pipelines

#dataengineering #azuredatafactory #apipagination #devops

4

3 min read

Danwycliff Ndwiga

Oct 30 '24

SQL "SELECT INTO" vs "INSERT INTO SELECT" statements.

#sql #database #data #dataengineering

1 min read

Meqdad Darwish

Nov 27 '24

ACID Properties in Databases: What Happens Without Them?

#database #data #dataengineering #sql

6 min read

adriens

Nov 25 '24

🕵️ OSINT: link company acronyms to Standard Occupation Classification w. Open Source LLMs

#ai #datascience #database #dataengineering

8

6 min read

DQOps

Nov 23 '24

Data Architecture Best Practices

#data #dataengineering #dataquality #datascience

6 min read

Lusanda Ndlovu

Oct 20 '24

My Journey into Data AI and Machine Learning

#softwaredevelopment #ai #machinelearning #dataengineering

1 min read

Pratik Barjatiya

Nov 22 '24

🚀 Unlock the Power of ORC File Format 📊

#dataengineering #bigdata #datascience #data

1 min read

Pedro H Goncalves

Nov 19 '24

Designing robust and scalable relational databases: A series of best practices.

#database #advanced #optimization #dataengineering

10

17 min read

Vikas76

Nov 20 '24

From Data to Decisions: How Machine Learning Works in 2025

#machinelearning #datascience #data #dataengineering

3

3 min read

Lulu Cheng for jarrid.xyz

Oct 15 '24

Why Data Security is Broken and How to Fix it?

#security #automation #devops #dataengineering