Dataengineering

Apache Doris

Jul 8

Apache Doris for log and time series data analysis in NetEase, why not Elasticsearch and InfluxDB?

#datascience #database #dataengineering #opensource

1

9 min read

Shivansh Yadav

Jul 7

MapReduce Vs Tez

#hadoop #dataengineering #database #datascience

6

2 min read

Ayush Kumar

Jul 4

Azure Synapse Analytics Security: Data Protection

#azure #sqlserver #dataengineering

2

6 min read

Felipe de Godoy

Jul 4

Leveraging PySpark.Pandas for Efficient Data Pipelines

#dataengineering #spark #pandas #python

3 min read

Apache Doris

Jul 1

Why Apache Doris is the Best Open Source Alternative to Rockset

#database #bigdata #dataengineering #openai

3

3 min read

SNEHASISH DUTTA

Jun 30

Apache Spark-Structured Streaming :: Cab Aggregator Use-case

#apachespark #dataengineering #streaming #realtimedata

1

4 min read

Shivansh Yadav

Jun 30

Introduction to Apache Hadoop & MapReduce

#hadoop #dataengineering #bigdata #datascience

5

3 min read

Salma

Jun 19

MySQL: Using and Enhancing `DATETIME` and `TIMESTAMP`

#mysql #database #data #dataengineering

1

3 min read

kination

Jun 29

Analytics don't want duplicated data, so get it exactly-once with Flink/Kafka

#flink #kafka #dataengineering

3 min read

Rahul Dubey

May 25

Metadata for win — Apache Parquet

#python #bigdata #datascience #dataengineering

5 min read

Ayush Kumar

Jun 24

Remove unwanted partition data in Azure Synapse (SQL DW)

#dataengineering #sqlserver #azure

1

6 min read

Aman Gupta

Jun 24

Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu

#saasetl #dataengineering #python

2

3 min read

Aman Gupta

Jun 24

Simplifying SDMX Data Integration with Python

#dataengineering #pipeline #etl #sdmx

2

3 min read

Alex Merced

Jun 21

Clustering vs Partitioning your Apache Iceberg Tables

#database #datascience #dataengineering #data

4

10 min read

Mubarak Mohamed

Jun 20

The Data Professions

#data #datascience #dataengineering #datastructures

1

3 min read

Zak for Ably

Jun 20

Database generated events: LiveSync’s database connector vs CDC

#database #dataengineering #architecture

4

5 min read

Carl Vander

Jun 17

Analyzing Svenskalag Data using DBT and DuckDB

#dataengineering #dbt #duckdb #football

1

4 min read

Fady GA 😎

Jun 17

How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop

#dataengineering #apachespark #data #opensource

9

6 min read

tinApyp

Jun 17

Working with Dates and Times in SQL: Tips and Tricks

#datascience #database #dataengineering #tutorial

1

3 min read

Felipe de Godoy

Jun 14

FastAPI for Data Applications: From Concept to Creation. Part I

#fastapi #dataengineering #datascience #llmops

2

5 min read

Alex Pliutau

Jun 14

Bridging Backend and Data Engineering: Communicating Through Events

#distributedsystems #pubsub #backend #dataengineering

1 min read

Alex Salgado

May 10

Usando Consultas de Percolação do Elasticsearch, Netflix Aperfeiçoa Buscas Reversas Eficientemente

#elasticsearch #reversesearch #dataengineering #netflix

1

3 min read

kination

Jun 8

How to setup resources for k8s pod

#kubernetes #dataengineering #resources

2

3 min read

Apache Doris

Jun 7

Multi-tenant workload isolation in Apache Doris: a better balance between isolation and utilization

#database #opensource #cpu #dataengineering

1

9 min read

Ed

Jun 6

Data Mesh: An Executive Guide to Modern Data Architecture in Manufacturing

#datamesh #data #datascience #dataengineering

1

13 min read

Onumaku Chibuike Victory

May 6

Difference between Data Analysts, Data Scientists, and Data Engineers

#datascience #database #dataengineering

1

1 min read

Ahmed Tarek

Apr 29

What is Data Ethics?

#data #ethics #datascience #dataengineering

8 min read

David Ostler

May 31

Converting .shp files to CSV with GeoPandas

#datascience #python #tutorial #dataengineering

11

2 min read

Alex Merced

May 29

Apache Iceberg and Data Lakehouse Partitioning

#database #datascience #dataengineering #dataanalytics

7

1

7 min read

Aristek Systems

May 28

Data warehouse vs data lake

#data #datascience #datalake #dataengineering

1

8 min read

Apache Doris

May 28

SQL Convertor for Easy Migration from Presto, Trino, ClickHouse, and Hive to Apache Doris

#datascience #dataengineering #dataplatform #datamigration

4 min read

Romina Mendez

May 26

Python Projects with SQL: Strategies for Effective Query Management

#python #sql #database #dataengineering

13

2

9 min read

Paulet Wairagu

Apr 22

CAP Theorem

#database #distributedsystems #dataengineering

1

2 min read

Paulet Wairagu

Apr 22

NoSQL DATABASES

#database #dataengineering

1

1 min read

Rubens Barbosa

May 25

Apache Spark 101

#apache #spark #scala #dataengineering

2

7 min read

ChelseaLiu0822

Apr 18

PySpark： missing value

#pyspark #python #dataengineering #bigdata

2 min read

Apache Doris

May 21

Cross-cluster replication for read-write separation

#database #bigdata #dataengineering #tutorial

2

4 min read

Nitin-bhatt46

Apr 17

"Day 61 of My Learning Journey: Setting Sail into Data Excellence! Today's Focus: Mathematics for Data Analysis (Graph - 1)

#data #datascience #dataengineering #analyst

1

1 min read

ChunTing Wu

May 20

Trino & Iceberg Made Easy: A Ready-to-Use Playground

#bigdata #datascience #tutorial #dataengineering

14

3 min read

EMMAMAG

Apr 14

HOW TO ADD A DATA DISK TO A VIRTUAL MACHINE

#vm #dataengineering #disk #azure

3 min read

Alex Merced

May 15

3 Reasons Data Engineers Should Embrace Apache Iceberg

#datascience #dataengineering #apacheiceberg

4

4 min read

Apache Doris

May 13

Arrow Flight SQL in Apache Doris for 10X faster data transfer

#database #dataengineering #python #apachearrow

6

10 min read

Greptime

May 12

Overcoming Prometheus's Single-Value Data Model Limitations - A New Approach by GreptimeDB

#prometheus #monitoring #database #dataengineering

1

5 min read

Nitin-bhatt46

Apr 8

"Day 58 of My Learning Journey: Setting Sail into Data Excellence! Today's Focus: Maths for Data Analysis (Probability - 4)

#data #analyst #dataengineering #datascience

1

1 min read

Maíra Ottoni

Apr 11

DAG no Airflow para invocar Google Cloud Function

#airflow #gcp #tutorial #dataengineering

3 min read

Nitin-bhatt46

Apr 11

"Day 60 of My Learning Journey: Setting Sail into Data Excellence! Today's Focus: Maths for Data Analysis (Probability - 6)

#data #dataengineering #datascience

1

1 min read

Raju Nekadi

May 10

How to write memory efficient machine learning model prediction data pipelines in Python,With an Example

#python #machinelearning #dataengineering #googlecloud

1

5 min read

DeadPunnk

May 9

Carregando dados com Apache HOP & Postgres

#apachehop #dataengineering #postgres #tutorial

3

3 min read

GURUDEV H Y

Apr 5

Demystifying:Azure Data Factory

#azure #datafactory #etl #dataengineering

1 min read

Janeth Graziani

May 7

Exploring Data Warehousing and ELT Tools

#data #dataengineering #elt #airbyte

1

2 min read

Richard Li

Apr 3

Data-driven customer acquisition: Machine Learning applied to Customer Lifetime Value

#datascience #dataengineering #machinelearning #saasmetrics

7 min read

Nitin-bhatt46

Apr 3

"Day 56 of My Learning Journey: Setting Sail into Data Excellence! Today's Focus: Maths for Data Analysis (Probability - 2)

#dataengineering #datascience #data #analytics

1

1 min read

Cris Crawford

Apr 3

Final project part 5

#dataengineering #dbt #lookerstudio

3 min read

Raju Nekadi

May 6

Few new things in Python which I learned last week.

#python #machinelearning #dataengineering

2

1

2 min read

Nitin-bhatt46

Apr 2

"Day 55 of My Learning Journey: Setting Sail into Data Excellence! Today's Focus: Maths for Data Analysis (Probability - 1)

#dataengineering #datascience #analyst #maths

1

2 min read

Nitin-bhatt46

Apr 2

"Day 54 of My Learning Journey: Setting Sail into Data Excellence! Today's Focus: Maths for Data Analysis ( Perm & Comb - 9)

#dataengineering #datascience #analyst #data

1

2 min read

Nitin-bhatt46

Mar 31

"Completed Weeks 3 and 4 of the AI Engineering Journey!. Ready to tackle the next leg of the journey! 🚀"

#codebasics #ai #mlops #dataengineering

1

1 min read

Raj Das

May 3

Data Ingestion in Snowflake with Google Cloud Storage - Part I

#snowflake #gcp #dataengineering #data

4

5 min read

Raju Nekadi

May 3

Scheduling a BigQuery SQL script, using Apache Airflow, with an example

#airflow #bigquery #dataengineering #sql

8

1

2 min read

Raj Das

May 3

Data Ingestion in Snowflake with Google Cloud Storage - Part II

#snowflake #gcp #dataengineering #data

2

5 min read