# bigdata

12 min read

James Wilson

Sep 22 '22

Docker Alternatives That Can Boost Your Productivity

#cloud #docker #devops #bigdata

4 min read

ChunTing Wu

Oct 10 '22

Building Apache Pinot and Presto

#bigdata #eventdriven #tutorial #programming

4 min read

Rita Carolina for Feministech

Oct 6 '22

O que é dark data?

#bigdata #braziliandevs #darkdata

1 min read

Cesar Mostacero

Sep 29 '22

Apache-Spark introduction for SQL developers

#apachespark #dataengineering #beginners #bigdata

7 min read

Areeba Farooq

Sep 27 '22

Learning Big Data - Step by Step

#bigdata #aws #hive #programming

1 min read

Apache SeaTunnel

Sep 20 '22

SeaTunnel Connector Access Plan

#connectordevelopment #bigdata #datascience #programming

12 min read

Arpit Shrivastava

Sep 1 '22

Entrepreneurs must learn from Lord Ganesha!!!

#bigdata #webdev #beginners #startup

6

2 min read

Hunter Johnson for Educative

Sep 7 '22

What is Big Data? Characteristics, types, and technologies

#datascience #database #bigdata #tutorial

11 min read

Karel Vanden Bussche for Lighthouse

Sep 7 '22

Why we don’t use Spark

#python #spark #googlecloud #bigdata

7 min read

Renee Betina Esperas

Aug 31 '22

Top Skills You Need in Testing Big Data projects

#testing #bigdata

3 min read

ChunTing Wu

Aug 29 '22

Design Pattern of Streaming Enrichment

#eventdriven #bigdata #architecture #programming

6 min read

Muhammad Rameez

Aug 28 '22

Data Lake vs Data Warehouse

#datascience #lake #difference #bigdata

3 min read

Artem Plotnikov

Aug 26 '22

Spark tip: Disable Coalescing Post Shuffle Partitions for compute intensive tasks

#spark #performance #bigdata #machinelearning

3

3 min read

ChunTing Wu

Aug 22 '22

Stream Processing Introduction

#eventdriven #bigdata #tutorial #architecture

6 min read

Neylson Crepalde for AWS Community Builders

Aug 18 '22

How to run Amazon EMR Serverless with --packages flag

#aws #bigdata #spark #emrserverless

6 min read

Augusto Valdivia for AWS Community Builders

Aug 14 '22

The Relational DBs (RDB)

#database #aws #terraform #bigdata

12

4 min read

Apache SeaTunnel

Aug 10 '22

The story behind Apache SeaTunnel’s evolving from a data integration component to an enterprise-level service

#bigdata #service

12 min read

Muhammad Rameez

Aug 5 '22

Big Data Vs Small Data

#bigdata #smalldata #hadoop #datamining

2 min read

Ruikai Li

Jul 29 '22

Learning Workflow Schedulers (Oozie)

#bigdata #datascience #dataengineering

5 min read

Augusto Valdivia for AWS Community Builders

Jul 18 '22

There will be 175 Zettabytes of data in the world by 2025. Where will we store it?

#awsdatabases #terraform #bigdata #aws

18

1 min read

Abdulrahman S.

Jul 15 '22

How discord manage 300M socket connection

#discord #algorithms #programming #bigdata

13

2 min read

Memphis.dev team for Memphis.dev

Jul 7 '22

Here is why you need a message broker

#beginners #architecture #opensource #bigdata

57

7 min read

DataPotion

Jul 8 '22

How to filter columns in HBase Shell

#database #nosql #bigdata

3 min read

Apache SeaTunnel

Jul 8 '22

Visual task orchestration & Drag & Drop, Scaleph Data integration practice based on SeaTunnel

#datascience #bigdata

12 min read

DMetaSoul

Jul 8 '22

The best Open-source lakehouse project, LakeSoul 2.0, supports snapshot, rollback, Flink, and Hive interconnection

#opensource #bigdata #database #datascience

5 min read

Paul Preibisch

Jun 2 '22

Creating a Subtitle Search Engine using the Stanford Parts of Speech Tagger

#bigdata #elasticsearch #programming

3

4 min read

Gabriel Luz

Jun 30 '22

Data Mesh: Scaling Delivery of Data as Product

#datamesh #bigdata #datascience

9 min read

Bittsanalytics

Jun 29 '22

Introduction to Reinforcement Learning

#machinelearning #datascience #ai #bigdata

7 min read

DMetaSoul

Jun 26 '22

Data engineers must-see: The future trend of big data cloud services

#database #dataengineering #bigdata #opensource

8 min read

Apache SeaTunnel

Jun 21 '22

New release! Support for Kubernetes, multiple connectors added, SeaTunnel 2.1.2 is here!

#bigdata #opensource #apache

4 min read

BPB Online

Jun 19 '22

Best Practices for Successful Data Quality

#datascience #beginners #bigdata

3 min read

DataPotion

Jun 19 '22

What's new in Apache Spark 3.3.0

#news #bigdata #scala #python

4 min read

DMetaSoul

Jun 15 '22

A New One-stop AI development and production platform, AlphaIDE

#ai #machinelearning #bigdata #opensource

4 min read

DMetaSoul

Jun 15 '22

Usage Guide：Quickly deploy an intelligent data platform with the One-stop AI development and production platform, AlphaIDE

#machinelearning #ai #bigdata #productivity

3 min read

Albert Ulysses

Jun 13 '22

Data Pipelines with Apache Airflow - Book Review

#python #dataengineering #books #bigdata

2 min read

Henny Jones

Jun 10 '22

Why Big Data Analytics Is In The Big Picture in Banking Market?

#bigdata #banking #programming

4 min read

DMetaSoul

May 29 '22

Solved a practical business problem when using Hudi: LakeSoul supports null field non-override semanticssemantics

#opensource #database #dataengineering #bigdata

3 min read

DMetaSoul

May 14 '22

What is the Lakehouse, the latest Direction of Big Data Architecture?

#opensource #dataengineering #bigdata #database

10 min read

matthieucham for Stack Labs

May 9 '22

BigQuery transactions over multiple queries, with sessions

#googlecloud #python #database #bigdata

3 min read

mustafasajid

May 9 '22

Dynamic way doing ETL through Pyspark

#pyspark #etl #bigdata #python

4 min read

ricklatham

May 9 '22

Auto discovering and auto actions in data monitoring or How to drink coffee instead of routine tasks

#monitoring #machinelearning #bigdata #devops

13

9 min read

Timothy Spann. 🇺🇦

May 9 '22

May 9th in Streaming

#apache #apachepulsar #realtimestreaming #bigdata

6

1 min read

DMetaSoul

May 6 '22

Build a real-time machine learning sample library using the best open-source project about big data and data lakehouse, LakeSoul

#opensource #datascience #bigdata #database

11

7 min read

John Vester

May 3 '22

Leveraging Change Data Capture for Fraud Detection using Arcion Cloud

#tutorial #bigdata #cloud #datascience

9 min read

Semyon Kirekov

Apr 22 '22

Apache Spark, Hive, and Spring Boot — Testing Guide

#bigdata #testing #java #docker

18 min read

DMetaSoul

Apr 16 '22

Design concept of a best opensource project about big data and data lakehouse

#opensource #dataengineering #bigdata #datascience

9 min read

Gabriel Luz

May 2 '22

How to prepare for the GCP Professional Data Engineer certification

#googlecloud #dataengineering #gcp #bigdata

31

8 min read

DMetaSoul

Apr 7 '22

Details of 4 best opensource projects about big data you should try out（Ⅰ）

#opensource #dataengineering #bigdata #spark

5 min read

Anuj Vaghani

Apr 1 '22

HIVE installation on WSL

#hadoop #hive #bigdata

3 min read

Eric See

Mar 26 '22

How to create a DIY Inexpensive Cloud Data Lake

#python #datascience #design #bigdata

3 min read

Zishuo Ding

Mar 25 '22

Create a Hadoop playground with Docker Desktop on Windows in minutes

#docker #java #bigdata #codenewbie

4 min read

DMetaSoul

Mar 25 '22

Quick use of CDC: A new demo from lakesoul makes it easier to set up the environment

#opensource #dataengineering #bigdata #spark

5 min read

Warda Liaqat

Mar 24 '22

Big Data in Cloud Computing - AWS

#aws #bigdata #bigdataincloud #bigdataandaws

14

2 min read

DMetaSoul

Mar 24 '22

4 best opensource projects about big data you should try out

#opensource #dataengineering #bigdata #spark

3

3 min read

DMetaSoul

Mar 17 '22

A new unified streaming and batch table storage solution similar to iceberg/hudi/delta lake but with several new functions

#dataengineering #opensource #bigdata #programming

2 min read

Lis R. Barreto

Mar 9 '22

[OPINIÃO] Construindo uma Carreira como Data Engineer

#bigdata #dataengineering #tips

2 min read

Aarti Yadav

Mar 3 '22

Characteristics of Big Data

#bigdata

8 min read

Sukumaar Mane

Feb 28 '22

Apache Spark Unit Testing Strategies

#scala #programming #apachespark #bigdata