DEV Community

Cover image for Deep insight into Shopee's data integration module refactor by Apache SeaTunnel
Apache SeaTunnel
Apache SeaTunnel

Posted on

Deep insight into Shopee's data integration module refactor by Apache SeaTunnel

SeaTunnel is collaborating with the leading e-commerce Shopee to have a deep tech talk with the technical experts from Shopee Singapore to share the optimization practice of SeaTunnel in Shopee.

The performance optimization of data integration facilitates enterprises to maximize the data value. It eliminates the problems such as the inconsistent caliber of various systems, complex data interaction, and lack of a unified data integration platform.

SeaTunnel is a rising star in the data integration space, It's a data integration platform that runs on Spark and Flink, supports a variety of data sources, and equips with a rich plug-in system.

Join us on 24 September 2022,14:00 PM GMT+8 to get a knowledgeable Tech Talk with Shopee engineers, SeaTunnel core developers, and contributors, as they will comprehensively discuss the data integration implementation techniques, and hands-on experiences using SeaTunnel in the e-commerce industry.

Image description

  • Schedule: Sat, 24 September 2022 | 14:00 PM GMT+8
  • Format of the event: live online
  • Sign up now (free): zoom link

Click the link to enter the SeaTunnel Meetup

https://bit.ly/3KAqGmJ

Scan to get the Slack channel link

Image description

Learn and gain new knowledge about SeaTunnel by registering yourself through: https://seatunnel.apache.org/

Agenda

14:00 ~ 14:05

Opening

14:05 ~ 14:45

Image description
Speaker: Yang Wang, Shopee Data Engineer
Topic: Practice of Apache SeaTunnel in Shopee

Summary:
Introduce the process and ideas of introducing SeaTunnel into Shopee, and show how to use SeaTunnel right out of the box, how to use SeaTunnel to refactor existing modules, and SeaTunnel servitization in the platform by instances.

14:50 ~ 15:30

Image description
Speaker: William GUO, Apache Foundation Member
Apache Projects in Modern Data Stack

Summary:
Help the audience to quickly understand the latest features of the new generation of Modern Data Stack: "de-specialization", "de-centralization", "extremely fast experience", "use as needed", sharing and explaining what is MDS( Modern Data Stack) and how to use the Apache open source project to implement MDS.

15:30 ~ 16:10

Image description
Speaker: Jiayi Jin, Shopee Data Expert
Integration Practice of SeaTunnel x Druid in Shopee

Summary:
Introducing how Shopee uses SeaTunnel to help Druid business build Pipelines more quickly, shorten business delivery cycles, and improve iteration efficiency

16:10 ~ 16:50

Image description
Speaker: Jia Fan, Apache SeaTunnel PPMC
Make data integration easy by SeaTunnel

Summary:
Introduce what SeaTunnel is and how to use it, as well as its advantages over traditional data synchronization. A quick guide by referring to use cases to help you know and experience SeaTunnel, and help new users quickly implement SeaTunnel in the production environment.

Apache SeaTunnel(Incubating) is a distributed, high-performance, easily scalable, data integration platform for massive data (offline & real-time) synchronization and transformation. On December 9, 2021, SeaTunnel was officially voted as an Apache incubator project with unanimous votes by the world's top open source organization, Apache Software Foundation!

The Meetup is monthly held by the SeaTunnel community, which is mainly for the developers in the data synchronization space. Through the practice sharing of front-line engineers, it aims to help the community developers to improve their professional skills and knowledge and creates greater value for the community around the globe.

The series meetups have been held successfully 6 times, attracting more than 7000+ technology-enthusiastic attendees.

Top comments (0)