DEV Community

Apache SeaTunnel
Apache SeaTunnel

Posted on

Fully Tested! A Complete Guide to Installing SeaTunnel on Kylin

#apacheseatunnel #kylin #datascience #opensource

Want to know how to quickly install Apache SeaTunnel on a Kylin Linux server? This article walks you through environment preparation, accelerated plugin download, and startup testing—so you can easily build a stable data‑synchronization platform. Fully tested and proven!

First, because SeaTunnel is developed in Java, you need to prepare a Java environment.

Required Packages and Version Specifications

I’m using Kylin Linux localhost 4.19.90‑89.11.v2401.ky10.x86_64

  • JDK ≥ 1.8.151
  • Maven ≥ 3.6.3
  • Apache SeaTunnel == 2.3.11
  • Apache SeaTunnel Web == 1.0.2
  • MySQL ≥ 5.7.28

Downloads:

I extracted everything to the /data directory
Official download links:
Apache SeaTunnel: https://seatunnel.apache.org/download/

seatunnel-2.3.11 and apache-seatunnel-web-1.0.2-bin.tar.gz

wget -c https://dlcdn.apache.org/seatunnel/seatunnel-web/1.0.2/apache-seatunnel-web-1.0.2-bin.tar.gz
wget -c https://dlcdn.apache.org/seatunnel/2.3.11/apache-seatunnel-2.3.11-bin.tar.gz
Enter fullscreen mode Exit fullscreen mode 
tar -zxvf apache-dolphinscheduler-3.3.0-alpha-src.tar.gz -C /data/
tar -zxvf apache-seatunnel-2.3.11-bin.tar.gz -C /data/
tar -zxvf apache-seatunnel-web-1.0.2-bin.tar.gz -C /data/
cd /data/
mv apache-dolphinscheduler-3.3.0-alpha-src dolphinscheduler
mv apache-seatunnel-2.3.11 seatunnel
mv apache-seatunnel-web-1.0.2-bin seatunnel-web
echo 'export SEATUNNEL_HOME=/data/seatunnel' >> /etc/profile
echo 'export PATH=$SEATUNNEL_HOME/bin:$PATH' >> /etc/profile
source /etc/profile
Enter fullscreen mode Exit fullscreen mode

Download Connector JAR Packages

After unzipping SeaTunnel, the official distribution contains only two connector JARs. To connect to MySQL, Oracle, SQL Server, Hive, Kafka, ClickHouse, Doris, etc., you must download the corresponding JARs.

When SeaTunnel downloads connector JARs, running install-plugin.sh in the bin directory uses mvnw to download from https://repo.maven.apache.org—extremely slow.

  • Option 1: Switch to your locally installed mvn.

Go to /data/seatunnel/bin, back up install-plugin.sh:

mv install-plugin.sh back_install-plugin.sh
Enter fullscreen mode Exit fullscreen mode

screenshot

Replace every occurrence of ${SEATUNNEL_HOME}/mvnw with mvn so you can use the system Maven together with Alibaba Cloud’s Maven mirror for faster downloads.
screenshot

  • Option 2: If you need only a few packages, download them directly. 
https://repo.maven.apache.org/maven2/org/apache/seatunnel/
Enter fullscreen mode Exit fullscreen mode

Find the packages you need and place them directly into

/data/seatunnel/connectors

screenshot

Test Verification 

# Start the service
cd /data/seatunnel/
./bin/seatunnel.sh --config ./config/v2.batch.config.template -e local
Enter fullscreen mode Exit fullscreen mode

screenshot

# Enter the installation directory
cd /data/seatunnel/
# Start the service
nohup sh bin/seatunnel-cluster.sh 2>&1 &
Enter fullscreen mode Exit fullscreen mode

If tail -f logs/seatunnel-engine-server.log prints messages like those above, the startup succeeded.

Note: Apache SeaTunnel Server must be running properly for the Web service to function normally.

Top comments (0)