SeaTunnel

Apache SeaTunnel is a distributed, connector-first data integration platform that enables data movement and transformation across multiple data sources.

A SeaTunnel job uses a Human-Optimized Config Object Notation (HOCON) configuration file with three blocks: source, transform, and sink.

SeaTunnel supports the following execution engines:

• Zeta: SeaTunnel's native Java Virtual Machine (JVM) engine, built on Hazelcast. It does not require YARN or an external cluster manager.
• Flink: Runs jobs on YARN using Flink 1.19 in ODP 3.3.6.6 or Flink 2.2 in ODP 3.4.3.0.
• Spark: Runs jobs on YARN using Spark 3.5 or Spark 4.1.

The same job configuration works across all three engines. To select an execution engine, use the corresponding command-line interface (CLI) script: bin/seatunnel.sh, start-seatunnel-flink-*.sh, or start-seatunnel-spark-*.sh.

Apache SeaTunnel provides more than 50 upstream connectors. The ODP Management Pack (MPack) includes 11 connectors selected for the ODP stack: Kafka, HDFS (file-hadoop), S3 (file-s3), Hive, JDBC, Kudu, HBase, Iceberg, Hudi, ClickHouse, and MongoDB CDC.

The upstream binary distribution also includes three demonstration connectors: Fake, Console, and CDC-base.

Explore SeaTunnel

The following topics provide information about installing, configuring, managing, monitoring, and troubleshooting SeaTunnel in ODP.

• Overview and Architecture
• Installation, Configuration, and Job Submission
• Monitoring SeaTunnel
• Connector Reference: Validated Examples
• Troubleshooting and Tuning
• Security: Kerberos, Ranger, Knox, and ACLs
• Performance Benchmarks
• ODP-Specific Additions Compared to Apache SeaTunnel
• SeaTunnel FAQs