Deploy Celeborn with Ambari Mpack

Install the Celeborn Mpack

Run the following commands on the Ambari server host:

Step 1: Stop Ambari Server

Bash
Copy

Step 2: Install the Celeborn mpack

Bash
Copy

Step 3: Restart Ambari Server

Bash
Copy

Add Celeborn Service via Ambari UI

  1. Navigate to Ambari UI → Services → Add Service

  2. Select Celeborn from the service list and click Next

  3. Assign hosts for each component:

    • Celeborn Master: 1 host (non-HA) or 3 hosts (HA mode)
    • Celeborn Worker: 3 or more worker hosts
    • Celeborn Client: All nodes running Spark or Flink executors

  4. Configure properties (see Section 6) and deploy

  5. Verify via Master Web UI: http://<master-host>:9098

Basic Ambari Configuration

celeborn-defaults

PropertyDefaultDescription
celeborn.master.port9097Master RPC port
celeborn.master.http.port9098Master HTTP / UI port
celeborn.worker.storage.dirs/var/lib/celeborn/shuffleWorker shuffle storage directories
celeborn.metrics.enabledtrueEnable Prometheus metrics collection

celeborn-env

VariableDefaultDescription
celeborn_master_memory1024 MBMaster JVM heap size
celeborn_worker_memory1024 MBWorker JVM heap size
celeborn_worker_offheap_memory4096 MBWorker off-heap (direct) memory
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard
  Last updated on Apr 23, 2026
Next to read:
Configuration Reference
null
On This Page
Deploy Celeborn with Ambari MpackInstall the Celeborn MpackAdd Celeborn Service via Ambari UIBasic Ambari ConfigurationStep 1: Stop Ambari ServerStep 2: Install the Celeborn mpackStep 3: Restart Ambari Serverceleborn-defaultsceleborn-env