Celeborn Appendix

CELEBORN_HOME

Celeborn installation root directory

CELEBORN_CONF_DIR

Configuration files directory

CELEBORN_LOG_DIR

Log output directory

CELEBORN_PID_DIR

PID file directory

CELEBORN_MASTER_MEMORY

Master JVM heap size (e.g., 4g)

CELEBORN_WORKER_MEMORY

Worker JVM heap size (e.g., 2g)

CELEBORN_WORKER_OFFHEAP_MEMORY

Worker direct (off-heap) memory (e.g., 8g)

9097

Master RPC

Client and Worker registration/communication

9098

Master HTTP

Web UI, REST API, Prometheus metrics

9872

Ratis (HA)

Master-to-Master Raft consensus traffic

9094

Worker RPC

Client data push and fetch

9096

Worker HTTP

Worker Web UI and Prometheus metrics

19097

Master Internal

Used when authentication (celeborn.auth.enabled=true)