Install ODP Celeborn

Apache Celeborn is a Remote Shuffle Service (RSS) designed to improve the efficiency, stability, and flexibility of shuffle operations in distributed compute engines. It supports Apache Spark, Apache Flink, Apache Tez, and MapReduce.

For details, access the following pages:

• Introduction to Celeborn
• Celeborn vs YARN External Shuffle Service
• Architecture Overview
• Prerequisites for Celeborn
• Deploy Celeborn with Ambari Mpack
• Configuration Reference
• Engine Integration
• Security Configuration
• Configure Storage
• Quota Management
• Worker Tags
• Monitoring and Metrics
• Performance Tuning
• Capacity Planning
• Troubleshooting
• Celeborn Appendix