Manage Spark 3 Configurations

Version-Specific Configurations

Each Spark version has independent configuration files:

/etc/spark3/conf/ # Spark 3.5.5
/etc/spark3_3_3_3/conf/ # Spark 3.3.3
/etc/spark3_3_5_1/conf/ # Spark 3.5.1

Modifying Configurations via Ambari

• Navigate to Services → Select Spark version
• Click the "Configs" tab
• Modify settings as needed
• Save changes
• Restart affected components

Example: Increase History Server memory for Spark 3.3.3

• Go to Spark3 3.3.3 service
• Configs → Advanced spark3-3.3.3-env
• Set spark_daemon_memory = 2048 (MB)
• Save and restart the History Server