Manage Configurations

Version-Specific Configurations

Each Livy version has independent configuration files:

/etc/livy3/conf/ # Livy 3.5.5
/etc/livy3_3_3_3/conf/ # Livy 3.3.3
/etc/livy3_3_5_1/conf/ # Livy 3.5.1

Key Configuration Files

livy.conf

Main Livy configuration file containing server settings:

# /etc/livy3_3_3_3/conf/livy.conf
livy.server.port = 8333
livy.spark.master = yarn
livy.spark.deploy-mode = cluster
livy.repl.enable-hive-context = true
livy.rsc.jars = /usr/odp/current/livy3_3_3_3-server/rsc-jars
livy.server.session.timeout = 1h

spark-blacklist.conf

Controls which Spark configurations clients can override:

# Configurations that Livy clients cannot override
spark.master
spark.submit.deployMode
spark.yarn.keytab
spark.yarn.principal

livy-env.sh

Environment variables for Livy server:

export SPARK_HOME=/usr/odp/current/spark3_3_3_3-client
export SPARK_CONF_DIR=/etc/spark3_3_3_3/conf
export HADOOP_CONF_DIR=/etc/hadoop/conf
export LIVY_SERVER_JAVA_OPTS="-Xmx2g"

Modifying Configurations via Ambari

• Navigate to Services → Select Livy version
• Click the "Configs" tab
• Modify settings as needed
• Save changes
• Restart Livy Server

Example: Increase session timeout for Livy 3.3.3

• Go to Spark3 3.3.3 service
• Configs → Advanced livy3-3.3.3-conf
• Set livy.server.session.timeout = 2h
• Save and restart the Livy Server