Manage Configurations

Version-Specific Configurations

Each Livy version has independent configuration files:

/etc/livy3/conf/ # Livy 3.5.5 /etc/livy3_3_3_3/conf/ # Livy 3.3.3 /etc/livy3_3_5_1/conf/ # Livy 3.5.1

Key Configuration Files

livy.conf

Main Livy configuration file containing server settings:

# /etc/livy3_3_3_3/conf/livy.conf livy.server.port = 8333 livy.spark.master = yarn livy.spark.deploy-mode = cluster livy.repl.enable-hive-context = true livy.rsc.jars = /usr/odp/current/livy3_3_3_3-server/rsc-jars livy.server.session.timeout = 1h

spark-blacklist.conf

Controls which Spark configurations clients can override:

# Configurations that Livy clients cannot override spark.master spark.submit.deployMode spark.yarn.keytab spark.yarn.principal

livy-env.sh

Environment variables for Livy server:

export SPARK_HOME=/usr/odp/current/spark3_3_3_3-client export SPARK_CONF_DIR=/etc/spark3_3_3_3/conf export HADOOP_CONF_DIR=/etc/hadoop/conf export LIVY_SERVER_JAVA_OPTS="-Xmx2g"

Modifying Configurations via Ambari

  1. Navigate to Services → Select Livy version

  2. Click the "Configs" tab

  3. Modify settings as needed

  4. Save changes

  5. Restart Livy Server

Example: Increase session timeout for Livy 3.3.3

  1. Go to Spark3 3.3.3 service

  2. ConfigsAdvanced livy3-3.3.3-conf

  3. Set livy.server.session.timeout = 2h

  4. Save and restart the Livy Server



  Last updated