Using Multiple Livy Versions

Create sessions on specific versions:

Livy 3.5.5 (Port 8355)

# Create interactive Scala session curl -X POST http://<livy-host>:8355/sessions \ -H "Content-Type: application/json" \ -d '{ "kind": "spark", "conf": { "spark.executor.memory": "2g", "spark.executor.cores": 2 } }'

Livy 3.3.3 (Port 8333)

# Create interactive PySpark session curl -X POST http://<livy-host>:8333/sessions \ -H "Content-Type: application/json" \ -d '{ "kind": "pyspark", "conf": { "spark.executor.memory": "2g", "spark.executor.cores": 2 } }'

Livy 3.5.1 (Port 8351)

# Create SparkR session curl -X POST http://<livy-host>:8351/sessions \ -H "Content-Type: application/json" \ -d '{ "kind": "sparkr", "conf": { "spark.executor.memory": "2g" } }'


  Last updated