Submitting Batch Jobs to Specific Versions

Livy 3.5.5 Batch Job

curl -X POST http://<livy-host>:8355/batches \ -H "Content-Type: application/json" \ -d '{ "file": "hdfs:///user/spark/myapp.jar", "className": "com.example.MyApp", "args": ["arg1", "arg2"], "conf": { "spark.master": "yarn", "spark.submit.deployMode": "cluster" } }'

Livy 3.3.3 Batch Job

curl -X POST http://<livy-host>:8333/batches \ -H "Content-Type: application/json" \ -d '{ "file": "hdfs:///user/spark/legacy-app.jar", "className": "com.example.LegacyApp", "args": ["arg1"], "conf": { "spark.master": "yarn", "spark.submit.deployMode": "cluster" } }'


  Last updated