Livy 3 Migration Guide

Migrating from Livy 3.3.3 to Livy 3.5.5

Step 1: Assessment

# Check current session usage curl http://<host>:8333/sessions | jq '.total' # Identify client applications grep -r "8333" /path/to/application/configs

Step 2: Testing

# Test application with Livy 3.5.5 livy_client = LivySession(url='http://<host>:8355') session = livy_client.create(kind='pyspark') # Run test workloads # Validate results # Check for errors

Step 3: Gradual Migration

  1. Update non-critical applications first

  2. Monitor for issues for 1-2 weeks

  3. Migrate critical applications during the maintenance window

  4. Keep Livy 3.3.3 running for 30 days post-migration

Step 4: Decommission

# Stop Livy 3.3.3 server via Ambari UI # Monitor for any connection attempts # Remove service after validation period


  Last updated