Spark Modernization
Spark Modernization is Acceldata's initiative to move Spark workloads onto current Spark releases. Its first deliverable is spark-migrate-cli, a command-line tool that takes a Spark 2.x repository in Scala, Java or PySpark and returns it migrated, built, and tested on a newer Spark release (Spark 3.5.5 today).
Spark Migrate CLI helps you:
- Identify compatibility issues in application code, dependencies, and configurations.
- Automatically apply supported code changes and dependency upgrades.
- Compile migrated applications and run their existing tests.
- Review migration reports and validate application outputs before deployment.
The tool runs on your machines against your repositories, and nothing leaves your network. Every change comes from a documented rule, so the same repository always gets the same migration.
Info
Contact Acceldata Support for the release tarball and its SHA-256 checksum. The tarball includes the full user guide.
Have a suggestion?