Tez and MapReduce Service Checks Fail After ODP Upgrade

After upgrading an ODP cluster, Tez and MapReduce service checks may fail with errors indicating that YARN cannot download required application resources from HDFS.

This issue typically occurs when the Tez or MapReduce application archives stored in HDFS are missing, corrupted, or have a file size of zero bytes.

Symptoms

Tez Service Check Failure

MapReduce Service Check Failure

Applications may repeatedly fail with:

Cause

Tez and MapReduce rely on application archives stored in HDFS under:

During service startup or service checks, YARN distributes these archives to containers.

If the archive:

• Does not exist

• Is corrupted

• Has a size of 0 bytes

YARN cannot unpack the application resources and the service check fails.

Verify the Issue

Check the file sizes:

Example of a problematic archive:

Resolution

Restore MapReduce Archive

Copy the archive from a healthy local installation:

Restore Tez Archive

Verify:

Confirm the files are no longer zero bytes.

Validation

Test Tez

Run the Tez service check from Ambari.

Test MapReduce

Both service checks should complete successfully.

Best Practices

• Verify /odp/apps/<version>/ contents immediately after upgrade.

• Validate archive file sizes before running service checks.

• Ensure HDFS permissions remain intact.

• Keep a backup of application archives prior to major upgrades.