Upgrade from Version 3.0.x to 3.3.20

Prerequisites

Upgrade the Docker version to 20.10.x or above.

Steps to upgrade the Docker version:

• Uninstall the current Docker

yum remove -y docker-ce docker-ce-cli containerd.io

• Install the latest version of Docker

yum install -y docker-ce docker-ce-cli containerd.io

• To install a specific version of docker

yum install -y docker-ce-24.0.5 docker-ce-cli-24.0.5 containerd.io

• Replace 24.0.5 with the appropriate version string
• To list specific versions of docker

yum list docker-ce --showduplicates | sort -r

• Start Docker

systemctl start docker

Preparing for MongoDB Upgrade

Ensure the MongoDB migrate images are present on the Pulse server.

Download the MongoDB images using Docker pull:

docker pull 191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-4.4.20
docker pull 191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-5.0.16

Download the Mongo Migrate Images from the Download Links

• Download the MongoDB images named as database-4.tar.gz and database-5.tar.gz on the Pulse server.
• Once downloaded, use the command docker load -i to load these images into the local repository.

Cluster Specific Changes for Upgrades from Pulse other than 3.2.X

Below are the components absent in releases preceding 3.2.x, as opposed to the 3.3.0 release.

• ad-events
• ad-gauntlet

No adjustments are needed on the cluster side for ad-gauntlet. However, incorporating the ad-events component necessitates specific hook-related modifications on the cluster side.

For configuring Hive/Tez hooks, refer to the wiki on New Configure HDP for the Pulse deployment.

Pulse Upgrade Steps

• Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.3.0.
• Run the following command to push the updated configs:

accelo admin database push-config

• Ensure that you have downloaded and loaded all essential Pulse images for version 3.3.0.
• Ensure that the prerequisites for MongoDB migration/upgradation have been completed.
• Ensure that the prerequisites for Docker upgrade have been completed.
• Complete the prerequisites for cluster-specific changes when migrating from Pulse versions other than 3.2.X.
• Download the new accelo binary and replace the older accelo binary with the newer one.
• Run the migrate command:
  • -v: The version to which you want to migrate to
  • -i: The version from which you want to migrate from

For example, to migrate from version 3.0.12 to version 3.3.0 the migrate command will look like this:

accelo migrate -v 3.3.0 -i 3.0.12

If any issues occur during migration, re-run the same command.

• Upon successful execution of the migration command, deploy all core containers.

accelo deploy core

• Restart all containers to apply the updated images.

accelo restart all -d

• Uninstall the hydra agent.

accelo uninstall remote

• Install the hydra agent.

accelo deploy hydra

• Reconfigure the cluster to get the updated configs for agents.

accelo reconfig cluster -a

• To push the updated config to the database, execute the following command.

accelo admin database push-config -a

• To configure when gauntlet snap will run MongoDB cleanup and compaction, run:

accelo config retention

When prompted, input values as a string of comma-separated values. For example: 12,18.

Pulse Upgrade Steps for Version 3.3.0 to 3.3.20

• Update the ImageTag in $AcceloHome/config/accelo.yml to 3.3.20.
• To push the updated config to the database, execute the following command:

accelo admin database push-config -a

• Take a backup of the accelo file and download the latest version for accelo.linux CLI.
• Move the latest accelo CLI file and set it as executable, then verify the updated Pulse information.

mv accelo.linux accelo
chmod +x ./accelo

• For online installations, execute the following command and confirm with 'Y' at the prompt to obtain the latest binaries.

accelo login docker
accelo pull all

• For offline installations, download all the latest image packs and execute the following command to upload the newest images.

docker load -i

• Restart all containers, including databases, using the following command:

accelo restart all -d

• Update the hydra agents.
  • In ansible based deployment:
    • Uninstall the hydra agent: accelo uninstall remote
    • Install the hydra agent: accelo deploy hydra
  • In Parcel based deployment: Upgradation of Parcel and Hydra Services.
• To push the updated config to the database, execute the following command:

accelo admin database push-config -a

• Reconfigure the cluster to get the updated configs for agents.

accelo reconfig cluster -a