Upgrade to Version 3.4.5

Prerequisite

Upgrade the Docker version to 20.10.x or above.

Steps to upgrade the Docker version:

1. Uninstall the current Docker:

yum remove -y docker-ce docker-ce-cli containerd.io

2. Install the latest version of Docker:

yum install -y docker-ce docker-ce-cli containerd.io

• To install a specific version of Docker:

yum install -y docker-ce-24.0.5 docker-ce-cli-24.0.5 containerd.io

• Replace 24.0.5 with the appropriate version string
• To list specific versions of docker

yum list docker-ce --showduplicates | sort -r

3. Start Docker:

systemctl start docker

Migration Steps from Version 3.3.x to 3.4.5

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

1. Update Configuration:

   • Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.5.

2. Push Updated Configuration to Database:

   • Run the following command:

accelo admin database push-config

3. Download Necessary Images:

   • Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.5.

4. Update Accelo Binary:

   • Download the new Accelo binary.
   • Replace the older Accelo binary with the new one.

5. Run Migration Command:

• -i : This indicates the version you are migrating from. For example, to migrate from 3.3.8 to 3.4.0, run:

accelo migrate -v 3.4.0 -i 3.3.8 -b

• For Multi-Cluster:

accelo migrate -v 3.4.0 -i 3.3.8 -a -b

6. Handle Migration Issues:

   • If any issues occur during migration, rerun the same command.

7. Restart Containers:

   • Restart all containers to use the updated images:

accelo restart all -d

8. Uninstall Hydra Agent:
   • Run the following command:

accelo uninstall remote

9. Install Hydra Agent:
   • Run the following command:

accelo deploy hydra

10. If Logsearch is deployed in standalone mode:
    • Check if yarn_app_es_urls is present in override.yml
    • If the above is present, change the port number from 19013 to 19051.

yarn_app_es_urls: <http://<LOG_SEARCH_HOSTNAME>>:19051

11. Reconfigure Cluster:
    • To get the updated configuration for agents, run:

accelo reconfig cluster -a

12. Push Updated Configuration to Database:
    • Run the following command:

accelo admin database push-config -a

13. Configure MongoDB Cleanup & Compaction:
    • To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

accelo config retention

14. Create Indices for Database Collections:
    • Finally, run the following command:

accelo admin database index-db

15. If the old playbooks already present in the node where ad-director is deployed, delete them, and download the latest playbooks tar from the License UI.
    1. Delete the old playbooks using the command: rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace <cluster_name> with name of the cluster where the playbooks are present.
    2. Download the playbooks tar from the License UI. For details, see Deploy Playbooks.

Migration Steps from Version 3.0.x to 3.4.5

Cluster Specific Changes

The following components are introduced in version 3.4.0 and are not present in version 3.0.x:

• ad-events
• ad-gauntlet

To accommodate the ad-events component, you need to make certain changes related to hooks on the cluster side. For configuring Hive or Tez hooks, refer to the document, [Configure HDP for Pulse Deployment](Configure HDP for Pulse Deployment).

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

1. Update Configuration:

• Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.5.

2. Push Updated Configuration to Database:

• Run the following command:

accelo admin database push-config

3. Download Necessary Images:
   • Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.5, including:

191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-4.4.20   

191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-5.0.16

4. Update Accelo Binary:

   • Download the new Accelo binary.
   • Replace the older Accelo binary with the new one.

5. Run Migration Command:

• -i : This indicates the version you are migrating from. For example, to migrate from 3.0.16 to 3.4.0, run:

accelo migrate -v 3.4.0 -i 3.0.16 -b

• For Multi-Cluster:

accelo migrate -v 3.4.0 -i 3.0.16 -a -b

6. Handle Migration Issues:

   • If any issues occur during migration, rerun the same command.

7. Generate Notifications Configuration:

   • Note Skip this step on nodes that don't have Core services running on them.
   • After migration completes successfully, generate notifications.yml by running:

accelo config actions notifications

8. Deploy Core Containers:
   • Note Skip this step on nodes that don't have Core services running on them.
   • Deploy all core containers by running:

accelo deploy core

• If you see the following error, just answer y and proceed:

ERROR: Looks like core setup is missing the services '[ad-events ad-gauntlet]' from the stack 'default'.

9. Restart Containers:
   • Restart all containers to use the updated images:

accelo restart all -d

10. Uninstall Hydra Agent:
    • Run the following command:

accelo uninstall remote

11. Install Hydra Agent:
    • Run the following command:

accelo deploy hydra

12. If Logsearch is deployed in standalone mode:
    • Check if yarn_app_es_urls is present in override.yml
    • If the above is present, change the port number from 19013 to 19051.

yarn_app_es_urls: <http://<LOG_SEARCH_HOSTNAME>>:19051

13. Reconfigure Cluster:
    • To get the updated configuration for agents, run:

accelo reconfig cluster -a

14. Push Updated Configuration to Database:
    • Run the following command:

accelo admin database push-config -a

15. Configure MongoDB Cleanup & Compaction:
    • To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

accelo config retention

16. Create Indices for Database Collections:
    • Finally, run the following command:

accelo admin database index-db

17. If the old playbooks already present in the node where ad-director is deployed, delete them, and download the latest playbooks tar from the License UI.
    1. Delete the old playbooks using the command: rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace <cluster_name> with name of the cluster where the playbooks are present.
    2. Download the playbooks tar from the License UI. For details, see Deploy Playbooks.

Migration Steps from Version 3.2.x to 3.4.5

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

1. Update Configuration:

   • Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.5.

2. Push Updated Configuration to Database:

   • Run the following command:

accelo admin database push-config

3. Download Necessary Images:
   • Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.5, including:

191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-4.4.20   

191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-5.0.16

4. Update Accelo Binary:

   • Download the new Accelo binary.
   • Replace the older Accelo binary with the new one.

5. Run Migration Command:

• -i : This indicates the version you are migrating from. For example, to migrate from 3.2.14 to 3.4.0, run:

accelo migrate -v 3.4.0 -i 3.2.14 -b

• For Multi-Cluster:

accelo migrate -v 3.4.0 -i 3.2.14 -a -b

6. Handle Migration Issues:

   • If any issues occur during migration, rerun the same command.

7. Restart Containers:

   • Restart all containers to use the updated images:

accelo restart all -d

8. Uninstall Hydra Agent:
   • Run the following command:

accelo uninstall remote

9. Install Hydra Agent:
   • Run the following command:

accelo deploy hydra

10. If Logsearch is deployed in standalone mode:
    • Check if yarn_app_es_urls is present in override.yml
    • If the above is present, change the port number from 19013 to 19051.

yarn_app_es_urls: <http://<LOG_SEARCH_HOSTNAME>>:19051

11. Reconfigure Cluster:
    • To get the updated configuration for agents, run:

accelo reconfig cluster -a

12. Push Updated Configuration to Database:
    • Run the following command:

accelo admin database push-config -a

13. Configure MongoDB Cleanup & Compaction:
    • To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

accelo config retention

14. Create Indices for Database Collections:
    • Finally, run the following command:

accelo admin database index-db

15. If the old playbooks already present in the node where ad-director is deployed, delete them, and download the latest playbooks tar from the License UI.
    1. Delete the old playbooks using the command: rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace <cluster_name> with name of the cluster where the playbooks are present.
    2. Download the playbooks tar from the License UI. For details, see Deploy Playbooks.

Migration Steps from Version 3.3.2x to 3.4.5

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

1. Update Configuration:

   • Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.5.

2. Push Updated Configuration to Database:

   • Run the following command:

accelo admin database push-config

3. Download Necessary Images:
   • Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.5, including:

191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-4.4.20   

191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-5.0.16

4. Update Accelo Binary:

   • Download the new Accelo binary.
   • Replace the older Accelo binary with the new one.

5. Run Migration Command:

• -i : This indicates the version you are migrating from. For example, to migrate from 3.3.20 to 3.4.0, run:

accelo migrate -v 3.4.0 -i 3.3.20 -b

• For Multi-Cluster:

accelo migrate -v 3.4.0 -i 3.3.20 -a -b

6. Handle Migration Issues:

   • If any issues occur during migration, rerun the same command.

7. Restart Containers:

   • Restart all containers to use the updated images:

accelo restart all -d

8. Uninstall Hydra Agent:
   • Run the following command:

accelo uninstall remote

9. Install Hydra Agent:
   • Run the following command:

accelo deploy hydra

10. If Logsearch is deployed in standalone mode:
    • Check if yarn_app_es_urls is present in override.yml
    • If the above is present, change the port number from 19013 to 19051.

yarn_app_es_urls: <http://<LOG_SEARCH_HOSTNAME>>:19051

11. Reconfigure Cluster:
    • To get the updated configuration for agents, run:

accelo reconfig cluster -a

12. Push Updated Configuration to Database:
    • Run the following command:

accelo admin database push-config -a

13. Configure MongoDB Cleanup & Compaction:
    • To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

accelo config retention

14. Create Indices for Database Collections:
    • Finally, run the following command.

accelo admin database index-db

15. If the old playbooks already present in the node where ad-director is deployed, delete them, and download the latest playbooks tar from the License UI.
    1. Delete the old playbooks using the command: rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace <cluster_name> with name of the cluster where the playbooks are present.
    2. Download the playbooks tar from the License UI. For details, see Deploy Playbooks.

Migration Steps from Version 3.4.x to 3.4.5

1. Update Configuration:

   • Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.5.

2. Push Updated Configuration to Database:

   • Run the following command:

accelo admin database push-config -a

3. Take a backup of the accelo file and download the latest version for the accelo.linux CLI.
4. Move and make the latestaccelo CLI file as an executable. Also, check the updated Pulse information for the following:

mv accelo.linux accelo

chmod +x ./accelo

5. For the Online installation option, run the following command and press 'Y' at the prompt to get the most recent binaries.

accelo login docker

accelo pull all

6. For the Offline Installation option, download all the latest image packs and run the following command to upload the latest images.

docker load -i

7. Run the below command to update and add new keys in vars.yml.

accelo reconfig cluster

8. Run the below command to push acceldata.conf and other updated files to MongoDB.

accelo admin database push-config

9. Restart all containers including database(s) with the following command.

accelo restart all -d

10. Uninstall the hydra agent using the following command.

accelo uninstall remote

11. Install the hydra agent using the following command.

accelo deploy hydra

12. Reconfigure the cluster to get the updated configurations for agents.

accelo reconfig cluster -a

13. If the old playbooks already present in the node where ad-director is deployed, delete them, and download the latest playbooks tar from the License UI.
    1. Delete the old playbooks using the command: rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace <cluster_name> with name of the cluster where the playbooks are present.
    2. Download the playbooks tar from the License UI. For details, see Deploy Playbooks.