Upgrade to Version 3.4.1

Prerequisite

Upgrade the Docker version to 20.10.x or above.

Steps to upgrade the Docker version:

Uninstall the current Docker:

Bash
    
 
yum remove -y docker-ce docker-ce-cli containerd.io
Copy

Install the latest version of Docker:

Bash
    
 
yum install -y docker-ce docker-ce-cli containerd.io
Copy

To install a specific version of Docker:

Bash
    
 
yum install -y docker-ce-24.0.5 docker-ce-cli-24.0.5 containerd.io
Copy

Replace 24.0.5 with the appropriate version string
To list specific versions of docker

Bash
    
 
yum list docker-ce --showduplicates | sort -r
Copy

Start Docker:

Bash
    
 
systemctl start docker
Copy

Migration Steps from Version 3.3.x to 3.4.1

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

Update Configuration:
- Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.1.
Push Updated Configuration to Database:
- Run the following command:

Bash
    
 
accelo admin database push-config
Copy

Download Necessary Images:
- Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.1.
Update Accelo Binary:
- Download the new Accelo binary.
- Replace the older Accelo binary with the new one.
Run Migration Command:

Make sure you run the command from $AcceloHome.
Do not change the value of -v from 3.4.0 unless explicitly advised by Engineering. The following command needs to run on all Pulse nodes including standalone nodes i.e. nodes where PULSE_SA_NODE is true. Examples of such nodes include but aren’t limited to Logsearch, FS Analytics V2, Dashplot .

- To migrate from 3.3.8 to 3.4.0, run:

Bash
    
 
accelo migrate -v 3.4.0 -i 3.3.8 -b
Copy

For Multi-Cluster:

Bash
    
 
accelo migrate -v 3.4.0 -i 3.3.8 -a -b
Copy

Handle Migration Issues:
- If any issues occur during migration, rerun the same command.
Restart Containers:
- Restart all containers to use the updated images:

Bash
    
 
accelo restart all -d
Copy

Uninstall Hydra Agent:
- Run the following command:

Bash
    
 
accelo uninstall remote
Copy

Install Hydra Agent:
- Run the following command:

Bash
    
 
accelo deploy hydra
Copy

If Logsearch is deployed in standalone mode:
- Check if yarn_app_es_urls is present in override.yml
- If the above is present, change the port number from 19013 to 19051.

Bash
    
 
yarn_app_es_urls: <http://<LOG_SEARCH_HOSTNAME>>:19051
Copy

Reconfigure Cluster:
- To get the updated configuration for agents, run:

Bash
    
 
accelo reconfig cluster -a
Copy

Push Updated Configuration to Database:
- Run the following command:

Bash
    
 
accelo admin database push-config -a
Copy

Configure MongoDB Cleanup & Compaction:
- To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

Bash
    
 
accelo config retention
Copy

Create Indices for Database Collections:
- Finally, run the following command:

Bash
    
 
accelo admin database index-db
Copy

Migration Steps from Version 3.0.x to 3.4.1

Cluster Specific Changes

The following components are introduced in version 3.4.0 and are not present in version 3.0.X:

ad-events
ad-gauntlet

To accommodate the ad-events component, you need to make certain changes related to hooks on the cluster side. For configuring Hive/Tez hooks, refer to the document, [Configure HDP for Pulse Deployment](Configure HDP for Pulse Deployment).

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

Update Configuration:

Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.1.

Push Updated Configuration to Database:

Run the following command:

Bash
    
 
accelo admin database push-config
Copy

Download Necessary Images:
- Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.1, including:

Bash
    
 
191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-4.4.20   191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-5.0.16
Copy

Update Accelo Binary:
- Download the new Accelo binary.
- Replace the older Accelo binary with the new one.
Run Migration Command:

Make sure you run the command from $AcceloHome.
Do not change the value of -v from 3.4.0 unless explicitly advised by Engineering. The following command needs to run on all Pulse nodes including standalone nodes i.e. nodes where PULSE_SA_NODE is true. Examples of such nodes include but aren’t limited to Logsearch, FS Analytics V2, Dashplot .

To migrate from 3.0.16 to 3.4.0, run:

Bash
    
 
accelo migrate -v 3.4.0 -i 3.0.16 -b
Copy

For Multi-Cluster:

Bash
    
 
accelo migrate -v 3.4.0 -i 3.0.16 -a -b
Copy

Handle Migration Issues:
- If any issues occur during migration, rerun the same command.
Generate Notifications Configuration:
- Note Skip this step on nodes that don't have Core services running on them.
- After migration completes successfully, generate notifications.yml by running:

Bash
    
 
accelo config actions notifications
Copy

Deploy Core Containers:
- Note Skip this step on nodes that don't have Core services running on them.
- Deploy all core containers by running:

Bash
    
 
accelo deploy core
Copy

If you see the following error, just answer y and proceed:

Bash
    
 
ERROR: Looks like core setup is missing the services '[ad-events ad-gauntlet]' from the stack 'default'.
Copy

Restart Containers:
- Restart all containers to use the updated images:

Bash
    
 
accelo restart all -d
Copy

Uninstall Hydra Agent:
- Run the following command:

Bash
    
 
accelo uninstall remote
Copy

Install Hydra Agent:
- Run the following command:

Bash
    
 
accelo deploy hydra
Copy

If Logsearch is deployed in standalone mode:
- Check if yarn_app_es_urls is present in override.yml
- If the above is present, change the port number from 19013 to 19051.

Bash
    
 
yarn_app_es_urls: <http://<LOG_SEARCH_HOSTNAME>>:19051
Copy

Reconfigure Cluster:
- To get the updated configuration for agents, run:

Bash
    
 
accelo reconfig cluster -a
Copy

Push Updated Configuration to Database:
- Run the following command:

Bash
    
 
accelo admin database push-config -a
Copy

Configure MongoDB Cleanup & Compaction:
- To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

Bash
    
 
accelo config retention
Copy

Create Indices for Database Collections:
- Finally, run the following command:

Bash
    
 
accelo admin database index-db
Copy

Migration Steps from Version 3.2.x to 3.4.1

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

Update Configuration:
- Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.1.
Push Updated Configuration to Database:
- Run the following command:

Bash
    
 
accelo admin database push-config
Copy

Download Necessary Images:
- Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.1, including:

Bash
    
 
191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-4.4.20   191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-5.0.16
Copy

Update Accelo Binary:
- Download the new Accelo binary.
- Replace the older Accelo binary with the new one.
Run Migration Command:

Make sure you run the command from $AcceloHome.
Do not change the value of -v from 3.4.0 unless explicitly advised by Engineering. The following command needs to run on all Pulse nodes including standalone nodes i.e. nodes where PULSE_SA_NODE is true. Examples of such nodes include but aren’t limited to Logsearch, FS Analytics V2, Dashplot .

- To migrate from 3.2.14 to 3.4.0, run:

Bash
    
 
accelo migrate -v 3.4.0 -i 3.2.14 -b
Copy

For Multi-Cluster:

Bash
    
 
accelo migrate -v 3.4.0 -i 3.2.14 -a -b
Copy

Handle Migration Issues:
- If any issues occur during migration, rerun the same command.
Restart Containers:
- Restart all containers to use the updated images:

Bash
    
 
accelo restart all -d
Copy

Uninstall Hydra Agent:
- Run the following command:

Bash
    
 
accelo uninstall remote
Copy

Install Hydra Agent:
- Run the following command:

Bash
    
 
accelo deploy hydra
Copy

If Logsearch is deployed in standalone mode:
- Check if yarn_app_es_urls is present in override.yml
- If the above is present, change the port number from 19013 to 19051.

Bash
    
 
yarn_app_es_urls: <http://<LOG_SEARCH_HOSTNAME>>:19051
Copy

Reconfigure Cluster:
- To get the updated configuration for agents, run:

Bash
    
 
accelo reconfig cluster -a
Copy

Push Updated Configuration to Database:
- Run the following command:

Bash
    
 
accelo admin database push-config -a
Copy

Configure MongoDB Cleanup & Compaction:
- To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

Bash
    
 
accelo config retention
Copy

Create Indices for Database Collections:
- Finally, run the following command:

Bash
    
 
accelo admin database index-db
Copy

Migration Steps from Version 3.3.2x to 3.4.1

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

Bash
    
 
accelo admin database push-config
Copy

Update Configuration:
- Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.1.
Push Updated Configuration to Database:
- Run the following command:

Bash
    
 
accelo admin database push-config
Copy

Download Necessary Images:
- Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.1, including:

Bash
    
 
191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-4.4.20   191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-5.0.16
Copy

Update Accelo Binary:
- Download the new Accelo binary.
- Replace the older Accelo binary with the new one.
Run Migration Command:

Make sure you run the command from $AcceloHome.
Do not change the value of -v from 3.4.0 unless explicitly advised by Engineering. The following command needs to run on all Pulse nodes including standalone nodes i.e. nodes where PULSE_SA_NODE is true. Examples of such nodes include but aren’t limited to Logsearch, FS Analytics V2, Dashplot .

To migrate from 3.3.20 to 3.4.0, run:

Bash
    
 
accelo migrate -v 3.4.0 -i 3.3.20 -b
Copy

For Multi-Cluster:

Bash
    
 
accelo migrate -v 3.4.0 -i 3.3.20 -a -b
Copy

Handle Migration Issues:
- If any issues occur during migration, rerun the same command.
Restart Containers:
- Restart all containers to use the updated images:

Bash
    
 
accelo restart all -d
Copy

Uninstall Hydra Agent:
- Run the following command:

Bash
    
 
accelo uninstall remote
Copy

Install Hydra Agent:
- Run the following command:

Bash
    
 
accelo deploy hydra
Copy

If Logsearch is deployed in standalone mode:
- Check if yarn_app_es_urls is present in override.yml
- If the above is present, change the port number from 19013 to 19051.

Bash
    
 
yarn_app_es_urls: <http://<LOG_SEARCH_HOSTNAME>>:19051
Copy

Reconfigure Cluster:
- To get the updated configuration for agents, run:

Bash
    
 
accelo reconfig cluster -a
Copy

Push Updated Configuration to Database:
- Run the following command:

Bash
    
 
accelo admin database push-config -a
Copy

Configure MongoDB Cleanup & Compaction:
- To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

Bash
    
 
accelo config retention
Copy

Create Indices for Database Collections:
- Finally, run the following command:

Bash
    
 
accelo admin database index-db
Copy

Migration Steps from Version 3.4.x to 3.4.1

Update Configuration:
- Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.1.
Push Updated Configuration to Database:
- Run the following command:

Bash
    
 
accelo admin database push-config -a
Copy

Take a backup of the accelo file and download the latest version for the accelo.linux CLI.
Move and make the latestaccelo CLI file as an executable. Also, check the updated Pulse information for the following:

Bash
    
 
mv accelo.linux accelochmod +x ./accelo
Copy

For the Online installation option, run the following command and press 'Y' at the prompt to get the most recent binaries.

Bash
    
 
accelo login dockeraccelo pull all
Copy

For the Offline Installation option, download all the latest image packs and run the following command to upload the latest images.

Bash
    
 
docker load -i
Copy

Run the below command to update and add new keys in vars.yml.

Bash
    
 
accelo reconfig cluster
Copy

Run the below command to push acceldata.conf and other updated files to MongoDB.

Bash
    
 
accelo admin database push-config
Copy

Restart all containers including database(s) with the following command.

Bash
    
 
accelo restart all -d
Copy

Uninstall the hydra agent using the following command.

Bash
    
 
accelo uninstall remote
Copy

Install the hydra agent using the following command.

Bash
    
 
accelo deploy hydra
Copy

Reconfigure the cluster to get the updated configurations for agents.

Bash
    
 
accelo reconfig cluster -a
Copy

Last updated on

Was this page helpful?