Upgrade to Version 3.4.0

Prerequisite

Upgrade the Docker version to 20.10.x or above.

Steps to upgrade the Docker version:

Uninstall the current Docker:

Bash
    
xxxxxxxxxx
 
yum remove -y docker-ce docker-ce-cli containerd.io
Copy

Install the latest version of Docker:

Bash
    
xxxxxxxxxx
 
yum install -y docker-ce docker-ce-cli containerd.io
Copy

To install a specific version of Docker:

Bash
    
xxxxxxxxxx
 
yum install -y docker-ce-24.0.5 docker-ce-cli-24.0.5 containerd.io
Copy

Replace 24.0.5 with the appropriate version string
To list specific versions of docker

Bash
    
xxxxxxxxxx
 
yum list docker-ce --showduplicates | sort -r
Copy

Start Docker:

Bash
    
xxxxxxxxxx
 
systemctl start docker
Copy

Execute the migration steps according to your current version to upgrade to version 3.4.0 as outlined in the following sections:

Migration Steps from Version 3.3.X to 3.4.0

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

Update Configuration:

Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.0.

Push Updated Configuration to Database:

Run the following command:

Bash
    
xxxxxxxxxx
 
accelo admin database push-config
Copy

Download Necessary Images:

Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.0.

Update Accelo Binary:

Download the new Accelo binary.
Replace the older Accelo binary with the new one.

Run Migration Command:

Make sure you run the command from $AcceloHome.
Do not change the value of -v from 3.4.0 unless explicitly advised by Engineering. The following command needs to run on all Pulse nodes including standalone nodes i.e. nodes where PULSE_SA_NODE is true. Examples of such nodes include but aren’t limited to Logsearch, FS Analytics V2, Dashplot .

To migrate from 3.3.8 to 3.4.0, run:

Bash
    
xxxxxxxxxx
 
accelo migrate -v 3.4.0 -i 3.3.8 -b
Copy

For Multi-Cluster:

Bash
    
xxxxxxxxxx
 
accelo migrate -v 3.4.0 -i 3.3.8 -a -b
Copy

Handle Migration Issues:

If any issues occur during migration, rerun the same command.

Restart Containers:

Restart all containers to use the updated images:

Bash
    
xxxxxxxxxx
 
accelo restart all -d
Copy

Uninstall Hydra Agent:

Run the following command:

Bash
    
xxxxxxxxxx
 
accelo uninstall remote
Copy

Install Hydra Agent:

Run the following command:

Bash
    
xxxxxxxxxx
 
accelo deploy hydra
Copy

Reconfigure Cluster:

To get the updated configuration for agents, run:

Bash
    
xxxxxxxxxx
 
accelo reconfig cluster -a
Copy

Push Updated Configuration to Database:

Run the following command:

Bash
    
xxxxxxxxxx
 
accelo admin database push-config -a
Copy

Configure MongoDB Cleanup & Compaction:

To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

Bash
    
xxxxxxxxxx
 
accelo config retention
Copy

Create Indices for Database Collections:

Finally, run the following command:

Bash
    
xxxxxxxxxx
 
accelo admin database index-db
Copy

Migration Steps from Version 3.0.X to 3.4.0

Cluster Specific Changes

The following components are introduced in version 3.4.0 and are not present in version 3.0.X:

ad-events
ad-gauntlet

To accommodate the ad-events component, you need to make certain changes related to hooks on the cluster side. For configuring Hive/Tez hooks, refer to the document, [Configure HDP for Pulse Deployment](Configure HDP for Pulse Deployment).

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

Update Configuration:

Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.0.

Push Updated Configuration to Database:

Run the following command:

Bash
    
xxxxxxxxxx
 
accelo admin database push-config
Copy

Download Necessary Images:
- Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.0, including:

Bash
    
xxxxxxxxxx
 
191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-4.4.20191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-5.0.16
Copy

Update Accelo Binary:
- Download the new Accelo binary.
- Replace the older Accelo binary with the new one.
Run Migration Command:

To migrate from 3.0.16 to 3.4.0, run:

Bash
    
xxxxxxxxxx
 
accelo migrate -v 3.4.0 -i 3.0.16 -b
Copy

For Multi-Cluster:

Bash
    
xxxxxxxxxx
 
accelo migrate -v 3.4.0 -i 3.0.16 -a -b
Copy

Important Do not change the value of -v from 3.4.0 unless explicitly advised by Engineering.

Handle Migration Issues:

If any issues occur during migration, rerun the same command.

Generate Notifications Configuration:

Note Skip this step on nodes that don't have Core services running on them.
After migration completes successfully, generate notifications.yml by running:

Bash
    
xxxxxxxxxx
 
accelo config actions notifications
Copy

Deploy Core Containers:
- Note Skip this step on nodes that don't have Core services running on them.
- Deploy all core containers by running:

Bash
    
xxxxxxxxxx
 
accelo deploy core
Copy

If you see the following error, just answer y and proceed:

Bash
    
xxxxxxxxxx
 
ERROR: Looks like core setup is missing the services '[ad-events ad-gauntlet]' from the stack 'default'.
Copy

Restart Containers:
- Restart all containers to use the updated images:

Bash
    
xxxxxxxxxx
 
accelo restart all -d
Copy

Uninstall Hydra Agent:

Run the following command:

Bash
    
xxxxxxxxxx
 
accelo uninstall remote
Copy

Install Hydra Agent:
- Run the following command:

Bash
    
xxxxxxxxxx
 
accelo deploy hydra
Copy

Reconfigure Cluster:
- To get the updated configuration for agents, run:

Bash
    
xxxxxxxxxx
 
accelo reconfig cluster -a
Copy

Push Updated Configuration to Database:
- Run the following command:

Bash
    
xxxxxxxxxx
 
accelo admin database push-config -a
Copy

Configure MongoDB Cleanup & Compaction:
- To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

Bash
    
xxxxxxxxxx
 
accelo config retention
Copy

Create Indices for Database Collections:
- Finally, run the following command:

Bash
    
xxxxxxxxxx
 
accelo admin database index-db
Copy

Migration Steps from Version 3.2.X to 3.4.0

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

Update Configuration:

Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.0.

Push Updated Configuration to Database:

Run the following command:

Bash
    
xxxxxxxxxx
 
accelo admin database push-config
Copy

Download Necessary Images:

Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.0, including:

Bash
    
xxxxxxxxxx
 
191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-4.4.20191579300362.dkr.ecr.us-east-1.amazonaws.com/acceldata/ad-database:migrate-5.0.16
Copy

Update Accelo Binary:

Download the new Accelo binary.
Replace the older Accelo binary with the new one.

Run Migration Command:

To migrate from 3.2.14 to 3.4.0, run:

Bash
    
xxxxxxxxxx
 
accelo migrate -v 3.4.0 -i 3.2.14 -b
Copy

For Multi-Cluster:

Bash
    
xxxxxxxxxx
 
accelo migrate -v 3.4.0 -i 3.2.14 -a -b
Copy

Handle Migration Issues:

If any issues occur during migration, rerun the same command.

Restart Containers:

Restart all containers to use the updated images:

Bash
    
Copy

Uninstall Hydra Agent:

Run the following command:

Bash
    
Copy

Install Hydra Agent:

Run the following command:

Bash
    
Copy

Reconfigure Cluster:

To get the updated configuration for agents, run:

Bash
    
Copy

Push Updated Configuration to Database:

Run the following command:

Bash
    
Copy

Configure MongoDB Cleanup & Compaction:

To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

Bash
    
Copy

Create Indices for Database Collections:

Finally, run the following command:

Bash
    
Copy

Migration Steps from Version 3.3.2X to 3.4.0

Pulse Upgrade Steps (Core Services Server / Addon Services Server)

Update Configuration:

Update the ImageTag in the $AcceloHome/config/accelo.yml file to 3.4.0.

Push Updated Configuration to Database:

Run the following command:

Bash
    
Copy

Download Necessary Images:

Ensure you have downloaded or loaded all the necessary Docker images for version 3.4.0.

Update Accelo Binary:

Download the new Accelo binary.
Replace the older Accelo binary with the new one.

Run Migration Command:

Make sure you run the command from $AcceloHome.
Do not change the value of -v from 3.4.0 unless explicitly advised by Engineering. The following command needs to run on all Pulse nodes including standalone nodes i.e. nodes where PULSE_SA_NODE is true. Examples of such nodes include but aren’t limited to Logsearch, FS Analytics V2, Dashplot .

To migrate from 3.3.20 to 3.4.0, run:

Bash
    
Copy

For Multi-Cluster:

Bash
    
Copy

Handle Migration Issues:

If any issues occur during migration, rerun the same command.

Restart Containers:

Restart all containers to use the updated images:

Bash
    
Copy

Uninstall Hydra Agent:

Run the following command:

Bash
    
Copy

Install Hydra Agent:

Run the following command:

Bash
    
Copy

Reconfigure Cluster:

To get the updated configuration for agents, run:

Bash
    
Copy

Push Updated Configuration to Database:

Run the following command:

Bash
    
Copy

Configure MongoDB Cleanup & Compaction:

To configure when Gauntlet Snap will run MongoDB cleanup and compaction, run:

Bash
    
Copy

Create Indices for Database Collections:

Finally, run the following command:

Bash
    
Copy

Last updated on

Was this page helpful?