Upgrade to Version 3.8.3
Prerequisite
Upgrade the Docker version to 20.10.x or above.
Steps to upgrade the Docker version:
- Uninstall the current Docker:
yum remove -y docker-ce docker-ce-cli containerd.io- Install the latest version of Docker:
yum install -y docker-ce docker-ce-cli containerd.io- To install a specific version of Docker:
yum install -y docker-ce-24.0.5 docker-ce-cli-24.0.5 containerd.io- Replace 24.0.5 with the appropriate version string
- To list specific versions of docker
yum list docker-ce --showduplicates | sort -r- Start Docker:
systemctl start dockerMigration Steps from Version 3.8.0 to 3.8.3
Follow these steps to upgrade Pulse.
Update Configuration:
- Update
ImageTagin the$AcceloHome/config/accelo.ymlfile to3.8.3.
- Update
Push Updated Configuration to Database:
- Run the following command:
accelo admin database push-config -a- Take a backup of the
accelofile and download the latest version foraccelo.linuxCLI. - Move and make the latest
acceloCLI file as an executable. Also, check the updated Pulse information for the following.
mv accelo.linux accelochmod +x ._accelo- For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login dockeraccelo pull all- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images.
docker load -i- Run the command below to update and add new keys in
vars.yml.
accelo reconfig cluster- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt- Enter the plain-text password to generate the encrypted password.
- Update the
bindPWfield in/data01/acceldata/config/ldap/ldap.confwith the encrypted value and add theencryptedPassword = trueflag in the same configuration file.
- Run the below command to push
acceldata.confand other updated files to MongoDB.
accelo admin database push-config- Restart all containers, including database(s,) with the following command.
accelo restart all -d- Uninstall the Hydra Agent.
accelo uninstall remote- Install the Hydra Agent.
accelo deploy hydra- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the
$AcceloHome/config/acceldata_<clustername>.conffile in the following format:
spark.worker.urls = "<http_s>:__<FQDN>:<port>,<http_s>:__<FQDN>:<port>"For example:
spark.worker.urls = "http:__host1:8082,http:__host2:8082"Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group { ...<irrelevant content> configuration = { ...<irrelevant content> spark.standalone.enable = true spark.standalone.urls = "http:__host1:8080,http:__host2:8081," spark.worker.urls = "http:__host1:8081,http:__host2:8082," spark.history.server.url = "http:__host1:18080,http:__host2:18080" ...<irrelevant content> }}If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNCSPARKMASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.
- Reconfigure the cluster to get the updated configurations for Agents.
accelo reconfig cluster -aMigration Steps from Version 3.7.x to 3.8.3
Follow these steps to upgrade Pulse.
- Take a backup of the
accelofile and download the latest version foraccelo.linuxCLI. - Move and make the latest
acceloCLI file as an executable. Also, check the updated Pulse information for the following:
mv accelo.linux accelochmod +x ._accelo- Push the updated configuration to the database.
- Run the following command:
accelo admin database push-config -a- Follow the manual steps in the document below to update MongoDB to the latest version, 8.0.8.
For information about migrating MongoDB manually, see Upgrade MongoDB Manually.
Update Configuration:
- Update
ImageTagin the$AcceloHome/config/accelo.ymlfile to3.8.3.
- Update
For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login dockeraccelo pull all- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images
docker load -i- Run the command below to update and add new keys in
vars.yml
accelo reconfig cluster> If your ODP cluster has Kafka 3 installed, run accelo config cluster before performing this step.
- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt- Enter the plain-text password to generate the encrypted password.
- Update the
bindPWfield in/data01/acceldata/config/ldap/ldap.confwith the encrypted value and add theencryptedPassword = trueflag in the same configuration file.
- Run the below command to push
acceldata.confand other updated files to MongoDB.
accelo admin database push-configOnce the above command is executed, move the license from the local work directory to a backup directory.
Ensure that you do not change the value of v from 3.8.0 to anything else unless explicitly advised by Acceldata. The following command needs to be run on all the Pulse nodes, including standalone nodes, i.e., nodes where PULSESANODE is true. The examples of such nodes include, but aren’t limited to, Logsearch, FS Analytics V2, and Dashplot.
- Run the migration command. For example:
-v 3.8.0: The version you are migrating to. Note Keep the version as-v 3.8.0, even when you are migrating to any update release version in 3.8.x.-i 3.7.0: The version you are migrating from.- To migrate from version 3.7.0 to 3.8.3, the migration command looks as shown below.
Ensure that you run the following command from $AcceloHome.
For a single cluster:
accelo migrate -v 3.8.0 -i 3.7.0 -bFor multi-cluster:
accelo migrate -v 3.8.0 -i 3.7.0 -a -b- Run the same command again if any issue occurs during migration on any step.
- Restart all the containers so that they use the updated images
accelo restart all -d- Uninstall the Hydra Agent.
accelo uninstall remote- Install the Hydra Agent.
accelo deploy hydra- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the
$AcceloHome/config/acceldata_<clustername>.conffile in the following format.
spark.worker.urls = "<http_s>:__<FQDN>:<port>,<http_s>:__<FQDN>:<port>"For example:
spark.worker.urls = "http:__host1:8082,http:__host2:8082"Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group { ...<irrelevant content> configuration = { ...<irrelevant content> spark.standalone.enable = true spark.standalone.urls = "http:__host1:8080,http:__host2:8081," spark.worker.urls = "http:__host1:8081,http:__host2:8082," spark.history.server.url = "http:__host1:18080,http:__host2:18080" ...<irrelevant content> }}If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNCSPARKMASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.
- Reconfigure the cluster to get the updated configuration for Agents.
accelo reconfig cluster -a- To push the updated configuration to the database, execute the following command.
accelo admin database push-config -a- To configure when
gauntlet snapmust run the MongoDB cleanup and compaction, run the following command.
accelo config retention- Finally, execute the following command to create indices for database collections.
If readOnlyRootFSEnabled is set to true in $AcceloHome_config_accelo.yml, then follow the steps listed below instead of running the command directly.1. Open $AcceloHome_config_accelo.yml and set the value of readOnlyRootFSEnabled to false.2. Run accelo admin database push-config 3. Run accelo restart all -d.4. Run accelo admin database index-db.5. Open $AcceloHome_config_accelo.yml and set the value of readOnlyRootFSEnabled to true.6. Run accelo admin database push-config.7. Run accelo restart all -d.accelo admin database index-db- If the older playbooks are already present in the node where Ad-Director is deployed, delete them, and download the latest playbooks tar from the License UI.
- Delete the older playbooks using the command:
rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace<cluster_name>with the name of the cluster where the playbooks are present. - Download the playbooks tar from the License UI. For details, see Deploy Playbooks.
- Delete the older playbooks using the command:
Migration Steps from Version 3.6.x to 3.8.3
Follow these steps to upgrade Pulse.
- Take a backup of the
accelofile and download the latest version foraccelo.linuxCLI. - Move and make the latest
acceloCLI file as an executable. Also, check the updated Pulse information for the following:
mv accelo.linux accelochmod +x ._accelo- Run the following command to push the updated configuration to the database.
accelo admin database push-config -a- Follow the manual steps in the document below to update MongoDB to the latest version, 8.0.8.
For information about migrating MongoDB manually, see Upgrade MongoDB Manually.
Update Configuration:
- Update
ImageTagin the$AcceloHome/config/accelo.ymlfile to3.8.3.
- Update
For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login dockeraccelo pull all- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images
docker load -i- Run the command below to update and add new keys in
vars.yml
accelo reconfig cluster> If your ODP cluster has Kafka 3 installed, run accelo config cluster before performing this step.
- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt- Enter the plain-text password to generate the encrypted password.
- Update the
bindPWfield in/data01/acceldata/config/ldap/ldap.confwith the encrypted value and add theencryptedPassword = trueflag in the same configuration file.
- Run the below command to push
acceldata.confand other updated files to MongoDB.
accelo admin database push-configOnce the above command is executed, move the license from local work directory to a backup directory.
Ensure that you do not change the value of v from 3.8.0 to anything else unless explicitly advised by Acceldata. The following command needs to be run on all the Pulse nodes, including standalone nodes i.e., nodes where PULSESANODE is true. The examples of such nodes include, but aren’t limited to, LogSearch, FS Analytics V2, and Dashplot.
- Run the migration command. For example:
-v 3.8.0: The version you are migrating to. Note Keep the version as-v 3.8.0, even when you are migrating to any update release version in 3.8.x.-i 3.6.6: The version you are migrating from.- To migrate from version 3.6.6 to 3.8.3, the migration command looks as shown below.
Ensure that you run the following command from $AcceloHome.
For a single cluster:
accelo migrate -v 3.8.0 -i 3.6.6 -bFor multi-cluster:
accelo migrate -v 3.8.0 -i 3.6.6 -a -b- Run the same command again if any issue occurs during migration on any step.
- Restart all the containers so that they use the updated images
accelo restart all -d- Uninstall the Hydra Agent.
accelo uninstall remote- Install the Hydra Agent.
accelo deploy hydra- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the
$AcceloHome/config/acceldata_<clustername>.conffile in the following format.
Bash+ xspark.worker.urls = "<http_s>:__<FQDN>:<port>,<http_s>:__<FQDN>:<port>"For example:
spark.worker.urls = "http:__host1:8082,http:__host2:8082"Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group { ...<irrelevant content> configuration = { ...<irrelevant content> spark.standalone.enable = true spark.standalone.urls = "http:__host1:8080,http:__host2:8081," spark.worker.urls = "http:__host1:8081,http:__host2:8082," spark.history.server.url = "http:__host1:18080,http:__host2:18080" ...<irrelevant content> }}If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNCSPARKMASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.
- Reconfigure the cluster to get the updated configuration for Agents.
accelo reconfig cluster -a- To push the updated configuration to the database, execute the following command.
accelo admin database push-config -a- To push the updated configuration to the database, execute the following command.
accelo config retention- Finally, execute the following command to create indices for database collections.
If readOnlyRootFSEnabled is set to true in $AcceloHome_config_accelo.yml, then follow the steps listed below instead of running the command directly.1. Open $AcceloHome_config_accelo.yml and set the value of readOnlyRootFSEnabled to false.2. Run accelo admin database push-config 3. Run accelo restart all -d.4. Run accelo admin database index-db.5. Open $AcceloHome_config_accelo.yml and set the value of readOnlyRootFSEnabled to true.6. Run accelo admin database push-config.7. Run accelo restart all -d.accelo admin database index-db- If the older playbooks are already present in the node where ad-director is deployed, delete them, and download the latest playbooks tar from the License UI.
- Delete the older playbooks using the command:
rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace<cluster_name>with the name of the cluster where the playbooks are present. - Download the playbooks tar from the License UI. For details, see Deploy Playbooks.
- Delete the older playbooks using the command: