Upgrade to Version 3.8.1
Prerequisite
Upgrade the Docker version to 20.10.x or above.
Steps to upgrade the Docker version:
- Uninstall the current Docker:
yum remove -y docker-ce docker-ce-cli containerd.io- Install the latest version of Docker:
yum install -y docker-ce docker-ce-cli containerd.io- To install a specific version of Docker:
yum install -y docker-ce-24.0.5 docker-ce-cli-24.0.5 containerd.io- Replace 24.0.5 with the appropriate version string
- To list specific versions of docker
yum list docker-ce --showduplicates | sort -r- Start Docker:
systemctl start dockerMigration Steps from Version 3.8.0 to 3.8.1
Follow these steps to upgrade Pulse.
Update Configuration:
- Update
ImageTagin the$AcceloHome/config/accelo.ymlfile to3.8.1.
- Update
Push Updated Configuration to Database:
- Run the following command:
accelo admin database push-config -a- Take a backup of the
accelofile and download the latest version foraccelo.linuxCLI. - Move and make the latest
acceloCLI file as an executable. Also, check the updated Pulse information for the following.
mv accelo.linux accelochmod +x ./accelo- For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login dockeraccelo pull all- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images.
docker load -i- Run the command below to update and add new keys in
vars.yml.
accelo reconfig cluster- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt- Enter the plain-text password to generate the encrypted password.
- Update the
bindPWfield in/data01/acceldata/config/ldap/ldap.confwith the encrypted value and add theencryptedPassword = trueflag in the same configuration file.
- Run the below command to push
acceldata.confand other updated files to MongoDB.
accelo admin database push-config- Restart all containers, including database(s,) with the following command.
accelo restart all -d- Uninstall the Hydra Agent.
accelo uninstall remote- Install the Hydra Agent.
accelo deploy hydra- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the
$AcceloHome/config/acceldata_<clustername>.conffile in the following format:
spark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group { ...<irrelevant content> configuration = { ...<irrelevant content> spark.standalone.enable = true spark.standalone.urls = "http://host1:8080,http://host2:8081," spark.worker.urls = "http://host1:8081,http://host2:8082," spark.history.server.url = "http://host1:18080,http://host2:18080" ...<irrelevant content> }}If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.
- Reconfigure the cluster to get the updated configurations for Agents.
accelo reconfig cluster -aMigration Steps from Version 3.7.x to 3.8.1
Follow these steps to upgrade Pulse.
- Take a backup of the
accelofile and download the latest version foraccelo.linuxCLI. - Move and make the latest
acceloCLI file as an executable. Also, check the updated Pulse information for the following:
mv accelo.linux accelochmod +x ./accelo- Push the updated configuration to the database.
- Run the following command:
accelo admin database push-config -a- Follow the manual steps in the document below to update MongoDB to the latest version, 8.0.8.
For information about migrating MongoDB manually, see Upgrade MongoDB Manually.
Update Configuration:
- Update
ImageTagin the$AcceloHome/config/accelo.ymlfile to3.8.1.
- Update
For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login dockeraccelo pull all- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images
docker load -i- Run the command below to update and add new keys in
vars.yml
accelo reconfig clusterIf your ODP cluster has Kafka 3 installed, run accelo config cluster before performing this step.
- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt- Enter the plain-text password to generate the encrypted password.
- Update the
bindPWfield in/data01/acceldata/config/ldap/ldap.confwith the encrypted value and add theencryptedPassword = trueflag in the same configuration file.
- Run the below command to push
acceldata.confand other updated files to MongoDB.
accelo admin database push-configOnce the above command is executed, move the license from the local work directory to a backup directory.
Ensure that you do not change the value of v from 3.8.0 to anything else unless explicitly advised by Acceldata. The following command needs to be run on all the Pulse nodes, including standalone nodes, i.e., nodes where PULSE_SA_NODE is true. The examples of such nodes include, but aren’t limited to, Logsearch, FS Analytics V2, and Dashplot.
- Run the migration command. For example:
-v 3.8.0: The version you are migrating to.Note Keep the version as-v 3.8.0, even when you are migrating to any update release version in 3.8.x.-i 3.7.0: The version you are migrating from.- To migrate from version 3.7.0 to 3.8.1, the migration command looks as shown below.
Ensure that you run the following command from $AcceloHome.
For a single cluster:
accelo migrate -v 3.8.0 -i 3.7.0 -bFor multi-cluster:
accelo migrate -v 3.8.0 -i 3.7.0 -a -b- Run the same command again if any issue occurs during migration on any step.
- Restart all the containers so that they use the updated images
accelo restart all -d- Uninstall the Hydra Agent.
accelo uninstall remote- Install the Hydra Agent.
accelo deploy hydra- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the
$AcceloHome/config/acceldata_<clustername>.conffile in the following format.
spark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group { ...<irrelevant content> configuration = { ...<irrelevant content> spark.standalone.enable = true spark.standalone.urls = "http://host1:8080,http://host2:8081," spark.worker.urls = "http://host1:8081,http://host2:8082," spark.history.server.url = "http://host1:18080,http://host2:18080" ...<irrelevant content> }}If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.
- Reconfigure the cluster to get the updated configuration for Agents.
accelo reconfig cluster -a- To push the updated configuration to database, execute the following command.
accelo admin database push-config -a- To configure when
gauntlet snapmust run the MongoDB cleanup and compaction, run the following command.
accelo config retention- Finally, execute the following command to create indices for database collections.
If readOnlyRootFSEnabled is set to true in $AcceloHome/config/accelo.yml, then follow the steps listed below instead of running the command directly.1. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to false.2. Run accelo admin database push-config 3. Run accelo restart all -d.4. Run accelo admin database index-db.5. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to true.6. Run accelo admin database push-config.7. Run accelo restart all -d.accelo admin database index-db- If the older playbooks are already present in the node where Ad-Director is deployed, delete them, and download the latest playbooks tar from the License UI.
- Delete the older playbooks using the command:
rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace<cluster_name>with the name of the cluster where the playbooks are present. - Download the playbooks tar from the License UI. For details, see Deploy Playbooks.
- Delete the older playbooks using the command:
Migration Steps from Version 3.6.x to 3.8.1
Follow these steps to upgrade Pulse.
- Take a backup of the
accelofile and download the latest version foraccelo.linuxCLI. - Move and make the latest
acceloCLI file as an executable. Also, check the updated Pulse information for the following:
mv accelo.linux accelochmod +x ./accelo- Run the following command to push the updated configuration to the database.
accelo admin database push-config -a- Follow the manual steps in the document below to update MongoDB to the latest version, 8.0.8.
For information about migrating MongoDB manually, see Upgrade MongoDB Manually.
Update Configuration:
- Update
ImageTagin the$AcceloHome/config/accelo.ymlfile to3.8.1.
- Update
For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login dockeraccelo pull all- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images
docker load -i- Run the command below to update and add new keys in
vars.yml
accelo reconfig clusterIf your ODP cluster has Kafka 3 installed, run accelo config cluster before performing this step.
- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt- Enter the plain-text password to generate the encrypted password.
- Update the
bindPWfield in/data01/acceldata/config/ldap/ldap.confwith the encrypted value and add theencryptedPassword = trueflag in the same configuration file.
- Run the below command to push
acceldata.confand other updated files to MongoDB.
accelo admin database push-configOnce the above command is executed, move the license from local work directory to a backup directory.
Ensure that you do not change the value of v from 3.8.0 to anything else unless explicitly advised by Acceldata. The following command needs to be run on all the Pulse nodes, including standalone nodes i.e., nodes where PULSE_SA_NODE is true. The examples of such nodes include, but aren’t limited to, LogSearch, FS Analytics V2, and Dashplot.
- Run the migration command. For example:
-v 3.8.0: The version you are migrating to.Note Keep the version as-v 3.8.0, even when you are migrating to any update release version in 3.8.x.-i 3.6.6: The version you are migrating from.- To migrate from version 3.6.6 to 3.8.1, the migration command looks as shown below.
Ensure that you run the following command from $AcceloHome.
For a single cluster:
accelo migrate -v 3.8.0 -i 3.6.6 -bFor multi-cluster:
accelo migrate -v 3.8.0 -i 3.6.6 -a -b- Run the same command again if any issue occurs during migration on any step.
- Restart all the containers so that they use the updated images
accelo restart all -d- Uninstall the Hydra Agent.
accelo uninstall remote- Install the Hydra Agent.
accelo deploy hydra- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the
$AcceloHome/config/acceldata_<clustername>.conffile in the following format.
Bash+ xspark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group { ...<irrelevant content> configuration = { ...<irrelevant content> spark.standalone.enable = true spark.standalone.urls = "http://host1:8080,http://host2:8081," spark.worker.urls = "http://host1:8081,http://host2:8082," spark.history.server.url = "http://host1:18080,http://host2:18080" ...<irrelevant content> }}If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.
- Reconfigure the cluster to get the updated configuration for Agents.
accelo reconfig cluster -a- To push the updated configuration to the database, execute the following command.
accelo admin database push-config -a- To push the updated configuration to the database, execute the following command.
accelo config retention- Finally, execute the following command to create indices for database collections.
If readOnlyRootFSEnabled is set to true in $AcceloHome/config/accelo.yml, then follow the steps listed below instead of running the command directly.1. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to false.2. Run accelo admin database push-config 3. Run accelo restart all -d.4. Run accelo admin database index-db.5. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to true.6. Run accelo admin database push-config.7. Run accelo restart all -d.accelo admin database index-db- If the older playbooks are already present in the node where ad-director is deployed, delete them, and download the latest playbooks tar from the License UI.
- Delete the older playbooks using the command:
rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace<cluster_name>with the name of the cluster where the playbooks are present. - Download the playbooks tar from the License UI. For details, see Deploy Playbooks.
- Delete the older playbooks using the command: