Upgrade to Version 3.8.1
Prerequisite
Upgrade the Docker version to 20.10.x or above.
Steps to upgrade the Docker version:
- Uninstall the current Docker:
yum remove -y docker-ce docker-ce-cli containerd.io
- Install the latest version of Docker:
yum install -y docker-ce docker-ce-cli containerd.io
- To install a specific version of Docker:
yum install -y docker-ce-24.0.5 docker-ce-cli-24.0.5 containerd.io
- Replace 24.0.5 with the appropriate version string
- To list specific versions of docker
yum list docker-ce --showduplicates | sort -r
- Start Docker:
systemctl start docker
Migration Steps from Version 3.8.0 to 3.8.1
Follow these steps to upgrade Pulse.
Update Configuration:
- Update
ImageTag
in the$AcceloHome/config/accelo.yml
file to3.8.1
.
- Update
Push Updated Configuration to Database:
- Run the following command:
accelo admin database push-config -a
- Take a backup of the
accelo
file and download the latest version foraccelo.linux
CLI. - Move and make the latest
accelo
CLI file as an executable. Also, check the updated Pulse information for the following.
mv accelo.linux accelo
chmod +x ./accelo
- For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login docker
accelo pull all
- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images.
docker load -i
- Run the command below to update and add new keys in
vars.yml.
accelo reconfig cluster
- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt
- Enter the plain-text password to generate the encrypted password.
- Update the
bindPW
field in/data01/acceldata/config/ldap/ldap.conf
with the encrypted value add theencryptedPassword = true
flag in the same configuration file.
- Run the below command to push
acceldata.conf
and other updated files to MongoDB.
accelo admin database push-config
- Restart all containers, including database(s,) with the following command.
accelo restart all -d
- Uninstall the Hydra Agent.
accelo uninstall remote
- Install the Hydra Agent.
accelo deploy hydra
- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the
$AcceloHome/config/acceldata_<clustername>.conf
file in the following format:
spark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"
For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"
Add the above field in group.configuration
in the $AcceloHome/config/acceldata_<clustername>.conf
file. The group.configuration
section should be in the following format:
group {
...<irrelevant content>
configuration = {
...<irrelevant content>
spark.standalone.enable = true
spark.standalone.urls = "http://host1:8080,http://host2:8081,"
spark.worker.urls = "http://host1:8081,http://host2:8082,"
spark.history.server.url = "http://host1:18080,http://host2:18080"
...<irrelevant content>
}
}
If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true"
to the /etc/profile.d/ad.sh
file and run source /etc/profile.d/ad.sh
to apply the changes.
- Reconfigure the cluster to get the updated configurations for Agents.
accelo reconfig cluster -a
Migration Steps from Version 3.7.x to 3.8.1
Follow these steps to upgrade Pulse.
- Take a backup of the
accelo
file and download the latest version foraccelo.linux
CLI. - Move and make the latest
accelo
CLI file as an executable. Also, check the updated Pulse information for the following:
mv accelo.linux accelo
chmod +x ./accelo
- Push the updated configuration to the database.
- Run the following command:
accelo admin database push-config -a
- Run the following command to update the MongoDB to the latest version 8.0.8.
accelo admin database migrate
For more information about migrating MongoDB, see Migrate MongoDB from Version 6.0.X to 8.0.X.
Update Configuration:
- Update
ImageTag
in the$AcceloHome/config/accelo.yml
file to3.8.1
.
- Update
For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login docker
accelo pull all
- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images
docker load -i
- Run the command below to update and add new keys in
vars.yml
accelo reconfig cluster
- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt
- Enter the plain-text password to generate the encrypted password.
- Update the
bindPW
field in/data01/acceldata/config/ldap/ldap.conf
with the encrypted value add theencryptedPassword = true
flag in the same configuration file.
- Run the below command to push
acceldata.conf
and other updated files to MongoDB.
accelo admin database push-config
Once the above command is executed, move the license from the local work
directory to a backup directory.
Ensure that you do not change the value of v
from 3.8.0 to anything else unless explicitly advised by Acceldata. The following command needs to be run on all the Pulse nodes, including standalone nodes, i.e., nodes where PULSE_SA_NODE
is true. The examples of such nodes include, but aren’t limited to, Logsearch, FS Analytics V2, and Dashplot.
- Run the migration command. For example:
-v 3.8.0
: The version you are migrating to.Note Keep the version as-v 3.8.0
, even when you are migrating to any update release version in 3.8.x.-i 3.7.0
: The version you are migrating from.- To migrate from version 3.7.0 to 3.8.1, the migration command looks as shown below.
Ensure that you run the following command from $AcceloHome.
For a single cluster:
accelo migrate -v 3.8.0 -i 3.7.0 -b
For multi-cluster:
accelo migrate -v 3.8.0 -i 3.7.0 -a -b
- Run the same command again if any issue occurs during migration on any step.
- Restart all the containers so that they use the updated images
accelo restart all -d
- Uninstall the Hydra Agent.
accelo uninstall remote
- Install the Hydra Agent.
accelo deploy hydra
- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the
$AcceloHome/config/acceldata_<clustername>.conf
file in the following format.
spark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"
For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"
Add the above field in group.configuration
in the $AcceloHome/config/acceldata_<clustername>.conf
file. The group.configuration
section should be in the following format:
group {
...<irrelevant content>
configuration = {
...<irrelevant content>
spark.standalone.enable = true
spark.standalone.urls = "http://host1:8080,http://host2:8081,"
spark.worker.urls = "http://host1:8081,http://host2:8082,"
spark.history.server.url = "http://host1:18080,http://host2:18080"
...<irrelevant content>
}
}
If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true"
to the /etc/profile.d/ad.sh
file and run source /etc/profile.d/ad.sh
to apply the changes.
- Reconfigure the cluster to get the updated configuration for Agents.
accelo reconfig cluster -a
If your ODP cluster has Kafka 3 installed, you need to run accelo config cluster
before performing this step.
- To push the updated configuration to database, execute the following command.
accelo admin database push-config -a
- To configure when
gauntlet snap
must run the MongoDB cleanup and compaction, run the following command.
accelo config retention
- Finally, execute the following command to create indices for database collections.
If readOnlyRootFSEnabled is set to true in $AcceloHome/config/accelo.yml, then follow the steps listed below instead of running the command directly.
1. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to false.
2. Run accelo admin database push-config
3. Run accelo restart all -d.
4. Run accelo admin database index-db.
5. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to true.
6. Run accelo admin database push-config.
7. Run accelo restart all -d.
accelo admin database index-db
- If the older playbooks are already present in the node where Ad-Director is deployed, delete them, and download the latest playbooks tar from the License UI.
- Delete the older playbooks using the command:
rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.
Replace<cluster_name>
with the name of the cluster where the playbooks are present. - Download the playbooks tar from the License UI. For details, see Deploy Playbooks.
- Delete the older playbooks using the command:
Migration Steps from Version 3.6.x to 3.8.1
Follow these steps to upgrade Pulse.
- Take a backup of the
accelo
file and download the latest version foraccelo.linux
CLI. - Move and make the latest
accelo
CLI file as an executable. Also, check the updated Pulse information for the following:
mv accelo.linux accelo
chmod +x ./accelo
- Run the following command to push the updated configuration to the database.
accelo admin database push-config -a
- Run the following command to update the MongoDB to the latest version 8.0.8.
accelo admin database migrate
For more information about migrating MongoDB, see Migrate MongoDB from Version 6.0.X to 8.0.X.
Update Configuration:
- Update
ImageTag
in the$AcceloHome/config/accelo.yml
file to3.8.1
.
- Update
For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login docker
accelo pull all
- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images
docker load -i
- Run the command below to update and add new keys in
vars.yml
accelo reconfig cluster
- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt
- Enter the plain-text password to generate the encrypted password.
- Update the
bindPW
field in/data01/acceldata/config/ldap/ldap.conf
with the encrypted value add theencryptedPassword = true
flag in the same configuration file.
- Run the below command to push
acceldata.conf
and other updated files to MongoDB.
accelo admin database push-config
Once the above command is executed, move the license from local work
directory to a backup directory.
Ensure that you do not change the value of v
from 3.8.0 to anything else unless explicitly advised by Acceldata. The following command needs to be run on all the Pulse nodes, including standalone nodes i.e., nodes where PULSE_SA_NODE
is true. The examples of such nodes include, but aren’t limited to, LogSearch, FS Analytics V2, and Dashplot.
- Run the migration command. For example:
-v 3.8.0
: The version you are migrating to.Note Keep the version as-v 3.8.0
, even when you are migrating to any update release version in 3.8.x.-i 3.6.6
: The version you are migrating from.- To migrate from version 3.6.6 to 3.8.1, the migration command looks as shown below.
Ensure that you run the following command from $AcceloHome.
For a single cluster:
accelo migrate -v 3.8.0 -i 3.6.6 -b
For multi-cluster:
accelo migrate -v 3.8.0 -i 3.6.6 -a -b
- Run the same command again if any issue occurs during migration on any step.
- Restart all the containers so that they use the updated images
accelo restart all -d
- Uninstall the Hydra Agent.
accelo uninstall remote
- Install the Hydra Agent.
accelo deploy hydra
- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the
$AcceloHome/config/acceldata_<clustername>.conf
file in the following format.
Bash+ xspark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"
For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"
Add the above field in group.configuration
in the $AcceloHome/config/acceldata_<clustername>.conf
file. The group.configuration
section should be in the following format:
group {
...<irrelevant content>
configuration = {
...<irrelevant content>
spark.standalone.enable = true
spark.standalone.urls = "http://host1:8080,http://host2:8081,"
spark.worker.urls = "http://host1:8081,http://host2:8082,"
spark.history.server.url = "http://host1:18080,http://host2:18080"
...<irrelevant content>
}
}
If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true"
to the /etc/profile.d/ad.sh
file and run source /etc/profile.d/ad.sh
to apply the changes.
- Reconfigure the cluster to get the updated configuration for Agents.
accelo reconfig cluster -a
If your ODP cluster has Kafka 3 installed, you need to run accelo config cluster
before performing this step.
- To push the updated configuration to the database, execute the following command.
accelo admin database push-config -a
- To push the updated configuration to the database, execute the following command.
accelo config retention
- Finally, execute the following command to create indices for database collections.
If readOnlyRootFSEnabled is set to true in $AcceloHome/config/accelo.yml, then follow the steps listed below instead of running the command directly.
1. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to false.
2. Run accelo admin database push-config
3. Run accelo restart all -d.
4. Run accelo admin database index-db.
5. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to true.
6. Run accelo admin database push-config.
7. Run accelo restart all -d.
accelo admin database index-db
- If the older playbooks are already present in the node where ad-director is deployed, delete them, and download the latest playbooks tar from the License UI.
- Delete the older playbooks using the command:
rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.
Replace<cluster_name>
with the name of the cluster where the playbooks are present. - Download the playbooks tar from the License UI. For details, see Deploy Playbooks.
- Delete the older playbooks using the command: