Search
Before starting the Ambari and ODP upgrade, ensure that all cluster services are healthy and functioning as expected.
Prerequisites
Before performing the backup, verify that you have access to the Ambari server and the required permissions to execute scripts.
Configuration backup
- Clone the CE utilities repository:
git clone https://github.com/acceldata-io/ce-utils.git- Navigate to the ODP scripts directory and grant execute permission to the script.
cd ce-utils/ODP/scripts/chmod +x config_backup_restore.sh- Run the configuration backup script.
./config_backup_restore.shResponse
x
Usage: ./config_backup_restore.shCluster Name: odp32332-exp┌─────────────────────────────────────────────────┐│ Select an option: │├─────────────────────────────────────────────────┤[1] 🔄 Backup individual service configurations │[2] 🔄 Restore individual service configurations │└─────────────────────────────────────────────────┘Enter your choice [1-2]: 1Choosen [1]
│ Backup Service Configurations │└──────────────────────────────────────────────┘1) 🎨 Hue2) 🦌 Impala3) ☕ Kafka4) 🛡️ Ranger5) 🔑 Ranger KMS6) ⚡ Spark37) 🎛️ NiFi8) 🏷️ NiFi Registry9) 📜 Schema Registry10) 📂 HTTPFS11) 🐐 Kudu12) 📓 Jupyter13) 🦩 Flink14) 🧙 Druid15) 🌬️ Airflow16) 🌍 Ozone17) ☕ Kafka318) 🍷 Pinot19) 🏦 ClickHouse20) 🤖 MLflow21) 🔄 All (Backup configurations of all services like Hue, Impala, Kafka, Ranger, Ranger KMS, NiFi, NiFi Registry, Schema Registry, HTTPFS, Kudu, Jupyter, Flink, Druid, Airflow, Ozone, Pinot, Kafka3, ClickHouse, MLflow)Q) QuitEnter your choice [1-22, Q]: 21Choosen 'All':
The backup files are stored in the upgrade_backup/ directory under the current working directory.
Example:
ls -lrth upgrade_backup/Response:
[root@expup01 scripts]# ls upgrade_backup/admin-properties kudu-tablet-stable-advancedairflow-admin-site kudu-unstableairflow-api-site livy3-client-confairflow-atlas-site livy3-confairflow-celery-site livy3-envairflow-cli-site livy3-log4j-propertiesairflow-core-site livy3-spark-blacklistairflow-dask-site llama-siteairflow-database-site log4j2airflow-elasticsearch-site mlflow-confairflow-email-site nifi-ambari-configairflow-env nifi-ambari-ssl-configairflow-githubenterprise-site nifi-authorizers-envairflow-hive-site nifi-bootstrap-envairflow-kerberos-site nifi-bootstrap-notification-services-envairflow-kubernetes_executor-site nifi-envairflow-kubernetessecrets-site nifi-flow-envairflow-kubernetes-site nifi-login-identity-providers-envairflow-ldap-site nifi-propertiesairflow-lineage-site nifi-registry-ambari-configairflow-logging-site nifi-registry-ambari-ssl-configairflow-mesos-site nifi-registry-authorizers-envairflow-metrics-site nifi-registry-bootstrap-envairflow-openlineage-site nifi-registry-envairflow-operators-site nifi-registry-identity-providers-envairflow-scheduler-site nifi-registry-logback-envairflow-smtp-site nifi-registry-propertiesairflow-webserver-site nifi-registry-providers-envatlas-tagsync-ssl nifi-state-management-envclickhouse-application ozone-core-siteclickhouse-client-config ozone-envclickhouse-enable-keeper ozone-log4j-datanodeclickhouse-env ozone-log4j-omclickhouse-keeper-config ozone-log4j-propertiesclickhouse-macros ozone-log4j-reconclickhouse-network-and-logging ozone-log4j-s3gclickhouse-remote-servers ozone-log4j-scmclickhouse-server-config ozone-siteclickhouse-use-keeper ozone-ssl-clientclickhouse-users pinot-admin-log4j2cruise-control3 pinot-broker-confcruise-control3-capacity pinot-broker-log4j2cruise-control3-capacityCores pinot-controller-confcruise-control3-capacityJBOD pinot-controller-log4j2cruise-control3-clusterConfigs pinot-env......Backup Backend Databases
Before upgrading, create backups of all related service databases.
## for ambarimysqldump --databases ambari > ambari_mysql_db_backup.sql## for hivemysqldump --databases hive > hive_mysql_db_backup.sql## for ooziemysqldump --databases oozie > oozie_mysql_db_backup.sql## for rangermysqldump --databases ranger > ranger_mysql_db_backup.sql## for rangerkmsmysqldump --databases rangerkms > rangerkms_mysql_db_backup.sql## for druidmysqldump --databases druid > druid_mysql_db_backup.sql## for registrymysqldump --databases registry > registry_mysql_db_backup.sqlExample:
[root@expup01 ODP-server_db_bckp]# ls -lrthtotal 64M-rw-r--r-- 1 root root 56M Nov 4 12:15 ambari_mysql_db_backup.sql-rw-r--r-- 1 root root 266K Nov 4 12:15 hive_mysql_db_backup.sql-rw-r--r-- 1 root root 18K Nov 4 12:15 oozie_mysql_db_backup.sql-rw-r--r-- 1 root root 8.6M Nov 4 12:15 ranger_mysql_db_backup.sql-rw-r--r-- 1 root root 5.6K Nov 4 12:15 rangerkms_mysql_db_backup.sql-rw-r--r-- 1 root root 11K Nov 4 12:16 druid_mysql_db_backup.sql-rw-r--r-- 1 root root 777 Nov 4 12:16 nifi_mysql_db_backup.sql-rw-r--r-- 1 root root 14K Nov 4 12:17 registry_mysql_db_backup.sqlRemove Mpack Services from Ambari
Ensure to stop and delete all Mpack services from Ambari before the upgrade.
Stop and Delete Mpack Services
Was this page helpful?