Controlling ODP Services Manually

You must follow the precise order while starting and stopping the various ODP services.

Starting ODP Services

Make sure to start the Hadoop services in the prescribed order.

About this task

Ranger
ZooKeeper
HDFS
Yarn
HBase
Hive Metastore
HiveServer2
Oozie
Nifi
Kafka
Spark2
Impala
Knox

Procedure

Start Ranger. Execute the following commands on the Ranger host machine:

a. Ranger Admin

Bash
    
 
/usr/odp/current/ranger-admin/ews/ranger-admin-start
Copy

b. Ranger Usersync

Bash
    
 
/usr/odp/current/ranger-usersync/ranger-usersync-start
Copy

c. Ranger KMS

Bash
    
 
/usr/odp/current/ranger-kms/ranger-kms-services.sh start
Copy

Start ZooKeeper. Execute this command on the ZooKeeper host machine(s):

Bash
    
su - zookeeper -c "export ZOOCFGDIR=/usr/odp/current/zookeeper-server/ conf ; export ZOOCFG=zoo.cfg; source /usr/odp/current/zookeeper-server/ conf/zookeeper-env.sh ; /usr/odp/current/zookeeper-server/bin/zkServer.sh start
Copy

3. Start HDFS

If you are running NameNode HA (High Availability), start the JournalNodes by executing these commands on the JournalNode host machines where $HDFS_USER is the HDFS user.

Bash
    
 
su -l hdfs -c "/usr/odp/current/hadoop-hdfs-journalnode/../hadoop/sbin/ hadoop-daemon.sh start journalnode"
Copy

For example, hdfs.

Execute this command on the NameNode host machine(s):

Bash
    
 
su -l hdfs -c "/usr/odp/current/hadoop-hdfs-namenode/../hadoop/sbin/hadoop-daemon.sh start namenode"
Copy

If you are running NameNode HA, start the ZooKeeper Failover Controller (ZKFC) by executing the following command on all NameNode machines. The starting sequence of the ZKFCs determines which NameNode will become Active.

Bash
    
 
su -l hdfs -c "/usr/odp/current/hadoop-hdfs-namenode/../hadoop/sbin/ hadoop-daemon.sh start zkfc"
Copy

If you are not running NameNode HA, execute the following command on the Secondary NameNode host machine. If you are running NameNode HA, the Standby NameNode takes on the role of the Secondary NameNode.

Bash
    
 
su -l hdfs -c "/usr/odp/current/hadoop-hdfs-namenode/../hadoop/sbin/ hadoop-daemon.sh start secondarynamenode"
Copy

Execute these commands on all DataNodes:

Bash
    
 
su -l hdfs -c "/usr/odp/current/hadoop-hdfs-datanode/../hadoop/sbin/hadoop-daemon.sh start datanode"
Copy

Execute this Yarn command on the ResourceManager host machine(s):

Execute this command on the ResourceManager host machine(s):

Bash
    
 
su -l yarn -c "/usr/odp/current/hadoop-yarn-resourcemanager/sbin/yarn-daemon.sh start resourcemanager"
Copy

Execute this command on the History Server host machine:

Bash
    
 
su -l mapred -c "/usr/odp/current/hadoop-mapreduce-historyserver/sbin/mr-jobhistory-daemon.sh start historyserver"
Copy

Execute this command on the timeline server:

Bash
    
 
su -l yarn -c "/usr/odp/current/hadoop-yarn-timelineserver/sbin/yarn-daemon.sh start timelineserver"
Copy

Execute this command on all NodeManagers:

Bash
    
 
su -l yarn -c "/usr/odp/current/hadoop-yarn-nodemanager/sbin/yarn-daemon.sh start nodemanager"
Copy

Start HBase

Execute this command on the HBase Master host machine:

Bash
    
 
su -l hbase -c "/usr/odp/current/hbase-master/bin/hbase-daemon.sh start master; sleep 25"
Copy

Execute this command on all RegionServers:

Bash
    
 
su -l hbase -c "/usr/odp/current/hbase-regionserver/bin/hbase-daemon.sh start regionserver"
Copy

Start the Hive Metastore. On the Hive Metastore host machine, execute the following commands:

Bash
    
 
su $HIVE_USER nohup /usr/odp/current/hive-metastore/bin/hive --service metastore>/var/log/hive/hive.out 2>/var/log/hive/hive.log &
Copy

Where $HIVE_USER is the Hive user. For example, hive.

Start HiveServer2. On the Hive Server2 host machine, execute the following commands:

Bash
    
 
nohup /usr/odp/current/hive-server2/bin/hiveserver2
Copy

Where $HIVE_USER is the Hive user. For example, hive.

Start Oozie. Execute the following command on the Oozie host machine:

Bash
    
 
su -l oozie -c "/usr/odp/current/oozie-server/bin/oozied.sh start"
Copy

Start Kafka with the following commands:

Bash
    
​x
 
su $KAFKA_USER​/usr/odp/current/kafka-broker/bin/kafka start
Copy

where $KAFKA_USER is the operating system user that installed Kafka. For example, kafka.

Start Spark with the following commands:

a. History Server

Bash
    
 
su '$SPARK_USER'/usr/odp/current/spark2-historyserver/sbin/start-history-server.sh
Copy

b. Thrift Server

Bash
    
su '$SPARK_USER'/usr/odp/current/spark2-thriftserver/sbin/start-thriftserver.sh --properties-file /usr/odp/current/spark2-thriftserver/conf/spark-thrift-sparkconf.conf
Copy

Knox

Bash
    
 
su '$KNOX_USER'/usr/odp/current/knox-server/bin/gateway.sh start
Copy

Stopping ODP Services

Before performing any upgrades or uninstalling software, stop all of the Hadoop services in the prescribed order.

About this task

Ranger
Oozie
Spark
HiveServer2
Hive Metastore
HBase
YARN
HDFS
ZooKeeper
Kafka

Procedure

Stop Ranger. Execute the following commands on the Ranger host machine:

a. Ranger Admin

Bash
    
 
/usr/odp/current/ranger-admin/ews/ranger-admin-stop
Copy

b. Ranger Usersync

Bash
    
 
/usr/odp/current/ranger-usersync/ranger-usersync-stop
Copy

c. Ranger KMS

Bash
    
 
/usr/odp/current/ranger-kms/ranger-kms-services.sh stop
Copy

Stop Knox. Execute the following command on the Knox host machine.

Bash
    
 
su -l knox -c "/usr/odp/current/knox-server/bin/gateway.sh stop"
Copy

Stop Oozie. Execute the following command on the Oozie host machine.

Bash
    
 
su -l oozie -c "/usr/odp/current/oozie-server/bin/oozied.sh stop"
Copy

4. Stop Hive. Execute this command on the Hive Metastore and Hive Server2 host machine.

Bash
    
 
ps aux | awk '{print $1,$2}' | grep hive | awk '{print $2}' | xargs kill >/dev/null 2>&1
Copy

Stop HBase

Execute this command on all RegionServers:

Bash
    
 
su -l hbase -c "/usr/odp/current/hbase-regionserver/bin/hbase-daemon.sh stop regionserver"
Copy

Execute this command on the HBase Master host machine:

Bash
    
 
su -l hbase -c "/usr/odp/current/hbase-master/bin/hbase-daemon.sh stop master"
Copy

Stop YARN

Execute this command on all NodeManagers:

Bash
    
 
su -l yarn -c "/usr/odp/current/hadoop-yarn-nodemanager/sbin/yarn-daemon.sh stop nodemanager"
Copy

Execute this command on the History Server host machine:

Bash
    
 
su -l mapred -c "/usr/odp/current/hadoop-mapreduce-historyserver/sbin/mr-jobhistory-daemon.sh stop historyserver"
Copy

Execute this command on the timeline server host machine(s):

Bash
    
 
su -l yarn -c "/usr/odp/current/hadoop-yarn-timelineserver/sbin/yarn-daemon.sh stop timelineserver"
Copy

Execute this command on the ResourceManager host machine(s):

Bash
    
 
su -l yarn -c "/usr/odp/current/hadoop-yarn-resourcemanager/sbin/yarn- daemon.sh stop resourcemanager"
Copy

7. Stop HDFS

Execute this command on all DataNodes:

Bash
    
 
su -l hdfs -c "/usr/odp/current/hadoop-hdfs-datanode/../hadoop/sbin/hadoop-daemon.sh stop datanode"
Copy

Bash
    
 
su -l hdfs -c "/usr/odp/current/hadoop-hdfs-namenode/../hadoop/sbin/hadoop-daemon.sh stop secondarynamenode"
Copy

Execute this command on the NameNode host machine(s):

Bash
    
 
su -l hdfs -c "/usr/odp/current/hadoop-hdfs-namenode/../hadoop/sbin/hadoop-daemon.sh stop namenode"
Copy

If you are running NameNode HA, stop the ZooKeeper Failover Controllers (ZKFC) by executing this command on the NameNode host machines:

Bash
    
 
su -l hdfs -c "/usr/odp/current/hadoop-hdfs-namenode/../hadoop/sbin/hadoop-daemon.sh stop zkfc"
Copy

If you are running NameNode HA, stop the JournalNodes by executing these commands on the JournalNode host machines:

Bash
    
 
su -l hdfs -c "/usr/odp/current/hadoop-hdfs-journalnode/../hadoop/sbin/hadoop-daemon.sh stop journalnode"
Copy

where $HDFS_USER is the HDFS user. For example, hdfs.

8. Stop ZooKeeper. Execute this command on the ZooKeeper host machine(s):

Bash
    
su - zookeeper -c "export ZOOCFGDIR=/usr/odp/current/zookeeper-server/ conf ; export ZOOCFG=zoo.cfg; source /usr/odp/current/zookeeper-server/ conf/zookeeper-env.sh ; /usr/odp/current/zookeeper-server/bin/zkServer.sh stop"
Copy

Stop Kafka. Execute this command on the Kafka host machine(s):

Bash
    
 
su $KAFKA_USER /usr/odp/current/kafka-broker/bin/kafka stop
Copy

where$KAFKA_USER is the operating system user that installed Kafka. For example, Kafka.

Stop Spark2. Execute the following stop commands on the Kafka host machine(s):

a. History Server

Bash
    
 
su '$SPARK_USER'/usr/odp/current/spark2-historyserver/sbin/stop-history-server.sh
Copy

b. Thrift Server

Bash
    
 
su '$SPARK_USER'/usr/odp/current/spark2-thriftserver/sbin/stop-thriftserver.sh
Copy

Last updated on Nov 30, 2023

Was this page helpful?