Configuring Ports

Make sure the appropriate ports are open before you install ODP.

Tables in this section specify which ports must be opened for an ecosystem component or service to communicate with other components and services.

HBase Service Ports

Note the default ports used by various HBase services.

The following table lists the default ports used by the various HBase services.

Table 1: HBase Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
HMasterMaster Nodes (HBase Master Node and any back- up HBase Master node)16000TCPThe port used by HBase client to connect to the HBase Master.Yeshbase.master.port
HMaster Info Web UIMaster Nodes (HBase master Node and back up HBase Master node if any)16010HTTPThe port for the HBaseMaster web UI. Set to -1 if you do not want the info server to run.Yeshbase.master.info.port
RegionServerAll Slave Nodes16020TCPThe port used by the HBase client to connect to the HBase RegionServer.Yes (Typically admins, dev/support teams)hbase.regionserver.port
RegionServerAll Slave Nodes16030HTTPThe port used by the HBase client to connect to the HBase RegionServer.Yes (Typically admins, dev/support teams)hbase.regionserver.info.port
HBase REST Server (optional)All REST Servers8080HTTPThe port used by the HBase Rest Servers. REST servers are optional, and not installed by defaultYeshbase.rest.port
HBase REST Server Web UI (optional)All REST Servers8085HTTPThe port used by the HBase Rest Servers web UI. REST servers are optional, and not installed by defaultYes (Typically admins, dev/support teams)hbase.rest.info.port
HBase Thrift Server (optional)All Thrift Servers9090TCPThe port used by the HBase Thrift Servers. Thrift servers are optional, and not installed by defaultYesN/A
HBase Thrift Server Web UI (optional)All Thrift Servers9095TCPThe port used by HBase Thrift Servers web UI. Thrift servers are optional, and not installed by defaultYes (Typically admins, dev/support teams)hbase.thrift.info.port

HDFS Service Ports

Note the default ports used by various HDFS services.

The following table lists the default ports used by the various HDFS services. (Note: Neither of these services are used in a standard ODP installation.)

Table 2: HDFS Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
NameNode WebUIMaster Nodes (NameNode and any back-up NameNodes)50070httpWeb UI to look at current the status of HDFS, explore the file systemYes (Typically admins, Dev/ Support teams, as well as extra-cluster users who require webhdfs/ hftp access, for example, to use distcp)dfs.http.address
50470httpsSecure http servicedfs.https.address
NameNode metadata service8020/ 9000IPCFile system metadata operationsYes (All clients who directly need to interact with the HDFS)Embedded in URI specified by fs.defaultFS
DataNodeAll Slave Nodes50075httpDataNode WebUI to access the status, logs, etc, and file data operations when using webhdfs or hftpYes (Typically admins, Dev/ Support teams, as well as extra-cluster users who require webhdfs/ hftp access, for example, to use distcp)dfs.datanode.http.address
50475httpsSecure http servicedfs.datanode.https.address
50010 SASL based IPC (non-privilege port)IPCSecure data transferdfs.datanode.address
1019 Privilege IPC portIPCSecure data transferdfs.datanode.address
50020IPCMetadata operationsNodfs.datanode.ipc.address
1022httpsCustomer HTTP port for Secure DataNode deploymentYesdfs.datanode.http.address
Secondary NameNodeSecondary NameNode and any backup Secondary NameNode50090httpCheckpoint for NameNode metadataNodfs.secondary.http.address
ZooKeeper Failover Controller (ZKFC)8019IPCRPC port for Zookeeper Failover ControllerNodfs.ha.zkfc.port

Hive service ports

Note the default ports used by the various Hive services.

The following table lists the default ports used by the various Hive services. (Note: Neither of these services is used in a standard ODP installation.)

Table 3: Hive Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
Hive ServerHive Server machine (Usually a utility machine)10000tcp or httpService for programmatically (Thrift/ JDBC) connecting to HiveYes(Clients who need to connect to Hive either programmatically or through UI SQL tools that use JDBC)ENV Variable HIVE_PORT
Hive Web UIHive Server machine (Usually utility machine)9999httpWeb UI to explore Hive schemasYeshive.hwi.listen.port
Hive Metastore9083httpYes (Clients that run Hive, Pig and potentially M/R jobs that use HCatalog)hive.metastore.uris

Hue service port

Note the default port used by the Hue web listener.

The following table lists the default port used by the Hue web listener.

ServiceServersDefault Port UsedProtocolDescriptionNeed End User Access?Configuration Parameters
HueNode that is running Hue8888httpPort used by the Hue web listener to server web pages for HueYeshttp_port property in the /etc/hue/ conf/hue.ini file

Kafka Service Ports

Note the default port used by Kafka.

The following table lists the default ports used by Kafka.

Table 4: Kafka Service Ports

ServiceServersDefault PortDefault Ambari PortProtocolDescriptionNeed End User Access?
KafkaKafka Server90926667TCPThe port for Kafka server.

Kerberos Service Ports

Note the default port used by the designated Kerberos KDC.

The following table lists the default port used by the designated Kerberos KDC.

Table 5: Kerberos Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
KDCKerberos KDC server88Port used by the designated KDC

Knox Service Ports

Note the default port used by Knox.

The following table lists the default port used by Knox.

Table 6: Knox Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
KnoxKnox server8443Port used by Knox

MapReduce Service Ports

Note the default port used by the various MapReduce services.

The following table lists the default ports used by the various MapReduce services.

Table 7: MapReduce Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
MapReduce10020httpMapReduce JobHistory server addressmapreduce.jobhistory.address
MapReduce19888httpMapReduce JobHistory webapp addressmapreduce.jobhistory.webapp.address
MapReduce13562httpMapReduce Shuffle Portmapreduce.shuffle.port
MapReduce19890httpsMapReduce JobHistory webapp HTTPS addressmapreduce.jobhistory.webapp.https.address

MySQL Service Ports

Note the default ports used by the various MySQL services.

The following table lists the default ports used by the various MySQL services.

Table 8: MySQL Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
MySQLMySQL database server3306

Ozone Service Ports

Note the default ports used by Ozone.

The following table lists the default ports used by Ozone:

ServicePortConfiguration KeyProtocolDescription
Ozone Manager9862ozone.om.rpc-portHadoop RPCRPC endpoint for clients and applications
9872ozone.om.ratis-portGRPCRPC endpoint for OM HA instances to form a RAFT consensus ring
9874ozone.om.http-portHTTPOzone Manager Web UI
9875ozone.om.https-portHTTPSOzone Manager Web UI
Storage Container Manager (SCM)9861ozone.scm.datanode.portHadoop RPCPort used by DataNodes to communicate with the SCM
9863ozone.scm.block.client.portHadoop RPCPort used by the Ozone Manager to communicate with the SCM for block related operations
9860ozone.scm.client.portHadoop RPCPort used by Ozone Manager and other clients to communicate with the SCM for container operations
9876ozone.scm.http-portHTTPSCM Web UI
9877ozone.scm.https-portHTTPSSCM Web UI
DataNode (DN)9882ozone.datanode.http-addressHTTPDataNode Web UI
9883ozone.datanode.https-addressHTTPSDataNode Web UI
9858dfs.container.ratis.ipcGRPCRAFT server endpoint that is used by clients and other DataNodes to replicate RAFT transactions and write data.
9859dfs.container.ipcGRPCEndpoint that is used by clients and other DataNodes to read block data.
19864hdds.datanode.client.addressRPCOzone DataNode client service address.
S3 Gateway (S3G)9878ozone.s3g.http-addressHTTPS3 API REST Endpoint and Web UI
9879ozone.s3g.https-addressHTTPSS3 API REST Endpoint and Web UI
Recon Service9891ozone.recon.rpc-portHadoop RPCPort used by Datanodes to communicate with Recon Server (reporting)
9898ozone.recon.http-portHTTPRecon service Web UI and REST API
9899ozone.recon.https-portHTTPSRecon service Web UI and REST API

Ranger Service Ports

Note the default ports used by Ranger.

The following table lists the default ports used by Ranger.

Table 10: Ranger Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
Ranger AdminRanger Admin Nodes6080HTTPPort for Ranger Admin web UI.Yesranger.service.http.port (in ranger-admin-site.xml)
Ranger AdminRanger Admin Nodes6182HTTPSPort for Ranger Admin web UI (with SSL).Yesranger.service.https.port (in ranger-admin- site.xml)
UNIX Auth ServiceRanger Usersync Node5151SSL/TCPPort for UNIX Auth service.Noranger.usersync.port (in ranger-ugsync-site.xml)
Ranger KMSRanger KMS Nodes9292HTTPPort for Ranger KMS.Noranger.service.http.port (in kms-site.xml)
Ranger KMSRanger KMS Nodes9293HTTPSPort for Ranger KMS.Noranger.service.https.port(in kms-site.xml)
Solr used by RangerSolr6083,6183HTTPPorts for auditing to Solr.Yesranger-admin and all plug-ins

Sqoop Service Ports

Note the default ports used by Sqoop.

The following table lists the default ports used by Sqoop.

Table 11: Sqoop Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
SqoopMetastore16000TCPConnection between Sqoop and the metastoreNosqoop.metastore.server.port
SqoopJDBC ListenerVaries, depends on target database. For example, if moving data from MySQL, TCP port 3306 must be open.TCPOutbound port from the Hadoop cluster to the database. Varies depending on DatabaseNo

Tez Ports

Note the default ports used by the various Tez services.

The following table lists the default ports used by the various Tez services.

Table 12: Tez Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
Tez AM, Tez Service12999Port to use for AMPoolService statusYes (Clients who need to submit Hive queries or jobs to Tez AM or Tez Service) Yestez.ampool.ws.port
10030httpAddress on which to run the ClientRMProtocol proxytez.ampool.address

YARN Service Ports

Note the default ports used by the various YARN services.

The following table lists the default ports used by the various YARN services.

Table 13: YARN Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
Resource Manager WebUIMaster Nodes (Resource Manager and any backup Resource Manager node)8088httpWeb UI for Resource ManagerYesyarn.resourcemanager.webapp.address
Resource Manager HostnameMaster Nodes (Resource Manager Node)8090httpsResource Manager HTTPS AddressYesyarn.resourcemanager.webapp.https.address
Resource ManagerMaster Nodes (Resource Manager Node)8050IPCFor application submissionsYes (All clients who need to submit the YARN applications including Hive, Hive server, and Pig)Embedded in URI specified by yarn.resourcemanager.address
Resource ManagerMaster Nodes (Resource Manager Node)8025httpFor application submissionsYes (All clients who need to submit the YARN applications including Hive, Hive server, and Pig)yarn.resourcemanager.resource-tracker.address
SchedulerMaster Nodes (Resource Manager Node)8030httpScheduler AddressYes (Typically admins, Dev/ Support teams)yarn.resourcemanager.scheduler.address
Resource ManagerMaster Nodes (Resource Manager Node)8141httpScheduler AddressYes (Typically admins, Dev/ Support teams)yarn.resourcemanager.admin.address
NodeManagerSlave Nodes running NodeManager45454httpNodeManager AddressYes (Typically admins, Dev/ Support teams)yarn.nodemanager.address
NodeManagerSlave Nodes running NodeManager8042httpNodeManager Webapp AddressYes (Typically admins, Dev/ Support teams)yarn.nodemanager.webapp.address
Timeline ServerMaster Nodes10200httpTimeline Server AddressYes (Typically admins, Dev/ Support teams)yarn.timeline-service.address
Timeline ServerMaster Nodes8188httpTimeline Server Webapp AddressYes (Typically admins, Dev/ Support teams)yarn.timeline-service.webapp.address
Timeline ServerMaster Nodes8190httpsTimeline Server Webapp https AddressYes (Typically admins, Dev/ Support teams)yarn.timeline-service.webapp.https.address
Job History ServiceMaster Nodes19888httpsJob History ServiceYes (Typically admins, Dev/ Support teams)yarn.log.server.url

ZooKeeper Service Ports

Note the default ports used by Zookeeper service.

Table 14: ZooKeeper Service Ports

ServiceServersDefault Ports UsedProtocolDescriptionNeed End User Access?Configuration Parameters
ZooKeeper ServerAll ZooKeeper Nodes2888N/APort used by ZooKeeper peers to talk to each other.NoX in server.N =host:X:Y
ZooKeeper ServerAll ZooKeeper Nodes3888N/APort used by ZooKeeper peers to talk to each other.NoX in server.N =host:X:Y
ZooKeeper ServerAll ZooKeeper Nodes2181N/AProperty from ZooKeeper's config zoo.cfg. The port at which the clients connect.YesX in server.N =host:X:Y
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard
  Last updated