Configure Ozone

Metadata directories

Ozone2 Manager (OM)

Configuration keyDefault valuePurpose
ozone.om.db.dirs/var/lib/ozone2/om/ozone-metadataOzone Manager Metadata directories. This should be specified as a single directory
ozone.om.ratis.storage.dir/var/lib/ozone2/om/ratisUsed for storing OM's Ratis metadata like logs. If undefined, OM ratis storage dir will fallback to ozone.metadata.dirs.
ozone.om.ratis.snapshot.dir/var/lib/ozone2/om-snapshotsDirectory to store OM's snapshot related files like the ratisSnapshotIndex and DB checkpoint from leader OM.

Storage Container Manager (SCM)

Configuration keyDefault valuePurpose
ozone.scm.db.dirs/var/lib/ozone2/scm/dataDirectory where the StorageContainerManager stores its metadata. This should be specified as a single directory. If the directory does not exist then the SCM will attempt to create it.
ozone.scm.ha.ratis.storage.dir/var/lib/ozone2/scm/ratisStorage directory used by SCM to write Ratis logs.
hdds.metadata.dir/var/lib/ozone2/hdds-metadataAbsolute path to HDDS metadata dir. Part of SCM balancer properties.

Ozone2 Datanode (DN)

Configuration keyDefault valuePurpose
hdds.datanode.dir/data/ozone2/datanode/dataDetermines where on the local filesystem HDDS data will be stored. Defaults to dfs.datanode.data.dir if not specified.
ozone.metadata.dirs/var/lib/ozone2/services-metadata/dn-metadataFallback location for SCM, OM, Recon and DataNodes to store their metadata. In ODP ozone, used only for datanode metadata.
dfs.container.ratis.datanode.storage.dir/var/lib/ozone2/datanode/ratis/dataOzone Datanode Ratis Data Directory, to store metadata like logs
ozone.scm.datanode.id.dir/var/lib/ozone2/datanodeThe path that datanodes will use to store the datanode ID.

Recon Service

Configuration keyDefault valuePurpose
ozone.recon.db.dir/var/lib/ozone2/recon/dataOzone RECON UI data directory. This should be specified as a single directory. If the directory does not exist then the Recon will attempt to create it.
ozone.recon.om.db.dir/var/lib/ozone2/recon/om/dataDirectory where the Recon Server stores its OM snapshot DB. This should be specified as a single directory. If the directory does not exist then the Recon will attempt to create it.
ozone.recon.scm.db.dirs/var/lib/ozone2/recon/scm/dataDirectory where the Recon Server stores its SCM snapshot DB. This should be specified as a single directory. If the directory does not exist then the Recon will attempt to create it.

Ozone2 Service Endpoints

Ozone2 Manager (OM)

Default PortOzone2 PortConfiguration keyEndpoint ProtocolPurpose
9862ozone.om.rpc.portHadoop RPCRPC endpoint for clients and applications
9872ozone.om.ratis-portGRPCRPC endpoint for OM HA instances to form a RAFT consensus ring
9874ozone.om.http-portHTTPOzone Manager web UI
9875ozone.om.https-portHTTPSOzone Manager web UI
9872ozone.om.ratis.port

Storage Container Manager (SCM)

Default PortConfiguration keyEndpoint ProtocolPurpose
9861ozone.scm.datanode.portHadoop RPCPort used by DataNodes to communicate with the SCM
9863ozone.scm.block.client.portHadoop RPCPort used by the Ozone Manager to communicate with the SCM for block related operations
9860ozone.scm.client.portHadoop RPCPort used by Ozone Manager and other clients to communicate with the SCM for container operations
9876ozone.scm.http-portHTTPSCM Web UI
9877ozone.scm.https-portHTTPSSCM Web UI
9895ozone.scm.grpc.port
9894ozone.scm.ratis.port
9961ozone.scm.security.service.port

Ozone2 Datanode (DN)

Default PortConfiguration keyEndpoint ProtocolPurpose
9882ozone.datanode.http-addressHTTPDataNode Web UI
9883ozone.datanode.https-addressHTTPSDataNode Web UI
9858dfs.container.ratis.ipcGRPCRAFT server endpoint that is used by clients and other DataNodes to replicate RAFT transactions and write data.
9859dfs.container.ipcGRPCEndpoint that is used by clients and other DataNodes to read block data.
9856dfs.container.ratis.server.port
9857dfs.container.ratis.admin.port
19864hdds.datanode.client.address

S3 Gateaway (S3G)

Default PortConfiguration keyEndpoint ProtocolPurpose
9878ozone.s3g.http-portHTTPS3 API REST Endpoint
9879ozone.s3g.https-portHTTPSS3 API REST Endpoint
0.0.0.0:19878ozone.s3g.webadmin.http-addressHTTPThe address and port where Ozone S3Gateway serves web content (like admin and jmx endpoints)
0.0.0.0:19879ozone.s3g.webadmin.https-addressHTTPSThe address and port where Ozone S3Gateway serves web content (like admin and jmx endpoints)

Recon Service

Default PortConfiguration keyEndpoint ProtocolPurpose
9891ozone.recon.rpc-portHadoop RPCPort used by Datanodes to communicate with Recon Server (reporting)
9898ozone.recon.http-portHTTPRecon service Web UI and REST API
9899ozone.recon.https-portHTTPSRecon service Web UI and REST API

####

####

Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard
  Last updated