Title
Create new category
Edit page index title
Edit category
Edit link
Configure Ozone
Metadata directories
Ozone2 Manager (OM)
Configuration key | Default value | Purpose |
|---|---|---|
ozone.om.db.dirs | /var/lib/ozone2/om/ozone-metadata | Ozone Manager Metadata directories. This should be specified as a single directory |
ozone.om.ratis.storage.dir | /var/lib/ozone2/om/ratis | Used for storing OM's Ratis metadata like logs. If undefined, OM ratis storage dir will fallback to ozone.metadata.dirs. |
ozone.om.ratis.snapshot.dir | /var/lib/ozone2/om-snapshots | Directory to store OM's snapshot related files like the ratisSnapshotIndex and DB checkpoint from leader OM. |
Storage Container Manager (SCM)
Configuration key | Default value | Purpose |
|---|---|---|
ozone.scm.db.dirs | /var/lib/ozone2/scm/data | Directory where the StorageContainerManager stores its metadata. This should be specified as a single directory. If the directory does not exist then the SCM will attempt to create it. |
ozone.scm.ha.ratis.storage.dir | /var/lib/ozone2/scm/ratis | Storage directory used by SCM to write Ratis logs. |
hdds.metadata.dir | /var/lib/ozone2/hdds-metadata | Absolute path to HDDS metadata dir. Part of SCM balancer properties. |
Ozone2 Datanode (DN)
Configuration key | Default value | Purpose |
|---|---|---|
hdds.datanode.dir | /data/ozone2/datanode/data | Determines where on the local filesystem HDDS data will be stored. Defaults to dfs.datanode.data.dir if not specified. |
ozone.metadata.dirs | /var/lib/ozone2/services-metadata/dn-metadata | Fallback location for SCM, OM, Recon and DataNodes to store their metadata. In ODP ozone, used only for datanode metadata. |
dfs.container.ratis.datanode.storage.dir | /var/lib/ozone2/datanode/ratis/data | Ozone Datanode Ratis Data Directory, to store metadata like logs |
ozone.scm.datanode.id.dir | /var/lib/ozone2/datanode | The path that datanodes will use to store the datanode ID. |
Recon Service
Configuration key | Default value | Purpose |
|---|---|---|
ozone.recon.db.dir | /var/lib/ozone2/recon/data | Ozone RECON UI data directory. This should be specified as a single directory. If the directory does not exist then the Recon will attempt to create it. |
ozone.recon.om.db.dir | /var/lib/ozone2/recon/om/data | Directory where the Recon Server stores its OM snapshot DB. This should be specified as a single directory. If the directory does not exist then the Recon will attempt to create it. |
ozone.recon.scm.db.dirs | /var/lib/ozone2/recon/scm/data | Directory where the Recon Server stores its SCM snapshot DB. This should be specified as a single directory. If the directory does not exist then the Recon will attempt to create it. |
Ozone2 Service Endpoints
Ozone2 Manager (OM)
Default Port | Ozone2 Port | Configuration key | Endpoint Protocol | Purpose |
|---|---|---|---|---|
9862 | ozone.om.rpc.port | Hadoop RPC | RPC endpoint for clients and applications | |
9872 | ozone.om.ratis-port | GRPC | RPC endpoint for OM HA instances to form a RAFT consensus ring | |
9874 | ozone.om.http-port | HTTP | Ozone Manager web UI | |
9875 | ozone.om.https-port | HTTPS | Ozone Manager web UI | |
9872 | ozone.om.ratis.port |
Storage Container Manager (SCM)
Default Port | Configuration key | Endpoint Protocol | Purpose |
|---|---|---|---|
9861 | ozone.scm.datanode.port | Hadoop RPC | Port used by DataNodes to communicate with the SCM |
9863 | ozone.scm.block.client.port | Hadoop RPC | Port used by the Ozone Manager to communicate with the SCM for block related operations |
9860 | ozone.scm.client.port | Hadoop RPC | Port used by Ozone Manager and other clients to communicate with the SCM for container operations |
9876 | ozone.scm.http-port | HTTP | SCM Web UI |
9877 | ozone.scm.https-port | HTTPS | SCM Web UI |
9895 |
| ||
9894 |
| ||
9961 |
|
Ozone2 Datanode (DN)
Default Port | Configuration key | Endpoint Protocol | Purpose |
|---|---|---|---|
9882 | ozone.datanode.http-address | HTTP | DataNode Web UI |
9883 | ozone.datanode.https-address | HTTPS | DataNode Web UI |
9858 | dfs.container.ratis.ipc | GRPC | RAFT server endpoint that is used by clients and other DataNodes to replicate RAFT transactions and write data. |
9859 | dfs.container.ipc | GRPC | Endpoint that is used by clients and other DataNodes to read block data. |
9856 |
| ||
9857 |
| ||
19864 |
|
S3 Gateaway (S3G)
Default Port | Configuration key | Endpoint Protocol | Purpose |
|---|---|---|---|
9878 | ozone.s3g.http-port | HTTP | S3 API REST Endpoint |
9879 | ozone.s3g.https-port | HTTPS | S3 API REST Endpoint |
0.0.0.0:19878 | ozone.s3g.webadmin.http-address | HTTP | The address and port where Ozone S3Gateway serves web content (like admin and jmx endpoints) |
0.0.0.0:19879 | ozone.s3g.webadmin.https-address | HTTPS | The address and port where Ozone S3Gateway serves web content (like admin and jmx endpoints) |
Recon Service
Default Port | Configuration key | Endpoint Protocol | Purpose |
|---|---|---|---|
9891 | ozone.recon.rpc-port | Hadoop RPC | Port used by Datanodes to communicate with Recon Server (reporting) |
9898 | ozone.recon.http-port | HTTP | Recon service Web UI and REST API |
9899 | ozone.recon.https-port | HTTPS | Recon service Web UI and REST API |