Configure Ozone

Metadata directories

Ozone2 Manager (OM)

Configuration key

Default value

Purpose

ozone.om.db.dirs

/var/lib/ozone2/om/ozone-metadata

Ozone Manager Metadata directories. This should be specified as a single directory

ozone.om.ratis.storage.dir

/var/lib/ozone2/om/ratis

Used for storing OM's Ratis metadata like logs. If undefined, OM ratis storage dir will fallback to ozone.metadata.dirs.

ozone.om.ratis.snapshot.dir

/var/lib/ozone2/om-snapshots

Directory to store OM's snapshot related files like the ratisSnapshotIndex and DB checkpoint from leader OM.

Storage Container Manager (SCM)

Configuration key

Default value

Purpose

ozone.scm.db.dirs

/var/lib/ozone2/scm/data

Directory where the StorageContainerManager stores its metadata. This should be specified as a single directory. If the directory does not exist then the SCM will attempt to create it.

ozone.scm.ha.ratis.storage.dir

/var/lib/ozone2/scm/ratis

Storage directory used by SCM to write Ratis logs.

hdds.metadata.dir

/var/lib/ozone2/hdds-metadata

Absolute path to HDDS metadata dir. Part of SCM balancer properties.

Ozone2 Datanode (DN)

Configuration key

Default value

Purpose

hdds.datanode.dir

/data/ozone2/datanode/data

Determines where on the local filesystem HDDS data will be stored. Defaults to dfs.datanode.data.dir if not specified.

ozone.metadata.dirs

/var/lib/ozone2/services-metadata/dn-metadata

Fallback location for SCM, OM, Recon and DataNodes to store their metadata. In ODP ozone, used only for datanode metadata.

dfs.container.ratis.datanode.storage.dir

/var/lib/ozone2/datanode/ratis/data

Ozone Datanode Ratis Data Directory, to store metadata like logs

ozone.scm.datanode.id.dir

/var/lib/ozone2/datanode

The path that datanodes will use to store the datanode ID.

Recon Service

Configuration key

Default value

Purpose

ozone.recon.db.dir

/var/lib/ozone2/recon/data

Ozone RECON UI data directory. This should be specified as a single directory. If the directory does not exist then the Recon will attempt to create it.

ozone.recon.om.db.dir

/var/lib/ozone2/recon/om/data

Directory where the Recon Server stores its OM snapshot DB. This should be specified as a single directory. If the directory does not exist then the Recon will attempt to create it.

ozone.recon.scm.db.dirs

/var/lib/ozone2/recon/scm/data

Directory where the Recon Server stores its SCM snapshot DB. This should be specified as a single directory. If the directory does not exist then the Recon will attempt to create it.


Ozone2 Service Endpoints

Ozone2 Manager (OM)

Default Port

Ozone2 Port

Configuration key

Endpoint Protocol

Purpose

9862

ozone.om.rpc.port

Hadoop RPC

RPC endpoint for clients and applications


9872

ozone.om.ratis-port

GRPC

RPC endpoint for OM HA instances to form a RAFT consensus ring


9874

ozone.om.http-port

HTTP

Ozone Manager web UI


9875

ozone.om.https-port

HTTPS

Ozone Manager web UI


9872

ozone.om.ratis.port




Storage Container Manager (SCM)

Default Port

Configuration key

Endpoint Protocol

Purpose

9861

ozone.scm.datanode.port

Hadoop RPC

Port used by DataNodes to communicate with the SCM

9863

ozone.scm.block.client.port

Hadoop RPC

Port used by the Ozone Manager to communicate with the SCM for block related operations

9860

ozone.scm.client.port

Hadoop RPC

Port used by Ozone Manager and other clients to communicate with the SCM for container operations

9876

ozone.scm.http-port

HTTP

SCM Web UI

9877

ozone.scm.https-port

HTTPS

SCM Web UI

9895

ozone.scm.grpc.port



9894

ozone.scm.ratis.port



9961

ozone.scm.security.service.port



Ozone2 Datanode (DN)

Default Port

Configuration key

Endpoint Protocol

Purpose

9882

ozone.datanode.http-address

HTTP

DataNode Web UI

9883

ozone.datanode.https-address

HTTPS

DataNode Web UI

9858

dfs.container.ratis.ipc

GRPC

RAFT server endpoint that is used by clients and other DataNodes to replicate RAFT transactions and write data.

9859

dfs.container.ipc

GRPC

Endpoint that is used by clients and other DataNodes to read block data.

9856

dfs.container.ratis.server.port



9857

dfs.container.ratis.admin.port



19864

hdds.datanode.client.address



S3 Gateaway (S3G)

Default Port

Configuration key

Endpoint Protocol

Purpose

9878

ozone.s3g.http-port

HTTP

S3 API REST Endpoint

9879

ozone.s3g.https-port

HTTPS

S3 API REST Endpoint

0.0.0.0:19878

ozone.s3g.webadmin.http-address

HTTP

The address and port where Ozone S3Gateway serves web content (like admin and jmx endpoints)

0.0.0.0:19879

ozone.s3g.webadmin.https-address

HTTPS

The address and port where Ozone S3Gateway serves web content (like admin and jmx endpoints)

Recon Service

Default Port

Configuration key

Endpoint Protocol

Purpose

9891

ozone.recon.rpc-port

Hadoop RPC

Port used by Datanodes to communicate with Recon Server (reporting)

9898

ozone.recon.http-port

HTTP

Recon service Web UI and REST API

9899

ozone.recon.https-port

HTTPS

Recon service Web UI and REST API





  Last updated