Apache Release Notes

Apache Ozone 2.1.0 Release Notes

Added

• Added design documentation and initial integration support for OpenTelemetry. (HDDS-13679)
• Implemented an in-memory manager for Snapshot Local Data. (HDDS-13627)
• Added Ranger support for authorizing STS tokens. (HDDS-13848)
• Added latency metrics for key creation operations and deletion services in Grafana dashboards. (HDDS-13510)
• Added OpenSSL native library validation to the ozone debug checknative command output. (HDDS-13266)
• Migrated Apache Ozone from OpenTracing to OpenTelemetry for distributed tracing. (HDDS-13680)
• Added support for RPM package builds. RPM packages can be generated using:

xxxxxxxxxx

mvn clean package -DskipTests=true -Prpm

Optionally, ARM builds can be generated using:

xxxxxxxxxx

-Drpm.targetArch=aarch64

(HDDS-13439)

• Added support for generating Debian (.deb) packages using:

xxxxxxxxxx

mvn clean package -Pdeb

The generated package is created under:

xxxxxxxxxx

hadoop-ozone/dist/target

and installs Ozone binaries under:

xxxxxxxxxx

/opt/ozone

(HDDS-13414)

• Added a Deletion Progress section in the OM Web UI to track Key Deleting Service metrics, including deletion count, deletion size over the last 24 hours, service status, and scheduling details. (HDDS-12887)
• Added a throttling mechanism in SCM to reduce excessive memory consumption and long garbage collection pauses during large-scale block deletions. (HDDS-12087)
• Added support for Listener Ozone Managers (OMs). Listener OMs are read-only, non-voting nodes that replicate logs from the leader OM to improve read scalability and reduce load on voting OMs. (HDDS-11523)
• Added new StorageVolumeScannerMetrics and VolumeInfoMetrics metrics on Datanodes to improve storage volume scanning observability and health monitoring. (HDDS-8783)
• Added dedicated audit logs for background deletion services and internal OM requests. (HDDS-13370, HDDS-11314)
• Added logic to immediately trigger heartbeat and container close operations when a storage volume becomes full. (HDDS-13045)
• Added support for uploading and deleting objects using presigned URLs. (HDDS-5195, HDDS-13663)
• Added support for custom metadata headers containing uppercase characters. (HDDS-13429)
• Added support for the S3 STANDARD_IA storage class with EC replication configuration and owner field support in listBuckets. (HDDS-1097)
• Added new Grafana dashboards for low-level RocksDB operations and deletion progress tracking. (HDDS-12446, HDDS-13259)
• Added a Mismatched Replica tab in the Containers page and improved mismatch APIs. (HDDS-12395)
• Added ozone admin commands for listing containers by health state and sorting Datanodes. (HDDS-12653, HDDS-13095)

Changed

• Moved container-related metadata and OM task metadata storage from Derby DB to Ozone Manager RocksDB. (HDDS-13669)
• Refactored OzoneManagerLock to support hierarchical resource locking and implemented a pool-based lock manager. (HDDS-13797, HDDS-13798)
• Upgraded Apache Ratis to version 3.2.0. (HDDS-12070)
• Upgraded AWS SDK to version 2.35.5. (HDDS-13793)
• Upgraded Jetty to version 9.4.58. (HDDS-13585)
• Increased the minimum required Maven version to 3.6.3. (HDDS-13364)
• Separated Recon OM synchronization from task processing to improve system stability. (HDDS-8633)
• Reduced the default backup SST pruning interval to 10 minutes to improve disk space management when Ozone Snapshot is enabled. (HDDS-13638)
• Updated Ozone runtime requirements to Hadoop 3.4. Support for Hadoop 3.1.2 has been deprecated. (HDDS-12152)
• Renamed the previous --all option behavior in ozone sh snapshot lsDiff to --all-status. The --all option now acts as a listing limit by setting the count to Integer.MAX_VALUE. (HDDS-8802)

Fixed

• Fixed OMLockDetails usage where a ThreadLocal object was incorrectly returned during snapshot locking operations. (HDDS-13978, HDDS-13004)
• Improved Recon startup performance by handling failed delta tasks from previous runs and making task reprocessing non-blocking. (HDDS-13791)
• Corrected pagination semantics for listMultipartUploads and ListObjectsV2. (HDDS-13290)
• Fixed Datanode decommission failures occurring when other nodes were offline in Ratis replication setups. (HDDS-13544)
• Fixed memory leaks in NSSummary and resolved Derby-related issues during schema upgrades. (HDDS-8565, HDDS-12968)

Security

• Added Ranger artifacts to support STS token authorization. (HDDS-13848)

##