Apache Release Notes

Apache Ozone 2.1.0 Release Notes

Added

• Added design documentation and initial integration support for OpenTelemetry. (HDDS-13679)
• Implemented an in-memory manager for Snapshot Local Data. (HDDS-13627)
• Added Ranger support for authorizing STS tokens. (HDDS-13848)
• Added latency metrics for key creation operations and deletion services in Grafana dashboards. (HDDS-13510)
• Added OpenSSL native library validation to the ozone debug checknative command output. (HDDS-13266)
• Migrated Apache Ozone from OpenTracing to OpenTelemetry for distributed tracing. (HDDS-13680)
• Added support for RPM package builds. RPM packages can be generated using:

xxxxxxxxxx

mvn clean package -DskipTests=true -Prpm

Optionally, ARM builds can be generated using:

xxxxxxxxxx

-Drpm.targetArch=aarch64

(HDDS-13439)

• Added support for generating Debian (.deb) packages using:

xxxxxxxxxx

mvn clean package -Pdeb

The generated package is created under:

xxxxxxxxxx

hadoop-ozone/dist/target

and installs Ozone binaries under:

xxxxxxxxxx

/opt/ozone

(HDDS-13414)

• Added a Deletion Progress section in the OM Web UI to track Key Deleting Service metrics, including deletion count, deletion size over the last 24 hours, service status, and scheduling details. (HDDS-12887)
• Added a throttling mechanism in SCM to reduce excessive memory consumption and long garbage collection pauses during large-scale block deletions. (HDDS-12087)
• Added support for Listener Ozone Managers (OMs). Listener OMs are read-only, non-voting nodes that replicate logs from the leader OM to improve read scalability and reduce load on voting OMs. (HDDS-11523)
• Added new StorageVolumeScannerMetrics and VolumeInfoMetrics metrics on Datanodes to improve storage volume scanning observability and health monitoring. (HDDS-8783)
• Added dedicated audit logs for background deletion services and internal OM requests. (HDDS-13370, HDDS-11314)
• Added logic to immediately trigger heartbeat and container close operations when a storage volume becomes full. (HDDS-13045)
• Added support for uploading and deleting objects using presigned URLs. (HDDS-5195, HDDS-13663)
• Added support for custom metadata headers containing uppercase characters. (HDDS-13429)
• Added support for the S3 STANDARD_IA storage class with EC replication configuration and owner field support in listBuckets. (HDDS-1097)
• Added new Grafana dashboards for low-level RocksDB operations and deletion progress tracking. (HDDS-12446, HDDS-13259)
• Added a Mismatched Replica tab in the Containers page and improved mismatch APIs. (HDDS-12395)
• Added ozone admin commands for listing containers by health state and sorting Datanodes. (HDDS-12653, HDDS-13095)

Changed

• Moved container-related metadata and OM task metadata storage from Derby DB to Ozone Manager RocksDB. (HDDS-13669)
• Refactored OzoneManagerLock to support hierarchical resource locking and implemented a pool-based lock manager. (HDDS-13797, HDDS-13798)
• Upgraded Apache Ratis to version 3.2.0. (HDDS-12070)
• Upgraded AWS SDK to version 2.35.5. (HDDS-13793)
• Upgraded Jetty to version 9.4.58. (HDDS-13585)
• Increased the minimum required Maven version to 3.6.3. (HDDS-13364)
• Separated Recon OM synchronization from task processing to improve system stability. (HDDS-8633)
• Reduced the default backup SST pruning interval to 10 minutes to improve disk space management when Ozone Snapshot is enabled. (HDDS-13638)
• Updated Ozone runtime requirements to Hadoop 3.4. Support for Hadoop 3.1.2 has been deprecated. (HDDS-12152)
• Renamed the previous --all option behavior in ozone sh snapshot lsDiff to --all-status. The --all option now acts as a listing limit by setting the count to Integer.MAX_VALUE. (HDDS-8802)

Fixed

• Fixed OMLockDetails usage where a ThreadLocal object was incorrectly returned during snapshot locking operations. (HDDS-13978, HDDS-13004)
• Improved Recon startup performance by handling failed delta tasks from previous runs and making task reprocessing non-blocking. (HDDS-13791)
• Corrected pagination semantics for listMultipartUploads and ListObjectsV2. (HDDS-13290)
• Fixed Datanode decommission failures occurring when other nodes were offline in Ratis replication setups. (HDDS-13544)
• Fixed memory leaks in NSSummary and resolved Derby-related issues during schema upgrades. (HDDS-8565, HDDS-12968)

Security

• Added Ranger artifacts to support STS token authorization. (HDDS-13848)

Apache NiFi 2 Release Notes

Version 2.7.2

Version 2.7.2 is a bug fix release with 6 issues resolved.

Release Date: December 17, 2025

Jira Release Notes for 2.7.2

Bug Fixes

• Corrected sensitive property migration for Management Controller Services
• Corrected disabling of invalid Controller Services
• Corrected handling of optional parameter when clearing state for components

Version 2.7.2

Version 2.7.1 is a bug fix release with 13 issues resolved.

Release Date: December 12, 2025

Jira Release Notes for 2.7.1

Bug Fixes

• Corrected property name migration for ExecuteScript and other scripted components
• Corrected property name migration for FetchGridFS

Improvements

• Added support for setting configuredForClustering flag in mock framework

Known Issues

• NIFI-15340 On upgrade from previous versions, SSL Context Services configured as Management Controller Services may be invalid due to incorrect Key Password property migration

Version 2.7.0

Version 2.7.0 is feature improvement and bug fix release with over 265 issues resolved.

Release Date: December 9th, 2025

Jira Release Notes for 2.7.0

Migration Guidance for 2.7.0

New Capabilities

• Added capability to clear bulletins
• Added stacktrace of bulletins is now available in the bulletin board
• Parquet is now a supported format for the content viewer
• New ConsumeKinesis processor using Amazon Kinesis Client Library 3
• New PutIcebergRecord processor with AWS and Azure Iceberg FileIO Providers
• Flow Registry Clients are now verifiable and documentation is now included in the embedded docs
• New NiFi endpoint to discover components with listening ports

Improvements

• BitBucket Flow Registry Client supports Data Center edition
• Added Key Pair authentication support to Snowflake Connection Pool
• Added support for GCP Workload Identity Federation to GCPCredentialsControllerService
• Added support for Web Identity to AmazonMSKConnectionService
• Added support for STS AssumeRoleWithWebIdentity to AWS Credentials Provider
• Added OAuth support for Azure Event Hubs Processors
• Added support for AWS RDS IAM authentication in DBCP Connection Pool

Deprecations

• Removed OCSP Certificate Validation from framework security configuration
• Deprecated Kerberos Login Identity Provider for removal in subsequent releases

Known Issues

• On upgrade from previous versions, the ExecuteScript Processor has an incorrect value for the Script Engine, corrected in NiFi 2.7.1

Version 2.6.0

Version 2.6.0 is feature improvement and bug fix release with over 175 issues resolved.

Release Date: September 21st, 2025

Jira Release Notes for 2.6.0

New Capabilities

• Azure Git DevOps Flow Registry Client
• StandardProtobufReader supporting Schema Registries with Protobuf

Improvements

• Upgrade to NiFi API 2.3.0
• Refactored Apache ZooKeeper clustering to separate NAR module
• Refactored SFTP Processors from SSHJ to Apache MINA SSHD
• Added AWS Role configuration options for Amazon MSK integration
• Added HTTP Protocol Version property to StandardWebClientServiceProvider
• Various dependency upgrades including
  • Codemirror 6
  • Client SDKs of AWS, Azure and GCP

Deprecations

• Deprecated CompressContent in favor of ModifyCompression
• Deprecated GetAzureEventHub in favor of ConsumeAzureEventHub
• Deprecated ConvertAvroToParquet in favor of Record Readers and Writers
• Deprecated ParseNetflowv5 for removal
• Deprecated GeohashRecord for removal
• Deprecated CreateHadoopSequenceFile for removal

Version 2.5.0

Version 2.5.0 is feature improvement and bug fix release with over 150 issues resolved.

Release Date: July 22nd, 2025

Jira Release Notes for 2.5.0

New Capabilities

• Add Amazon Glue Schema Reference Reader

Notable Improvements / Changes

• Support SASL/OAUTHBEARER in Kafka processors
• Add support for Binary XLS format to ExcelReader
• Allow an unversioned PG to start tracking to a version in a registry client
• Options to deal with parameter values in git registry clients when versioning a flow
• Normalization of the JSON flow definitions when using git registry clients
• Introduce Inject Metadata Output Strategy in ConsumeKafka
• Add OAUTH support to SnowflakeComputingConnectionPool

Bug fixes

• Various bug fixes for the Kafka components
• Various bug fixes around the Stateless engine

Dependencies

• Upgrade to NiFi API 2.2.0 (see below)

• Various dependencies upgrades including but not limited to

  • OkHttp 5, QuestDB 9, Elasticsearch 9
  • Client SDKs of AWS, Azure and GCP

Version 2.4.0

Version 2.4.0 is feature improvement and bug fix release with over 109 issues resolved.

Release Date: May 1st, 2025

Jira Release Notes for 2.4.0

New Capabilities

• Bitbucket Registry Client
• Flow Action Reporter Interface to Framework API for extensible tracking for Flow Configuration History
• New Box processors
• Support for AWS MSK (Kafka) IAM authentication
• OAuth 2.0 Controller Service to support JWT Bearer Flow
• Astral uv for dynamic download of Python dependencies

Notable Improvements / Changes

• Kafka refactor with significant improvements and bug fixes
• Registry client API call frequency changed from 1 minute to 30 minutes
• ConsumeKinesisStream support for Sub Sequence Number

Bug fixes

• Fix when importing JSON Flow Definitions with migrated properties
• ListGoogleDrive fails to list Shared Drive subfolder
• ConsumeKinesisStream skips aggregated records
• PutBigQuery Creates too many active streams

Deprecations

• Deprecated framework support for OCSP validation of X.509 Client Certificates

Version 2.3.0

Version 2.3.0 is feature improvement and bug fix release with over 102 issues resolved.

Release Date: March 11, 2025

Jira Release Notes for 2.3.0

New Capabilities

• New Box processors: ConsumeBoxEvents, FetchBoxFileRepresentation, ConsumeBoxEnterpriseEvents, FetchBoxFileInfo, GetBoxFileCollaborators, GetBoxGroupMembers
• Add Record and Demarcator support in ConsumeGCPubSub
• Add Processor to get S3 object tags

Notable Improvements

• Enable JWT auth with Elasticsearch
• Add support for HEAD in NiFi web client
• Performance improvements with SimpleRecordSchema
• Fix FlowFile distribution when load balancing with "partition by attribute"
• Allow ExecuteSQL to not overwrite FlowFile content when no result
• Add credential scope in GCP PubSub and BigQuery processors
• Fix custom Storage API URL in PutGCSObject
• Fix NullPointerException in ListGoogleDrive
• StandardFlowDifference hashCode should include fieldName
• Improvements in ConsumeKinesis processor

Version 2.2.0

Version 2.2.0 is feature improvement and bug fix release with over 55 issues resolved.

Release Date: January 27, 2025

Jira Release Notes for 2.2.0

New Capabilities

• Added support for pasting a versioned flow definition
• Added configurable groups claim mapping for OIDC to NiFi Registry
• Added Database Dialect Service

Notable Improvements

• Added support for OAuth to GetWorkdayReport processor
• Added a new arrayOf RecordPath function
• Added support for JSON file upload to pg-import in the NiFi CLI
• Added support for domain-wide delegation in GCP Credentials Controller Service
• Set Standard HTTP Response Headers for All Requests
• Added fallback to RSA algorithm for application JSON Web Tokens when the Java Security configuration does not support Ed25519

Version 2.1.0

Version 2.1.0 is feature improvement and bug fix release with over 90 issues resolved.

Release Date: December 23, 2024

Jira Release Notes for 2.1.0

New Capabilities

• Added support for copying and pasting flow definitions between separate NiFi deployments
• Added support for framework security configuration with PEM-encoded private keys and certificates
• Added support for extension security configuration with PEM-encoded private keys and certificates using the PEMEncodedSSLContextProvider
• Added support for using state management features in Python Processors

Notable Improvements

• Added NiFi CLI commands managing Flow Registry Clients
• Added OIDC Client Credentials Flow support to NiFi CLI
• Corrected SSLContextService and LDAP Provider when configured with a trust store and without a key store

Verison 2.0.0

Version 2.0.0 is the first general availability version of Apache NiFi 2.0.0.

Release Date: November 4, 2024

Jira Release Notes for 2.0.0

Please refer to the Deprecated Components and Features documentation for items removed in this version.

Migrating Deprecated Components and Features for 2.0.0 includes current progress on the steps necessary for migrating certain components and features.

New Capabilities

• Incorporated independent version of nifi-api 2.0.0
• Added Flow Registry Client integrated with GitLab
• Added Processors for retrieving metadata from S3 and copying files between buckets
• Added Processor to delete files from an SFTP server for more precise control over processing
• Added REST API services for uploading assets and custom NAR bundles

Notable Improvements

• Redesigned Content Viewer
• Redesigned Bootstrap process with simplified monitoring protocol using HTTP
• Added Starting Row Strategy for inferring schema from Excel spreadsheets using Excel Reader

Breaking Changes

• Removed PutIceberg Processor and services
• Removed HBase Processors and services
• Removed Kafka 2.6 Processors
• Removed ListenBeats, ListenRELP, ListenSMTP, and ListenTCPRecord Processors
• Removed DecryptContent and DecryptContentCompatbility Processors
• Removed PutKudu and KuduLookupService components
• Removed Yandex components
• Removed QueryDNS and QueryWhois Processors
• Removed ExtractTNEFAttachments Processor
• Removed support for Repository Encryption
• Removed Shell User Group Provider
• Renamed Distributed Cache Services without the word Distributed to avoid confusion over capabilities

Version 2.0.0-M4

Version 2.0.0-M4 is the fourth milestone version of Apache NiFi 2.0.0.

Release Date: July 1, 2024

Jira Release Notes for 2.0.0-M4

Please refer to the Deprecated Components and Features documentation for items removed in this version.

Migrating Deprecated Components and Features for 2.0.0 includes current progress on the steps necessary for migrating certain components and features.

New Capabilities

• Completely rebuilt user interface featuring system or user selectable dark mode!

• Support for Kafka 3 in for both consumption and publishing with Kafka.

• Now able to split binary Packet Capture (PCAP) with SplitPCAP

• Microsoft Excel XLSX files can be split to individual sheets with SplitExcel.

  • This is a good example of the increasingly common usage of NiFi in the wild to capture and transform unstructured or semi-structured data and deliver it to systems such as databases, vector stores, and more.

• DeleteFile allows for removal of local files

  • The List/Fetch pattern was the beginning of the movement and Delete* components help complete it. NiFi is increasingly being used not just for the traditional continuous and automated capture of data streams but also for more change data capture/replication scenarios.

• New interface for Python extensions supporting components which source new data called FlowFileSource

Notable Improvements

• Added Python Processor support to MiNiFi framework
• Added App Installation Token support to GitHub FlowRegistryClient
• Improved framework keystore and truststore handling to support dynamic reloading for cluster communication
• Changed from RSA to Ed25519 for signing and verification of Application Bearer Tokens

Breaking Changes

• Moved nifi-python-extensions to new Git repository
• Removed support for application property protection and encrypt-config
• Removed REST API support for Apache Knox SSO authentication
• Removed REST API support for Kerberos SPNEGO authentication

Version 2.0.0-M3

Version 2.0.0-M3 is the third milestone version of Apache NiFi 2.0.0.

Release Date: May 16, 2024

Jira Release Notes for 2.0.0-M3

Please refer to the Deprecated Components and Features documentation for items removed in this version.

Migrating Deprecated Components and Features for 2.0.0 includes current progress on the steps necessary for migrating certain components and features.

New Capabilities

• The new Apache NiFi UI is included and available at the /nf context path!

  • The current stable and pre-existing nifi UI remains available at https://host:port/nifi
  • The new UI is available at https://host:port/nf
  • This is an entirely newly implemented UI that remains faithful to most of the existing user experience but cleans things in up in various ways. It provides a far more modern stack to build on and includes various niceties such as a dark mode - to all those enterprises around the world that have been using NiFi in SOC or other dark rooms for a long time - we're sorry it took so long but you'll love the new dark theme. Once the new UI has all the critical bits to be fully GA we will remove the old one and the only context path will be 'nifi'.

• Python components can now be loaded from a NAR with included dependencies. This allows for strong development processes which leverage pip or anacodona but keeps secure practices in place for deployment where such processes may be blocked.

• OpenID Connect integration now supports the OAuth 2.0 Client Credentials Flow for programmatic access. The Authorization Code Flow now supports Proof Key for Code Exchange for enhanced security with browser-based authentication.

• New RecordReader and support for Protobuf.

• Support for OpenSearch to both publish and query vectors/embeddings.

• New capability allows usage of a Flow Registry client where the 'registry' is simply a Github Repo. The can greatly simplify the SDLC processes and this mechanism now supports branches!

Key Improvements

• The Python integration is really solid and tested both at scale and for behaviors over long duration. Logging behaviors and packaging options all improved.
• We have upgraded nearly all major dependencies and thousands of minor dependencies to their latest available versions and removed components for which dependencies are no longer actively maintained.

Breaking Changes

• Removed separate distribution of Kafka Connect modules from external modules
• Removed Apache Accumulo 2 Processors and Services
• Removed Apache Atlas Reporting Task
• Removed Apache Hive 3 Processors and Services
• Removed Apache Ranger Plugin
• Removed Apache Solr Processors
• Removed Cassandra 3 Processors and Services
• Removed ConvertAvroToJSON Processor
• Removed Couchbase Processors and Services
• Removed Datadog Reporting Task
• Removed ExecuteStateless Processor
• Removed InvokeAWSGatewayApi Processor
• Removed Spark Livy Components

Version 2.0.0-M2

Version 2.0.0-M2 is the second milestone version of Apache NiFi 2.0.0.

This version includes a number of new features and substantial dependency upgrades, as well as several breaking changes.

Release Date: January 29, 2024

Jira Release Notes for 2.0.0-M2

New Components

• Controller Services

  • DatabaseTableSchemaRegistryService
  • StandardKustoIngestService
  • StandardJsonSchemaRegistry
  • ZendeskRecordSink

• Processors

  • CalculateParquetOffsets
  • CalculateParquetRowGroupOffsets
  • FilterAttribute
  • PublishSlack
  • PutMongoBulk
  • PutAzureDataExplorer
  • PutZendeskTicket

Notable Upgrades

• Spring Framework 6
• Jetty 12
• Jakarta Servlet API 6
• Jakarta XML Binding 4
• Swagger 2 annotations
• OpenAPI 3.0 REST API specification

Breaking Changes

• Removed MiNiFi C2 Server modules and Docker image configuration
• Relocated JoltTransformJSON and JoltTransformRecord from nifi-standard-nar to nifi-jolt-nar
• Removed InfluxDB Processors
• Removed Bootstrap Notification Services
• Moved from SimpleDateFormat to DateTimeFormatter for date and time parsing and formatting
• Moving from Servlet API 3 and Servlet API 6 requires custom user interface extensions to be updated and recompiled

Version 2.0.0-M1

Version 2.0.0-M1 is the first milestone version of Apache NiFi 2.0.0. This version includes over 900 issues resolved, including new features as well as numerous improvements and bug fixes.

Please refer to the Deprecated Components and Features documentation for items removed in this version.

Migrating Deprecated Components and Features for 2.0.0 includes current progress on the steps necessary for migrating certain components and features.

Release Date: November 25, 2023

Jira Release Notes for 2.0.0-M1

New Features and Changes for 2.0.0-M1

• Initial version of native Python API for Processors

• Stateless Execution mode for Process Groups

• Flow Analysis Rules API

• Kubernetes-based Leader Election and State Management extensions

• Python-based Processors for interacting with ChatGPT and Vector Databases

• ListenOTLP Processor for collecting OpenTelemetry

• ListenSlack and ConsumeSlack Processors for handling messages from Slack

• EncryptContentAge and DecryptContentAge Processors supporting age-encryption.org specification

• Schema Registry Services for Amazon Glue and Apicurio

• Parameter Provider for 1Password Vault

• YamlTreeReader for YAML as Records

• PackageFlowFile Processor for writing file streams and attributes as FlowFile Version 3

• Migrated from H2 Database Engine to JetBrains Xodus for storing Flow Configuration History

• Moved several modules to optional build profiles, requiring separate NAR download from the Central Repository

  • nifi-hadoop-nar
  • nifi-hadoop-libraries-nar
  • nifi-hbase-nar
  • nifi-hbase2_client-service-nar
  • nifi-kudu-nar
  • nifi-parquet-nar
  • nifi-solr-nar