Enhancements

What's New

This section consists of the enhancements by services introduced in this release.

Ambari

ODP JIRA

Apache JIRA

Description

ODP-4792


Improved the MirrorMaker service labels for Kafka 2.

ODP-4764


Fixed the Oozie URL in Knox topology for the protocol.

ODP-4609


Updated the component versions.

ODP-4637


Updated the Zeppelin version.

ODP-4255


Added utils in ambari-agent (#261).

ODP-3611


Added the default proxy user configuration for Hue (#267).

ODP-4500

ODP-4504


Fixed the exposed password and credentials for Kafka Connect and Kafka MirrorMaker.

This fix requires a broker restart after a configuration change.

ODP-4495


Masked the exposed passwords for Kafka and Cruise Control (#275).

ODP-4279


Fixed the exposed password and credentials on Druid (#271).

ODP-4502


Added the missing default configuration for stack 3.3.

ODP-4294


Added the Oozie SSL properties by default to resolve the exposed issue (#266).

Flink

ODP JIRA

Apache JIRA

Description

ODP-4573


Bumped maven-shade-plugin version to 3.6.0 (#8).

ODP-4538


Bumped Hadoop version to 3.3.6.x (#6).

ODP-4280


Enhanced the Flink HS Web UI with obfuscated SSL password support (#5).

ODP-4277


Added the Hive connector to match v4.0.1 and made it as default.

ODP-3161|


Updated the Hive version to 4.0.1.

Hadoop

ODP JIRA

Apache JIRA

Description

ODP-2409


Upgraded the bootstrap version to 5.3.3.

ODP-4427


Reverted and applied the triple-beam version resolutions.

ODP-4277

HADOOP-18916

Excluded all the module-info classes from the uber jars (#6131).

ODP-4277

HADOOP-18929

Excluded commons-compress module-info.class (#6170).

ODP-4277

HADOOP-18441

Removed the Hadoop custom ServicesResourceTransformer (#4850).

ODP-3861

MAPREDUCE-7201

Made the job history file permissions configurable (#4507).


HADOOP-19107

Removed the support for HBase v1 and upgrade HBase v2 (#6629)


HADOOP-18039

Upgraded the HBase 2 version and fixed TestTimelineWriterHBaseDown (#3768).

ODP-2883

HADOOP-18487

Removed Protobuf 2.5 (part 2) by stopping the export of protobuf-2.5 (#6185).

ODP-2883

HADOOP-18487

Made Protobuf 2.5 an optional runtime dependency (#4996).

ODP-3467

HDFS-16777

Addressed sonatype-2020-0988 vulnerability in datatables@1.10.17 (#5003).

ODP-2935


Excluded JLine and added a version compatible with JDK 8 (#87).

HBase

ODP JIRA

Apache JIRA

Description

ODP-4277


Added the supplemental license info for the JBoss and WildFly dependencies.

ODP-4607


Compiled and built with JDK 8 to maintain synchronization with Hadoop.

Hue

ODP JIRA

Apache JIRA

Description

ODP-4348


Updated the Hue version and removed the GPL library.

ODP-4457


Set collect_usage to False by default.

ODP-4408


Set desktop_server_group to Hue's primary group.

ODP-4275


Simplified the secret key generating script.

ODP-3809


Automatically configures Livy in Hue upon installation.

ODP-4387


Enabled the automatic configuration for YARN in Hue.

ODP-2557


Enabled the Hive auto-configuration.

ODP-4284


Removed the plaintext passwords from Hue.

ODP-4407


Checks the length of the Hive interactive list.

Kafka 2

ODP JIRA

Apache JIRA

Description

ODP-4277


Eliminated the cyclic dependencies and made changes to use internal versions of components.

ODP-4277


Removed Maven Central and excluded the Zookeeper slf4j-api module to resolve SLF4J upgrade conflicts in Zookeeper.

ODP-4434


Resolved the Kafka compatibility issue with Scala 2.13 by upgrading to Jackson 2.16.

ODP-4288

KAFKA-14376

Added ConfigProvider to make use of environment variables KIP-887.

Knox

ODP JIRA

Apache JIRA

Description

ODP-4277


Fixed the compile issues with enforcer enablement and handling ODP internal versions and undeclared Jakarta activation version dependency.

ODP-4362

KNOX-2896

Reverted the default API service view to v2.

ODP-4362

KNOX-2881

Updated KnoxCLI to correctly handle aliases when testing LDAP (system) authentication.

ODP-4362

KNOX-3003

Services with more than one serviceUrl metadata are grouped on the Knox Home page.

Kudu

ODP JIRA

Apache JIRA

Description

ODP-4277


Fixed ODP versions and updated mavenPublishUrl.

NiFi

ODP JIRA

Apache JIRA

Description

ODP-4606


Updated HBase -hadoop3 to ODP specific version

ODP-4277


Aligned the versions to ODP components and removed the duplicate dependencies.

ODP-4272


Fixed the NiFi and NiFi Registry services check for JDK11 compatibility.

ODP-3950


Improved the NiFi logging for concurrent requests.

Oozie

ODP JIRA

Apache JIRA

Description

ODP-4277


Aligned the ODP matching version and fixed the fluent-job-api failure.

Ozone

ODP JIRA

Apache JIRA

Description

ODP-4277


Fixed the aws-java-sdk version to match upstream.

Sqoop

ODP JIRA

Apache JIRA

Description

ODP-3785


Updated the HBase version in Sqoop.

ODP-4588


Allows the multi-digit build numbers in the version pattern regex in build.gradle.

Trino

ODP JIRA

Apache JIRA

Description

ODP-4277


Fixed upper-bound rule dependency issue with trino-ranger.

ODP-4277


Aligned the ODP version and fixed compilation issues.

ZooKeeper

ODP JIRA

Apache JIRA

Description

ODP-4350

ZOOKEEPER-4717

Cache serializes data in the request to avoid repeated serialization. (apache#2030)

ODP-4350

ZOOKEEPER-4508

Implemented client-side session expiration to prevent endless connection loss.

ODP-4350

ZOOKEEPER-4752

Removed version files in zookeeper-server/src/main from .gitignore.

ODP-4350

ZOOKEEPER-4804

Updated the Netty client to use daemon threads for improved resource management.


Backported Ranger Updates from 2.6.0 to ODP v2.5.0.3.3.6.2-1

Jira ID

Description

Version

RANGER-4891

Replaced PrivilegedAction with PrivilegedExceptionAction in UserGroupInformation.doAs().

2.6.0

RANGER-4814

Upgraded Aircompressor library to version 0.27.

2.6.0

RANGER-4912

Upgraded Spring Framework to version 5.3.39.

2.6.0

RANGER-4809

Added utility to migrate admin audit logs to x_trx_log_v2 table.

2.6.0

RANGER-4964

Fixed index issue in x_trx_log table that caused patch failures.

2.6.0

RANGER-5068

Upgraded RAT Maven plugin to version 0.16.1.

2.6.0

RANGER-5095

Upgraded Apache Atlas to version 2.4.0 to resolve CVEs.

2.6.0

RANGER-5072

Upgraded Avro library from 1.11.3 to 1.11.4.

2.6.0

RANGER-5087

Upgraded Nimbus JOSE + JWT library to version 10.0.1.

2.6.0

RANGER-5091

Upgraded dnsjava to version 3.6.2 to address CVE-2024-25638.

2.6.0

RANGER-5086

Upgraded Protobuf to version 3.25.5.

2.6.0

RANGER-5024

Upgraded Jetty dependency to address CVE-2024-8184.

2.6.0

RANGER-4892

Upgraded Ranger Tomcat from 8.5.x to 9.x.

2.6.0

RANGER-5001

Updated policy evaluation to ignore denials for descendant resources.

2.6.0

RANGER-4670

Made HBase plugin authorization level configurable for table, column family, and column levels.

2.6.0

RANGER-5007

Exposed service configurations set in Ranger UI for plugin use.

2.6.0


Backported Enhancements from 3.0.0 to ODP-Ambari v2.7.9.2-1

Jira ID

Ambari ID

Description

ODP-4614

AMBARI-25084

Fixed issue where deleting identities failed when removing a service in reverse order.

ODP-4615

AMBARI-26517

Prevented database connection check from printing passwords in logs.

ODP-4349

AMBARI-25952

Upgraded spring-security-core from 5.7.2 to 5.7.8.

ODP-4349

AMBARI-25953

Upgraded PostgreSQL driver from 42.2.2 to 42.3.8.

ODP-4349

AMBARI-25986

Upgraded Ambari Hadoop dependency version.

ODP-4349

AMBARI-26184

Resolved CVE in SnakeYAML 1.12.

ODP-4349

AMBARI-26103

Removed Google Analytics in compliance with ASF Privacy Policy.

ODP-4349

AMBARI-26201

Added server link for ZooKeeper Admin Server.

ODP-4349

AMBARI-26270

Added quick link to HiveServer2 Web UI.

ODP-4349

AMBARI-24976

Listed Ozone as a supported file system service.

ODP-4349

AMBARI-26197

Added Distro dependency to Ambari Agent.

ODP-4349

AMBARI-26012

Documented procedure for reporting security issues.

ODP-4349

AMBARI-26236

Increased database password character type requirements.



  Last updated