Enhancements
This section consists of the enhancements by services introduced in this release.
ODP-Ambari
Ambari
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4792 | Improved the MirrorMaker service labels for Kafka 2. | |
| ODP-4764 | Fixed the Oozie URL in Knox topology for the protocol. | |
| ODP-4609 | Updated the component versions. | |
| ODP-4637 | Updated the Zeppelin version. | |
| ODP-4255 | Added utils in ambari-agent (#261). | |
| ODP-3611 | Added the default proxy user configuration for Hue (#267). | |
ODP-4500 ODP-4504 | Fixed the exposed password and credentials for Kafka Connect and Kafka MirrorMaker. This fix requires a broker restart after a configuration change. | |
| ODP-4495 | Masked the exposed passwords for Kafka and Cruise Control (#275). | |
| ODP-4279 | Fixed the exposed password and credentials on Druid (#271). | |
| ODP-4502 | Added the missing default configuration for stack 3.3. | |
| ODP-4294 | Added the Oozie SSL properties by default to resolve the exposed issue (#266). |
Flink
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4573 | Bumped maven-shade-plugin version to 3.6.0 (#8). | |
| ODP-4538 | Bumped Hadoop version to 3.3.6.x (#6). | |
| ODP-4280 | Enhanced the Flink HS Web UI with obfuscated SSL password support (#5). | |
| ODP-4277 | Added the Hive connector to match v4.0.1 and made it as default. | |
| ODP-3161| | Updated the Hive version to 4.0.1. |
Hadoop
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-2409 | Upgraded the bootstrap version to 5.3.3. | |
| ODP-4427 | Reverted and applied the triple-beam version resolutions. | |
| ODP-4277 | HADOOP-18916 | Excluded all the module-info classes from the uber jars (#6131). |
| ODP-4277 | HADOOP-18929 | Excluded commons-compress module-info.class (#6170). |
| ODP-4277 | HADOOP-18441 | Removed the Hadoop custom ServicesResourceTransformer (#4850). |
| ODP-3861 | MAPREDUCE-7201 | Made the job history file permissions configurable (#4507). |
| HADOOP-19107 | Removed the support for HBase v1 and upgrade HBase v2 (#6629) | |
| HADOOP-18039 | Upgraded the HBase 2 version and fixed TestTimelineWriterHBaseDown (#3768). | |
| ODP-2883 | HADOOP-18487 | Removed Protobuf 2.5 (part 2) by stopping the export of protobuf-2.5 (#6185). |
| ODP-2883 | HADOOP-18487 | Made Protobuf 2.5 an optional runtime dependency (#4996). |
| ODP-3467 | HDFS-16777 | Addressed sonatype-2020-0988 vulnerability in datatables@1.10.17 (#5003). |
| ODP-2935 | Excluded JLine and added a version compatible with JDK 8 (#87). |
HBase
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4277 | Added the supplemental license info for the JBoss and WildFly dependencies. | |
| ODP-4607 | Compiled and built with JDK 8 to maintain synchronization with Hadoop. |
Hue
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4348 | Updated the Hue version and removed the GPL library. | |
| ODP-4457 | Set collect_usage to False by default. | |
| ODP-4408 | Set desktop_server_group to Hue's primary group. | |
| ODP-4275 | Simplified the secret key generating script. | |
| ODP-3809 | Automatically configures Livy in Hue upon installation. | |
| ODP-4387 | Enabled the automatic configuration for YARN in Hue. | |
| ODP-2557 | Enabled the Hive auto-configuration. | |
| ODP-4284 | Removed the plaintext passwords from Hue. | |
| ODP-4407 | Checks the length of the Hive interactive list. |
Kafka 2
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4277 | Eliminated the cyclic dependencies and made changes to use internal versions of components. | |
| ODP-4277 | Removed Maven Central and excluded the Zookeeper slf4j-api module to resolve SLF4J upgrade conflicts in Zookeeper. | |
| ODP-4434 | Resolved the Kafka compatibility issue with Scala 2.13 by upgrading to Jackson 2.16. | |
| ODP-4288 | KAFKA-14376 | Added ConfigProvider to make use of environment variables KIP-887. |
Knox
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4277 | Fixed the compile issues with enforcer enablement and handling ODP internal versions and undeclared Jakarta activation version dependency. | |
| ODP-4362 | KNOX-2896 | Reverted the default API service view to v2. |
| ODP-4362 | KNOX-2881 | Updated KnoxCLI to correctly handle aliases when testing LDAP (system) authentication. |
| ODP-4362 | KNOX-3003 | Services with more than one serviceUrl metadata are grouped on the Knox Home page. |
Kudu
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4277 | Fixed ODP versions and updated mavenPublishUrl. |
NiFi
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4606 | Updated HBase -hadoop3 to ODP specific version | |
| ODP-4277 | Aligned the versions to ODP components and removed the duplicate dependencies. | |
| ODP-4272 | Fixed the NiFi and NiFi Registry services check for JDK11 compatibility. | |
| ODP-3950 | Improved the NiFi logging for concurrent requests. |
Oozie
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4277 | Aligned the ODP matching version and fixed the fluent-job-api failure. |
Ozone
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4277 | Fixed the aws-java-sdk version to match upstream. |
Sqoop
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-3785 | Updated the HBase version in Sqoop. | |
| ODP-4588 | Allows the multi-digit build numbers in the version pattern regex in build.gradle. |
Trino
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4277 | Fixed upper-bound rule dependency issue with trino-ranger. | |
| ODP-4277 | Aligned the ODP version and fixed compilation issues. |
ZooKeeper
| ODP JIRA | Apache JIRA | Description |
|---|---|---|
| ODP-4350 | ZOOKEEPER-4717 | Cache serializes data in the request to avoid repeated serialization. (apache#2030) |
| ODP-4350 | ZOOKEEPER-4508 | Implemented client-side session expiration to prevent endless connection loss. |
| ODP-4350 | ZOOKEEPER-4752 | Removed version files in zookeeper-server/src/main from .gitignore. |
| ODP-4350 | ZOOKEEPER-4804 | Updated the Netty client to use daemon threads for improved resource management. |
Backported Ranger Updates from 2.6.0 to ODP v2.5.0.3.3.6.2-1
| Jira ID | Description | Version |
|---|---|---|
| RANGER-4891 | Replaced PrivilegedAction with PrivilegedExceptionAction in UserGroupInformation.doAs(). | 2.6.0 |
| RANGER-4814 | Upgraded Aircompressor library to version 0.27. | 2.6.0 |
| RANGER-4912 | Upgraded Spring Framework to version 5.3.39. | 2.6.0 |
| RANGER-4809 | Added utility to migrate admin audit logs to x_trx_log_v2 table. | 2.6.0 |
| RANGER-4964 | Fixed index issue in x_trx_log table that caused patch failures. | 2.6.0 |
| RANGER-5068 | Upgraded RAT Maven plugin to version 0.16.1. | 2.6.0 |
| RANGER-5095 | Upgraded Apache Atlas to version 2.4.0 to resolve CVEs. | 2.6.0 |
| RANGER-5072 | Upgraded Avro library from 1.11.3 to 1.11.4. | 2.6.0 |
| RANGER-5087 | Upgraded Nimbus JOSE + JWT library to version 10.0.1. | 2.6.0 |
| RANGER-5091 | Upgraded dnsjava to version 3.6.2 to address CVE-2024-25638. | 2.6.0 |
| RANGER-5086 | Upgraded Protobuf to version 3.25.5. | 2.6.0 |
| RANGER-5024 | Upgraded Jetty dependency to address CVE-2024-8184. | 2.6.0 |
| RANGER-4892 | Upgraded Ranger Tomcat from 8.5.x to 9.x. | 2.6.0 |
| RANGER-5001 | Updated policy evaluation to ignore denials for descendant resources. | 2.6.0 |
| RANGER-4670 | Made HBase plugin authorization level configurable for table, column family, and column levels. | 2.6.0 |
| RANGER-5007 | Exposed service configurations set in Ranger UI for plugin use. | 2.6.0 |
Backported Enhancements from 3.0.0 to ODP-Ambari v2.7.9.2-1
| Jira ID | Ambari ID | Description |
|---|---|---|
| ODP-4614 | AMBARI-25084 | Fixed issue where deleting identities failed when removing a service in reverse order. |
| ODP-4615 | AMBARI-26517 | Prevented database connection check from printing passwords in logs. |
| ODP-4349 | AMBARI-25952 | Upgraded spring-security-core from 5.7.2 to 5.7.8. |
| ODP-4349 | AMBARI-25953 | Upgraded PostgreSQL driver from 42.2.2 to 42.3.8. |
| ODP-4349 | AMBARI-25986 | Upgraded Ambari Hadoop dependency version. |
| ODP-4349 | AMBARI-26184 | Resolved CVE in SnakeYAML 1.12. |
| ODP-4349 | AMBARI-26103 | Removed Google Analytics in compliance with ASF Privacy Policy. |
| ODP-4349 | AMBARI-26201 | Added server link for ZooKeeper Admin Server. |
| ODP-4349 | AMBARI-26270 | Added quick link to HiveServer2 Web UI. |
| ODP-4349 | AMBARI-24976 | Listed Ozone as a supported file system service. |
| ODP-4349 | AMBARI-26197 | Added Distro dependency to Ambari Agent. |
| ODP-4349 | AMBARI-26012 | Documented procedure for reporting security issues. |
| ODP-4349 | AMBARI-26236 | Increased database password character type requirements. |
Was this page helpful?