Enhancements

This section consists of the enhancements by services introduced in this release.

Ambari

ODP JIRAApache JIRADescription
ODP-1816Implemented the Ranger Kafka plugin for both Kafka and Kafka 3.
ODP-1817Set the Ambari and Infra Solr versions.
ODP-1813Removed Oozie and Spark 2 from the Ambari stack.
ODP-1627Added the keyadmin LDAP user.
ODP-1690Added the Knox Homepage UI to Knox via quicklinks.json.

ODP-1530

ODP-1612

The Ambari changes for JDK11 Runtime Support for Hadoop, Hive, Infra-Solr, Yarn, and Druid.
ODP-1782Added the ODP-3.3 stack in the Ambari stack.

ODP-1724

ODP-1849

Added the ODP stack JDK11 branch versions.
ODP-1336Added the cluster admin permission to allow user management access and fixed Python3 warnings.

ODP-1545

ODP-887

Added JDK11 support for 3.x stacks.
ODP-1995Updated the Ranger version to 2.5.0.
ODP-1913Upgraded the Java library versions for CVE reconciliation.
ODP-2186Updated the jdk version in the ambari-server setup
ODP-1873AMBARI-2611 | AMBARI-26119 | AMBARI-26122 | AMBARI-2510 | AMBARI-25956 | AMBARI-26130 | AMBARI-26093Fixed a few security issues and components getting restarted in maintenance mode with the restart of all.
ODP-1951AMBARI-26073 | AMBARI-26116 | AMBARI-26109 | AMBARI-26141 | AMBARI-26136Added DFSRouter via the 'Actions Button' on the HDFS summary page (#118).
ODP-2369Removed the spark2-client dependency for Zeppelin from parameters.
ODP-2311Added the 3.4 stack for future ODP upgrade.

Druid

ODP JIRAApache JIRADescription
ODP-1904The ODP stack and CVE libraries versions reconciliation.

Hadoop

ODP JIRAApache JIRADescription
ODP-1104Updated the snappy-java version to 1.1.10.4 andsnappy-java version to 1.1.10.4-v2
ODP-1781HADOOP-19116Updated the Zookeeper client version to 3.8.4 to fix CVE-2024-23944.
ODP-1103HADOOP-15327Upgraded MR ShuffleHandler to use Netty4.
ODP-1103Upgraded the netty4 version to 4.1.94.

HBase

ODP JIRAApache JIRADescription
ODP-1498Added the support for JDK11.
ODP-1900HADOOP-19116Upgraded the Guava version for CVE reconciliation.

Hive

ODP JIRAApache JIRADescription
ODP-1672Updated the LLAP Daemon log4j2 routing properties.
ODP-1950Upgraded the Hive schema version from 3.1.4 to 4.0.0.
ODP-1904ODP stack & CVE libraries versions reconciliation.

Impala

ODP JIRAApache JIRADescription
ODP-1642Upgrade the Hive schema from 3.1.4 to 4.0.0.
ODP-1950HIVE-28226Split Replication Commands from HiveParser.g.
ODP-2162HIVE-28399Improved the fetch size in HiveConnection.
ODP-2377Built Impala using the ODP jars.
ODP-1926Improved the Impala Ranger Authorizer with auto-populated ranger service cache and SSL management.

Livy

ODP JIRAApache JIRADescription
ODP-1906Livy-ODP and CVE versions reconciliation.
ODP-2095Fixed the Repl folder missing and netty4 version issues. Also, updated hadoop.major-minor.version as 3.
ODP-2117Added additional Java imports for pyspark.
ODP-1630Livy - porting ODP-main now commits into ODP-0.8.0-jdk11
ODP-1351Fixed the Spark3 livy0.7 TypeError: required field "type_ignores" missing from Module and other python3 fixes.

NiFi

ODP JIRAApache JIRADescription
ODP-2101Fixed the nifi-asana-services issue due to the error: the package com.google.gson.annotations does not exist.
ODP-1880Enabled the endpoint override option for S3FileResourceService to allow internal object store custom URLs.

Ozone

ODP JIRAApache JIRADescription
ODP-2142Added the Ozone JAVA_GC_ ARGS for JAVA 11 compatibility.

Phoenix

ODP JIRAApache JIRADescription
ODP-1920Upgraded Commons-codec, Curator, and Thrift versions for CVE reconciliation.

Ranger

ODP JIRAApache JIRADescription
ODP-1816Added the Kafka Ranger environment for Kafka 3.0 compatibility.
ODP-2127Upgraded Bump Hbase to 2.5.8 and Zookeeper to 3.8.4 in Ranger 2.5.0 to support the ODP stack.
ODP-2116Added the missing jars for the Kafka and Ozone plugins.

Schema Registry

ODP JIRAApache JIRADescription
ODP-1908 ODP-2051Upgraded snakeyml, jackson, and scala versions for CVE reconciliation.

Spark 3

ODP JIRAApache JIRADescription
ODP-1486Built Spark 3.5.1 with JDK11.
ODP-756Included Open Table formats such as Hudi, Delta, and Iceberg to spark jar.
ODP-1262Added the support for Python 3.11.
ODP-1486 ODP-1303SPARK-45732Upgraded commons-text to 1.11.0.
ODP-1699Fixed the spark-core test failures.
ODP-2020 ODP-1095Fixed the critical CVE patches.
ODP-1916SPARK-39653Done partial reverting to add populate fn for handling WritableColumnVector.
ODP-2118Upgraded Hudi, DeltaLake, and Iceberg versions for open table clients.
ODP-1971Spark3 - reverted the Kafka version to 3.4.1.

Tez

ODP JIRAApache JIRADescription
ODP-1237Excluded multiple slf4j binding warns for Tez.

Zeppelin

ODP JIRAApache JIRADescription
ODP-1829Updated the pom.xml files.
ODP-1644Added two variables that were previously missed.
ODP-1644Hive 4.0.0 now supports JDBC.
ODP-1644Added libthrift and updated the Hadoop and Phoenix versions.
Updated to the Spark Version.
Removed the unsupported interpreters.

Kafka-2

ODP JIRAApache JIRADescription
ODP-1921Updated jackson, netty, and the snappy versions in dependencies.gradle.

Cruise Control-2

ODP JIRAApache JIRADescription
ODP-1649Updated the Zookeeper and netty versions in gradle.properties.
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard
  Last updated on Oct 15, 2024
Next to read:
Bug Fixes
null
On This Page
EnhancementsAmbariDruidHadoopHBaseHiveImpalaLivyNiFiOzonePhoenixRangerSchema RegistrySpark 3TezZeppelinKafka-2Cruise Control-2