Bug Fixes

Airflow

ODP-6345 | ODP-6343 | OCR-2418 : Improved Airflow build and runtime issues for py3 2.8.3 airflow

Ambari

• ODP-6728: Added Spark4 in TARBALL_MAP.
• ODP-6688: Renamed removed Java option to the JDK 17 compatible version in comments.
• ODP-6510: Fixed runtime issues caused by upgrades done for CVEs.
• ODP-6555: Added missing import for the binascii module.
• ODP-6529: Fixed two-way SSL enablement failures between Ambari and Ambari Agent with Python3 caused by TypeError: POST data should be bytes.
• ODP-6451: Fixed Oozie status failures on non-SSL stack 3.3 deployments.
• ODP-6560: Fixed upgrade restart failures caused by NPEs and Python3 dictionary iteration errors.
• ODP-6555: Handled corrupt encrypted cluster cache issues during agent startup.
• ODP-6451: Fixed Oozie status failures on non-SSL deployments.
• ODP-6452: Fixed Zeppelin URL issues.
• ODP-5801: Added DFSRouter fixes to support Kerberos and other setup issues.
• ODP-6505: Added HBase Thrift identity and alert enablement.
• ODP-6507: Fixed alert loader initialization with the correct stack directory.
• ODP-6506: Fixed alert script stack mapping to ODP-3.3 and Namenode related issues.
• ODP-6422: Made PostgreSQL a soft dependency requirement.
• ODP-6386: Fixed minor deprecation warnings in ambari_jinja2.
• ODP-6189: Updated plain Java references to ambari_java_home for the CredentialUtil class.
• ODP-6304: Fixed HdfsResource silently dropping large files when WebHDFS was enabled.
• OCR-2382: Fixed hardcoded heap values in HBase services.
• OCR-2349: Fixed HostCleanup.py incompatibility with Python 3.11 and merged hostcheck INI files.

Druid

• ODP-6583: Bumped Netty to 4.1.132.Final.
• Excluded jaxb from hive-common -> tez-api -> hadoop-yarn-api.

Flink

• ODP-6293: Upgraded Scala from 2.12.7 to 2.12.18 to fix classfile parsing issues with updated commons-lang3 dependency.
• ODP-6217: Added jcip-annotations dependency to flink-runtime.
• ODP-6217: Updated jcip-annotations dependency to maintained coordinates.

Hadoop

• HADOOP-18583: Fixed loading of OpenSSL 3.x symbols.
• ODP-6342: Bumped Netty to 4.1.132.Final.
• HDFS-17754: Added uriparser2 to notices.
• HADOOP-18757: Fixed S3A Committer finalizing commits in a single thread.
• ODP-6223: Fixed error_prone_annotations dependency convergence in timelineservice-hbase-common.
• ODP-6311 | HDFS-17680: Fixed redirects for HTTPS Datanode server.
• HDFS-13695: Moved logging to SLF4J in HDFS package.
• HADOOP-18957: Updated usage to StandardCharsets.UTF_8.
• HADOOP-17123: Removed Guava Preconditions from hadoop-common-project modules.
• HDFS-16616: Removed usage of org.apache.hadoop.util.Sets.
• HADOOP-17970: Removed Guava Preconditions from hdfs-projects modules.

HBase

• ODP-6583: Bumped Netty to 4.1.132.Final.
• ODP-6216: Updated jcip-annotations dependency to maintained coordinates.
• ODP-6216: Fixed missing jcip-annotations dependency for hbase-client builds.

Hive

• ODP-6583: Bumped Netty to 4.1.132.Final.
• ODP-6280 | HIVE-24167: Fixed compilation failures caused by equivalence mapping violations when CTE materialization was enabled.
• ODP-6137: Fixed Log4j compile issues.

Hue

• ODP-6583: Bumped Netty to 4.1.132.Final.

JupyterHub

• ODP-6385: Added missing runtime scripts.

Kafka 2

• ODP-6672: Updated Kafka Connect runtime connector dependencies to ODP-3.3.6.4-1 versions.
• ODP-6585: Fixed Kafka build failures caused by syntax issues.
• ODP-6583: Bumped Netty to 4.1.132.Final.

Kafka 3

• ODP-6672: Updated Kafka Connect runtime connector dependencies to ODP-3.3.6.4-1 versions.

Knox

• ODP-6342: Bumped Netty version to 4.1.132.Final.

Kudu

• ODP-6583: Bumped Netty to 4.1.132.Final.

Livy

• ODP-6342: Bumped Netty version to 4.1.132.Final.
• OCR-2436 | LIVY-1012: Replaced SslContextFactory with SslContextFactory.Server().

NiFi / NiFi Registry

• ODP-6583: Bumped Netty to 4.1.132.Final.
• OCR-2401: Partially reverted DriveService scope changes.
• OCR-2401 | NIFI-15734: Fixed GCP PubSub/BigQuery scope issues for Workload Identity with Impersonation.

Oozie

• ODP-6228-Addendum: Fixed variable RankDir cannot find symbol issue.
• ODP-6591: Fixed missing Hadoop client JAR versions in dependencyManagement.
• ODP-6455: Fixed Oozie logging issues by excluding Log4j2 bridge JARs.
• ODP-6403: Fixed Hive-service missing JAR issues.
• ODP-6228: Updated APIs with graphviz-java upgrade.
• ODP-6424: Updated Spark3 support version to 3.3.6.4-1.

Ozone

• ODP-6180 | HDDS-14762: Fixed script issues for Ozone Log4j options.

Phoenix

• ODP-6583: Bumped Netty to 4.1.132.Final.

Pinot

• ODP-6583: Bumped Netty to 4.1.132.Final.

Ranger

• ODP-6583: Bumped Netty to 4.1.132.Final.
• ODP-6209: Fixed Ranger S3 policy updates not overwriting existing policies.
• ODP-6314: Made ozone.om.service.ids optional for Ranger Ozone connections to support non-HA OM setups

Schema Registry

• ODP-6330: Fixed java.lang.NoSuchMethodError: org.yaml.snakeyaml.parser.ParserImpl.
• ODP-4830: Allowed project builds when mavenUrl or snapMavenUrl were not specified.

Spark 3

• ODP-6583: Bumped Netty to 4.1.132.Final.
• ODP-6379: Updated PySpark version to match ODP.

Zeppelin

• ODP-6583: Bumped Netty to 4.1.132.Final.
• ZEPPELIN-6375: Added auto-reconnect support for abnormal WebSocket closures in the new UI.

Zookeeper

• ODP-6583: Bumped Netty to 4.1.132.Final.