Bug Fixes

JIRA ID

Apache ID

Description

ODP-5962

—

Fixed Kafka Connect issue where the local variable password_value could not be accessed.

ODP-5956

—

Fixed Spark2 Thrift picking the wrong environment configuration for Kerberos keytab and principal.

ODP-5885

—

Set the default value of command_file_retention_policy when it was not already set.

ODP-5291

—

Set command_file_retention_policy to remove.

OCR-2354

—

Added support for Kafka client.

ODP-5896

—

Added hive.tez.java.opts support for JDK 8 and JDK 11.

ODP-5890

—

Added support for JDK 8 and JDK 11 JVM parameters for Druid.

ODP-5888

—

Prevented TemplateNotFound errors during Kafka upgrades.

ODP-5876

—

Fixed Cruise Control SSL password exports in cruise-control-env.

ODP-5854

—

Removed old MirrorMaker2 configuration files.

ODP-5868

—

Removed cryptography dependency from the Ambari agent.

ODP-5853

—

Fixed credential helper to handle JCEKS in stack services.

ODP-5850

—

Fixed password scope handling by using self.value in PasswordString.str.

ODP-5787

—

Fixed curl out-of-memory issue for large files by falling back to the HDFS resource JAR.

ODP-5833

—

Updated MR2 version to 3.2.3.

ODP-5777

—

Fixed missing pwd module handling for Kerberos client installation.

ODP-5776

—

Updated MR2 version to 3.3.6.

ODP-5607

—

Cherry-picked ODP-839 to update the Oozie upgrade setup command and result output.

ODP-5788

—

Fixed Oozie restart failure during stack upgrade.

ODP-5620

—

Updated restart role order for Kafka and Ranger.

ODP-5737

—

Fixed Hive service check failure with SSL enabled when retrieving passwords from the credential store.

ODP-5810

—

Fixed JournalNode start failure when adding additional namespaces.

ODP-5819

—

Fixed configuration case for the Druid SSL alias property.

ODP-5811

—

Handled auth_to_local for JournalNode before HA enablement and allowed disabling Kerberos without failures.

ODP-5827

—

Fixed exposed passwords for Cruise Control.

ODP-5774

—

Updated PostgreSQL JDBC JAR for Oozie.

ODP-5763

—

Removed all references to ambari-odp-security in MPacks.

ODP-5664

—

Replaced ambari-odp-security with ambari_commons.credential_store_helper.

ODP-5642

—

Added logging support for Kafka MirrorMaker2.

ODP-5658

—

Updated Kafka environment to enable SSL.

ODP-5634

—

Added MirrorMaker heap size suffix in the template.

ODP-5630

—

Prevented deletion of command-*.json for default commands such as install, restart, and start.

ODP-5291

AMBARI-26555

Fixed password leakage in stack root configurations (for example, cluster-env.xml).

ODP-5291

AMBARI-26556

Added support for encrypting configurations.json in the Ambari agent cache.

ODP-5586

—

Fixed stack versioning for stack 3.0.

ODP-4768

—

Removed duplicate ssl.keystore.password to avoid client failures in stack 3.0.

ODP-5564

—

Backported JDK 11 environment changes across the complete stack.

ODP-4232

—

Added missing Oracle9Platform dependency to support Oracle 19c.

ODP-2975

—

Updated hadoop-env.xml template and fixed missing java_version update.

ODP-2232

—

Added JDK 11 JVM flags to Solr, HBase, HDFS, YARN, Hive, Druid, and Tez components.

ODP-2186

—

Updated JDK version in Ambari Server setup.

ODP-2152

—

Fixed incorrect java_version picked up by Ambari.

ODP-1817

—

Fixed Ambari runtime issues with JDK 11.

ODP-1724

—

Added ODP stack branch versions for JDK 11.

ODP-1612

—

Added required Ambari changes for Druid with JDK 11.

ODP-1545

—

Added JDK 11 support for 3.x stacks.

ODP-823

AMBARI-24759

Fixed Ambari Server test failures with JDK 11.

ODP-823

AMBARI-24752

Updated ambari-utility and ambari-server-spi dependencies for JDK 11.

ODP-823

AMBARI-24729

Fixed duplicate imports and resolved Ambari Server startup failure with Java 9 due to Guice errors.

ODP-887

—

Fixed issues to support JDK 11.

ODP-5314

—

Fixed Knox installation failure when Oozie was not installed.

ODP-3922

—

Updated Oozie version to 5.2.1.

ODP-5431

—

Added JDK 8 GC flags to Kafka MirrorMaker2.

ODP-5401

—

Fixed service advisory checks for the oozie.base.url property in oozie-site.

ODP-5413

—

Fixed oozie-setup.sh incorrectly using the -secure flag when HTTPS was disabled.

JIRA ID

Apache ID

Description

ODP-5831

—

Fixed duplicate module-info.class validation failure.

—

HADOOP-15621

S3Guard: Implemented time-based (TTL) expiry for Authoritative Directory Listing.

—

HADOOP-15621

S3Guard: Implemented time-based (TTL) expiry for Authoritative Directory Listing (part 2/2).

—

HADOOP-15827

Fixed NPE in DynamoDBMetadataStore.lambda$listChildren for root with authoritative S3Guard enabled.

—

HADOOP-15826

Fixed incorrect @retries annotation usage on putObject() calls.

—

HADOOP-15370

Improved S3A log message for rm s3a://bucket/ to be more intuitive.

—

HADOOP-15798

Fixed LocalMetadataStore.put() to retain isDeleted flag in parent listings.

—

HADOOP-15947

Fixed ITestDynamoDBMetadataStore test errors.

—

HADOOP-14927

Fixed ITestS3GuardTool failure in testDestroyNoBucket().

—

HADOOP-15428

Updated s3guard bucket-info to create the S3Guard table automatically when configured.

—

HADOOP-15987

Updated ITestDynamoDBMetadataStore to validate correct table configuration.

—

HADOOP-15845

Required explicit URI on CLI for s3guard init and s3guard destroy.

—

HADOOP-15988

Updated DynamoDBMetadataStore#innerGet to support empty directory flag with authoritative listings.

—

HADOOP-16015

Added BouncyCastle JARs to hadoop-aws as test dependencies.

—

HADOOP-15819

Fixed FileSystem cache misuse in S3A integration tests.

—

HADOOP-16027

Documented effective use of FileSystem instances during S3A integration tests.

—

HADOOP-16043

Fixed NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set.

—

HADOOP-15843

Updated s3guard bucket-info to avoid printing stack traces when bucket is not found.

—

HADOOP-14178

Updated Mockito dependency to version 2.23.4.

—

HADOOP-15229

Added FileSystem builder-based openFile() API and implemented S3 Select support in S3A.

ODP-5598

YARN-11902

Fixed build failure caused by mktemp@2.0.2.

JIRA ID

Apache ID

Description

ODP-5731

—

Fixed S3 configuration propagation for HMS create-partition folder operations and passing HMS client operations.

ODP-5857

HIVE-26134

Removed Hive on Spark from the main branch (partial change; Apache PR #3201, reviewed by Zoltan Haindrich).

JIRA ID

Apache ID

Description

KNOX-3153

Fixed Java command invocations in knoxcli.sh.

JIRA ID

Apache ID

Description

KUDU-3716

Added version information to the IPKI CA CSR.

JIRA ID

Apache ID

Description

ODP-2736 / ODP-5863

—

Added Ranger–S3 plugin integration.

ODP-5813

—

Added missing SQL patches for Oracle.

ODP-5756

—

Avoided segmentation fault error in Ranger security-admin-web.

ODP-5773

—

Fixed handling of ALTER TABLE in MySQL for x_trx_log only when the table exists.

ODP-5806

—

Fixed data truncation error by increasing kms_alias column size from VARCHAR(255) to VARCHAR(512).