Bug Fixes

This section consists of the issues fixed in this release.

Ambari

JIRA IDApache IDDescription
ODP-5962Fixed Kafka Connect issue where the local variable password_value could not be accessed.
ODP-5956Fixed Spark2 Thrift picking the wrong environment configuration for Kerberos keytab and principal.
ODP-5885Set the default value of command_file_retention_policy when it was not already set.
ODP-5291Set command_file_retention_policy to remove.
OCR-2354Added support for Kafka client.
ODP-5896Added hive.tez.java.opts support for JDK 8 and JDK 11.
ODP-5890Added support for JDK 8 and JDK 11 JVM parameters for Druid.
ODP-5888Prevented TemplateNotFound errors during Kafka upgrades.
ODP-5876Fixed Cruise Control SSL password exports in cruise-control-env.
ODP-5854Removed old MirrorMaker2 configuration files.
ODP-5868Removed cryptography dependency from the Ambari agent.
ODP-5853Fixed credential helper to handle JCEKS in stack services.
ODP-5850Fixed password scope handling by using self.value in PasswordString.str.
ODP-5787Fixed curl out-of-memory issue for large files by falling back to the HDFS resource JAR.
ODP-5833Updated MR2 version to 3.2.3.
ODP-5777Fixed missing pwd module handling for Kerberos client installation.
ODP-5776Updated MR2 version to 3.3.6.
ODP-5607Cherry-picked ODP-839 to update the Oozie upgrade setup command and result output.
ODP-5788Fixed Oozie restart failure during stack upgrade.
ODP-5620Updated restart role order for Kafka and Ranger.
ODP-5737Fixed Hive service check failure with SSL enabled when retrieving passwords from the credential store.
ODP-5810Fixed JournalNode start failure when adding additional namespaces.
ODP-5819Fixed configuration case for the Druid SSL alias property.
ODP-5811Handled auth_to_local for JournalNode before HA enablement and allowed disabling Kerberos without failures.
ODP-5827Fixed exposed passwords for Cruise Control.
ODP-5774Updated PostgreSQL JDBC JAR for Oozie.
ODP-5763Removed all references to ambari-odp-security in MPacks.
ODP-5664Replaced ambari-odp-security with ambari_commons.credential_store_helper.
ODP-5642Added logging support for Kafka MirrorMaker2.
ODP-5658Updated Kafka environment to enable SSL.
ODP-5634Added MirrorMaker heap size suffix in the template.
ODP-5630Prevented deletion of command-*.json for default commands such as install, restart, and start.
ODP-5291AMBARI-26555Fixed password leakage in stack root configurations (for example, cluster-env.xml).
ODP-5291AMBARI-26556Added support for encrypting configurations.json in the Ambari agent cache.
ODP-5586Fixed stack versioning for stack 3.0.
ODP-4768Removed duplicate ssl.keystore.password to avoid client failures in stack 3.0.
ODP-5564Backported JDK 11 environment changes across the complete stack.
ODP-4232Added missing Oracle9Platform dependency to support Oracle 19c.
ODP-2975Updated hadoop-env.xml template and fixed missing java_version update.
ODP-2232Added JDK 11 JVM flags to Solr, HBase, HDFS, YARN, Hive, Druid, and Tez components.
ODP-2186Updated JDK version in Ambari Server setup.
ODP-2152Fixed incorrect java_version picked up by Ambari.
ODP-1817Fixed Ambari runtime issues with JDK 11.
ODP-1724Added ODP stack branch versions for JDK 11.
ODP-1612Added required Ambari changes for Druid with JDK 11.
ODP-1545Added JDK 11 support for 3.x stacks.
ODP-823AMBARI-24759Fixed Ambari Server test failures with JDK 11.
ODP-823AMBARI-24752Updated ambari-utility and ambari-server-spi dependencies for JDK 11.
ODP-823AMBARI-24729Fixed duplicate imports and resolved Ambari Server startup failure with Java 9 due to Guice errors.
ODP-887Fixed issues to support JDK 11.
ODP-5314Fixed Knox installation failure when Oozie was not installed.
ODP-3922Updated Oozie version to 5.2.1.
ODP-5431Added JDK 8 GC flags to Kafka MirrorMaker2.
ODP-5401Fixed service advisory checks for the oozie.base.url property in oozie-site.
ODP-5413Fixed oozie-setup.sh incorrectly using the -secure flag when HTTPS was disabled.

Hadoop

JIRA IDApache IDDescription
ODP-5831Fixed duplicate module-info.class validation failure.
HADOOP-15621S3Guard: Implemented time-based (TTL) expiry for Authoritative Directory Listing.
HADOOP-15621S3Guard: Implemented time-based (TTL) expiry for Authoritative Directory Listing (part 2/2).
HADOOP-15827Fixed NPE in DynamoDBMetadataStore.lambda$listChildren for root with authoritative S3Guard enabled.
HADOOP-15826Fixed incorrect @retries annotation usage on putObject() calls.
HADOOP-15370Improved S3A log message for rm s3a://bucket/ to be more intuitive.
HADOOP-15798Fixed LocalMetadataStore.put() to retain isDeleted flag in parent listings.
HADOOP-15947Fixed ITestDynamoDBMetadataStore test errors.
HADOOP-14927Fixed ITestS3GuardTool failure in testDestroyNoBucket().
HADOOP-15428Updated s3guard bucket-info to create the S3Guard table automatically when configured.
HADOOP-15987Updated ITestDynamoDBMetadataStore to validate correct table configuration.
HADOOP-15845Required explicit URI on CLI for s3guard init and s3guard destroy.
HADOOP-15988Updated DynamoDBMetadataStore#innerGet to support empty directory flag with authoritative listings.
HADOOP-16015Added BouncyCastle JARs to hadoop-aws as test dependencies.
HADOOP-15819Fixed FileSystem cache misuse in S3A integration tests.
HADOOP-16027Documented effective use of FileSystem instances during S3A integration tests.
HADOOP-16043Fixed NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set.
HADOOP-15843Updated s3guard bucket-info to avoid printing stack traces when bucket is not found.
HADOOP-14178Updated Mockito dependency to version 2.23.4.
HADOOP-15229Added FileSystem builder-based openFile() API and implemented S3 Select support in S3A.
ODP-5598YARN-11902Fixed build failure caused by mktemp@2.0.2.

Hive

JIRA IDApache IDDescription
ODP-5731Fixed S3 configuration propagation for HMS create-partition folder operations and passing HMS client operations.
ODP-5857HIVE-26134Removed Hive on Spark from the main branch (partial change; Apache PR #3201, reviewed by Zoltan Haindrich).

Knox

JIRA IDApache IDDescription
KNOX-3153Fixed Java command invocations in knoxcli.sh.

Kudu

JIRA IDApache IDDescription
KUDU-3716Added version information to the IPKI CA CSR.

Ranger

JIRA IDApache IDDescription
ODP-5813Added missing SQL patches for Oracle.
ODP-5756Avoided segmentation fault error in Ranger security-admin-web.
ODP-5773Fixed handling of ALTER TABLE in MySQL for x_trx_log only when the table exists.
ODP-5806Fixed data truncation error by increasing kms_alias column size from VARCHAR(255) to VARCHAR(512).

Ambari-Mpack

Airflow Mpack

  • ODP-5924: Updated to use CredentialUtil instead of generic credential handling.
  • ODP-5848: Fixed minor bugs and syntax issues.
  • ODP-5763: Removed all references to ambari-odp-security in Airflow MPack.

Kafka3 Mpack

  • ODP-5953: Updated Kafka 3 MirrorMaker JMX ports to avoid conflicts with Kafka 2 MirrorMaker2.
  • ODP-5854: Fixed inaccurate config-type dependencies in Kafka.
  • ODP-5827: Fixed exposed passwords for Cruise Control.
  • ODP-5763: Removed all references to ambari-odp-security in Kafka3 MPack.
  • ODP-5621: Created PID directories for Kafka 3.
  • ODP-5634: Added MirrorMaker heap size suffix in the template.
  • ODP-5620: Updated restart role order for Kafka 3.

HttpFS MPack

  • ODP-5855: Converted string usernames to pwd/group objects for sudo.chown() in HTTPFS.

Hue MPack

  • ODP-5933: Skipped password obfuscation for SQLite.
  • ODP-5763: Removed all references to ambari-odp-security in Hue MPack.
  • ODP-5713: Removed dummy and misleading user and group configurations.

Impala MPack

  • ODP-5763: Removed all references to ambari-odp-security in Impala Mpack.

Kudu MPack

  • ODP-5875: Removed unnecessary EPEL packages.
  • ODP-5763: Removed all references to ambari-odp-security in Kudu MPack.

NiFi / NiFi Registry MPack

  • ODP-5285: Enabled LDAP Manager password encryption for NiFi authorizers.
  • ODP-5620: Updated restart role order for NiFi CA.

Ozone MPack

  • ODP-5620: Updated restart role order for Ozone Storage Container Manager.

Pinot MPack

  • ODP-5763: Removed all references to ambari-odp-security in Pinot MPack.
  • OCR-2322: Fixed Pinot UI to display Minion hostname instead of IP address.
  • ODP-5357: Configured Pinot Server GRPC port as 8092 in Ambari UI.
  • ODP-5673: Added missing import for Fail.
  • ODP-5621: Removed PID references and restart option from Pinot 1.4.0 service files.
  • ODP-5647: Fixed MPack version and removed requests dependency, causing service check failures.

Schema Registry MPack

  • ODP-5825: Fixed Schema Registry service check in Kerberos-enabled environments.

Trino MPack

  • ODP-5839: Fixed Trino startup failure caused by keystore issues in JDK 17 public repositories.
  • ODP-5763: Removed all references to ambari-odp-security in Trino MPack.
  • ODP-5745: Added ambari_java_home for resolving masked passwords and fixed Ranger policy-related group ownership.

JupyterHub MPack

  • ODP-5705: Fixed JupyterHub installation failure (blueprint-based installation) when HDFS is not running.
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard
  Last updated