1.0.0-643

Image Tag: 1.0.0-643

• ADLS Datastore Configuration via Spark Defaults — ADLS configurations are now automatically injected into Spark default configs, ensuring Spark context is aware of datastore settings at startup. Passing ADLS configs via environment variables is no longer required. Create a new ADLS datastore after upgrading to take advantage of this change.
• Kerberos Keytab via Kubernetes Secrets — Kerberos keytab files are now mounted automatically via Kubernetes secrets. You no longer need to pass keytab files as environment variables in your Spark job configuration.
• Spark Dynamic Allocation — Executor Count Moved — The number of executors parameter has been removed from the dynamic allocation configuration section and relocated to the Executors section for clearer resource configuration.

• Trino Impersonation — Fixed an issue with Trino impersonation. Trino must be reinstalled after upgrading to apply this fix.

1. Upgrade the dataplane to image tag 1.0.0-643.
2. Create a new ADLS datastore (existing datastores configured via environment variables will continue to work but new datastores should follow the updated config path).
3. Reinstall the Trino application to apply the Trino impersonation fix.

• In Trino edit mode, if a new datastore is added, a Trino coordinator restart is required for the change to take effect.
• During Trino installation, adding two ODP datastores simultaneously may cause the Trino app to fail. Add datastores one at a time.
• Kerberos keytab mounting via Kubernetes secrets requires the dataplane to be at 1.0.0-643 or later.