Prerequisites Datastore Credentials

NameNode URL

Hostname or IP of the HDFS NameNode (e.g., hdfs://namenode.example.com)

NameNode Port

NameNode RPC port (default: 8020)

Authentication Type

Simple or Kerberos

Kerberos Principal

Service principal for HDFS access (required if Kerberos)

Keytab Path

Path to the keytab file on the client (required if Kerberos)

HDFS Root Path

Base directory path for data access (e.g., /data/warehouse)

Bucket Name

Name of the S3 bucket

Region

AWS region (e.g., us-east-1)

Endpoint URL

Custom endpoint for S3-compatible stores (MinIO, Ceph); leave blank for AWS S3

Authentication Method

Access Key, IAM Role for Service Account, or EC2 Instance Profile

Access Key ID

AWS access key (required for Access Key auth)

Secret Access Key

AWS secret key (required for Access Key auth)

Storage Account Name

Azure Storage Account name

Container Name

Blob container within the storage account

Authentication Method

Storage Account Key or Service Principal (OAuth 2.0)

Storage Account Key

Full-access key (required for Account Key auth)

Tenant ID

Azure AD tenant ID (required for Service Principal auth)

Client ID

Application (client) ID (required for Service Principal auth)

Client Secret

Application secret (required for Service Principal auth)