Quota Management

Enable Quotas

Bash
    
xxxxxxxxxx
 
celeborn.quota.enabled=true
Copy

Quota Properties

Property	Description
celeborn.quota.tenant.diskBytesWritten	Maximum disk bytes written per tenant
celeborn.quota.tenant.diskFileCount	Maximum disk file count per tenant
celeborn.quota.tenant.hdfsBytesWritten	Maximum HDFS bytes written per tenant
celeborn.quota.tenant.hdfsFileCount	Maximum HDFS file count per tenant

dynamicConfig.yaml Example

Bash
    
xxxxxxxxxx
 
# System-level defaults - level: SYSTEM   config:     celeborn.quota.tenant.diskBytesWritten: 1T    celeborn.quota.tenant.diskFileCount: 10000    celeborn.quota.tenant.hdfsBytesWritten: 500G   # Tenant-level quota override - tenantId: production   level: TENANT   config:     celeborn.quota.tenant.diskBytesWritten: 5T    celeborn.quota.tenant.diskFileCount: 50000   users:     - name: data_engineer       config:         celeborn.quota.tenant.diskBytesWritten: 2T        celeborn.quota.tenant.diskFileCount: 20000
Copy

Identity Provider

Bash
    
xxxxxxxxxx
 
# Use Hadoop UGI to derive username for quota enforcement celeborn.quota.identity.provider=org.apache.celeborn.common.identity.HadoopBasedIdentityProvider
Copy

###

Last updated on Apr 23, 2026

Was this page helpful?