Manage Elasticsearch Disk Utilization

Issue

You may observe that the Pulse data directory is filling up due to large Elasticsearch indices under:

$AcceloHome/data/elasticsearch/nodes/0/indices

In some cases, individual indices can consume hundreds of GBs, causing the disk utilization on the Pulse node to reach critical levels.


Symptoms

You may observe:

  • High disk utilization on the Pulse node

  • Elasticsearch indices consuming excessive storage

  • Pulse instability due to low available disk space

Example:

du -hsx * | sort -rh | head -n 20

Sample output:

256G f8P9LtYASoaPJTxU-Y_1IQ 248G iLKFUc85T0OtYqpPCrBfBA 247G 9FnLtwknS36HGsjibmUGQg

Immediate Resolution: Identify and Delete Large Elasticsearch Indices

Step 1: List Elasticsearch Indices

Run the following command to identify large indices:

curl -X GET http://pulse:data%40ops@localhost:19013/_cat/indices

Example output:

green open edl-nifi-prod1-nifi-2026.05.04 iLKFUc85T0OtYqpPCrBfBA 1 0 247.6gb green open edl-nifi-prod1-nifi-2026.05.03 f8P9LtYASoaPJTxU-Y_1IQ 1 0 255.3gb

Step 2: Delete High Disk Utilization Indices

After identifying unnecessary or older large indices, delete them using:

curl -X DELETE "http://pulse:data%40ops@localhost:19013/<INDEX_NAME>"

Example:

curl -X DELETE "http://pulse:data%40ops@localhost:19013/edl-nifi-prod1-nifi-2026.05.04" curl -X DELETE "http://pulse:data%40ops@localhost:19013/edl-nifi-prod1-nifi-2026.05.03"

Result

After deleting the large indices:

  • Disk utilization reduced significantly

  • Elasticsearch storage usage returned to stable levels

Example outcome:

  • Disk utilization reduced to approximately 56%