Set up Apache Airflow-Redis for Celery

This applies to 3.2.3.5-2/3 and later versions only. Follow the steps below to install and use Redis as a Celery for Airflow.

Configuration

Configure the details as below for Airflow in Ambari.



Info

You will be able to see configs as shown in above image, set the celery broker, databases, hostname, password (IF), port and SSL according to your redis setup and airflow will start using that as celery broker and resultDB


  Last updated