Set up Apache Airflow-Redis for Celery

This applies to 3.2.3.5-2/3 and later versions only. Follow the steps below to install and use Redis as a Celery for Airflow.

Configuration

Configure the details as below for Airflow in Ambari.

You will be able to see configs as shown in above image, set the celery broker, databases, hostname, password (IF), port and SSL according to your redis setup and airflow will start using that as celery broker and resultDB

Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard
  Last updated