aihub-dag/elyra/pipeline/airflow/package_catalog_connector/README.md

Catalog connector for Apache Airflow packages

This catalog connector enables Elyra to load operator definitions from Apache Airflow Python packages. Only built distributions ('.whl') are supported.

Use the connector

1. Launch JupyterLab.
2. Open the 'Manage Components' panel.
3. Add a new Airflow package catalog ('+' > 'New Apache Airflow package operator catalog').
4. Specify a catalog name, e.g. 'Airflow 1.10.15 wheel'.
5. (Optional) Specify a category under which the loaded operators will be organized in the palette.
6. Configure the 'Airflow package download URL'. The URL must reference a location that Elyra can access using an HTTP GET request, without the need to authenticate. If the Airflow package is stored on PyPI:
   1. Search for the Apache Airflow package on PyPI.
   2. Open the package's release history and choose the desired version.
   3. Open the Download files link.
   4. Copy the download link for the package's wheel. (Example download URL for Apache Airflow 1.10.15)
7. Save the catalog entry.
8. Open the Visual Pipeline Editor and expand the palette. The loaded Apache Airflow operators are displayed.