Home Explore Help
Register Sign In
ylproj
/
aihub-dag
2
0
Fork 0
Files Issues 0 Pull Requests 0 Wiki
Branch: master
Branches Tags
aihub-dag
/
elyra
/
pipeline
/
airflow
/
package_catalog_connector
Alan Chin 720fb3663e Update linting to use black formatter (#2618) 2 years ago
..
README.md 9de443975a Add airflow package catalog connector (#2437) 2 years ago
__init__.py 9de443975a Add airflow package catalog connector (#2437) 2 years ago
airflow-package-catalog.json 9de443975a Add airflow package catalog connector (#2437) 2 years ago
airflow_package_catalog_connector.py 720fb3663e Update linting to use black formatter (#2618) 2 years ago
airflow_package_schema_provider.py 720fb3663e Update linting to use black formatter (#2618) 2 years ago

README.md

Catalog connector for Apache Airflow packages

This catalog connector enables Elyra to load operator definitions from Apache Airflow Python packages. Only built distributions ('.whl') are supported.

Use the connector

  1. Launch JupyterLab.
  2. Open the 'Manage Components' panel.
  3. Add a new Airflow package catalog ('+' > 'New Apache Airflow package operator catalog').
  4. Specify a catalog name, e.g. 'Airflow 1.10.15 wheel'.
  5. (Optional) Specify a category under which the loaded operators will be organized in the palette.
  6. Configure the 'Airflow package download URL'. The URL must reference a location that Elyra can access using an HTTP GET request, without the need to authenticate. If the Airflow package is stored on PyPI:
    1. Search for the Apache Airflow package on PyPI.
    2. Open the package's release history and choose the desired version.
    3. Open the Download files link.
    4. Copy the download link for the package's wheel. (Example download URL for Apache Airflow 1.10.15)
  7. Save the catalog entry.
  8. Open the Visual Pipeline Editor and expand the palette. The loaded Apache Airflow operators are displayed.