Home Explore Help
Register Sign In
ylproj
/
aihub-dag
2
0
Fork 0
Files Issues 0 Pull Requests 0 Wiki
Branch: master
Branches Tags
aihub-dag
/
elyra
/
pipeline
/
airflow
/
provider_package_catalog_connector
Alan Chin 720fb3663e Update linting to use black formatter (#2618) 2 years ago
..
README.md e7db8ef2eb Add Airflow provider package catalog connector (#2438) 2 years ago
__init__.py e7db8ef2eb Add Airflow provider package catalog connector (#2438) 2 years ago
airflow-provider-package-catalog.json e7db8ef2eb Add Airflow provider package catalog connector (#2438) 2 years ago
airflow_provider_package_catalog_connector.py 720fb3663e Update linting to use black formatter (#2618) 2 years ago
airflow_provider_package_schema_provider.py 720fb3663e Update linting to use black formatter (#2618) 2 years ago

README.md

Catalog connector for Apache Airflow provider packages

This catalog connector enables Elyra to load operator definitions from Apache Airflow provider packages. Only built distributions ('.whl') are supported.

Use the connector

  1. Launch JupyterLab.
  2. Open the 'Manage Components' panel.
  3. Add a new Airflow provider package catalog ('+' > 'New Apache Airflow provider package operator catalog').
  4. Specify a catalog name, e.g. 'HTTP provider package'.
  5. (Optional) Specify a category under which the loaded operators will be organized in the palette.
  6. Configure the 'Provider package download URL'. The URL must reference a location that Elyra can access using an HTTP GET request, without the need to authenticate. If the Airflow provider package is stored on PyPI:
    1. Search for the Apache Airflow provider package on PyPI.
    2. Open the package's release history and choose the desired version.
    3. Open the Download files link.
    4. Copy the download link for the package's wheel. (Example download URL for the HTTP v2.0.2 provider package)
  7. Save the catalog entry.
  8. Open the Visual Pipeline Editor and expand the palette. The loaded Apache Airflow operators are displayed.