Changelog
A summary of new feature highlights is located on the GitHub release page.
Release 3.8.1 - 05/03/2022
- Fix incorrect regex search in release script - #2703
- Update to JupyterLab 3.4 - #2632
- Remove unreachable code - #2695
Release 3.8.0 - 05/02/2022
- Update pipeline-editor package to v1.8.0 - #2697
- Update print stmts to use f-strings - #2683
- Add 'Elyra JupyterLab interface' topic to user guide - #2693
- Conditionally render COS info after pipeline submission - #2688
- Fix release script after template changes - #2691
- Fix broken links to documentation - #2690
- Add restoration to CodeViewer - #2684
- Add pipeline properties documentation to pipelines topic - #2682
- Improve data volume property help text - #2686
- Fix new
test_get_volume_mounts
test to use KeyValueList
type - #2687
- Support use of mounted volumes in airflow runtime - #2680
- Support key-value type list properties in a more generic way - #2679
- Add support for metadata import in the CLI - #2581
- Add support for storing pipeline parameters and COS prefixes - #2669
- Support use of mounted volumes in Kubeflow Pipelines runtime - #2675
- Update development dockerfiles to use prebuilt extensions - #2673
- Remove secret from airflow helm values - #2677
- Fix script editor file dependency bug - #2637
- Add documentation for pipeline default properties - #2668
- Add support for runtime image and env vars in pipeline default props - #2656
- Upgrade to canvas version 12 - #2641
- Bump async from 2.6.3 to 2.6.4 - #2672
- Remove hacking dependency, capture version snapshot prior to CI testing - #2671
- Fix install-server target in Makefile - #2665
- Update documentation URLs in schema definitions - #2658
- Publish latest-tagged images when building releases - #2660
- Update repository README to include a link to releases page - #2661
- Remove use of legacy resolver in builds and documentation - #2654
- Replace ComponentCache instance with fixture in processor test - #2653
- Clean up tests that rely on component cache instances - #2652
- Handle components that might fail on KFP with emissary executor - #2650
- Improve metadata CLI documentation - #2651
- Fix KFP component without inputs compilation bug - #2646
- Improve argument handling in elyra-metadata - #2645
- Tolerate editable packages in bootstrapper package install - #2643
- Fix flaky integration test - #2639
- Add support for dedicated public KFP endpoint - #2631
- Add support for static text spinner - #2633
- Fix component ID for new airflow test component - #2642
- Remove remaining references to airflow examples catalogs - #2636
- Abort generic component processing when prereq download fails - #2630
- Fix Gitlab port bug in URL scheme - #2629
- Clarify build instructions - #2628
- Uncap Jinja2 and update nbconvert dependencies - #2603
- Fix missing f string typo in operator - #2623
- Update linting to use black formatter - #2618
Release 3.7.0 - 03/30/2022
- Update Launcher to work with other languages - #2613
- Add ComponentCache load to relevant pipeline app commands - #2611
- Update Elyra menu items - #2596
Release 3.7.0rc0 - 03/28/2022
- Fix typo in release script
- Create Component Catalogs Widget - #2532
- Convert bytes and bytearray types to string for Component def attr - #2602
- Relax component YAML validation req's for certain fields - #2600
- Enable display of custom component definitions - #2564
- Temporary fix to metadata editor display bug - #2593
- Support KFP pipeline run monitoring for 'elyra-pipeline submit' cmd - #2584
- Make component cache event-driven to allow out-of-proc updates - #2522
- Add support for 'export' command to elyra-pipeline CLI - #2582
- Add troubleshooting information for 'component not found' errors - #2591
- Update Jinja2 dependencies - #2589
- Bump minimist from 1.2.5 to 1.2.6 - #2587
- Enable CodeQL checks in CI workflows - #2570
- Update python dependencies to address security issues - #2583
- Prevent error popups during KFP component parse - #2561
- Add support for elyra-metadata 'create' and 'update' commands - #2578
- Add unit tests for script editor package - #2576
- Update to latest container images to refresh runtime images - #2555
- Add a new extension - Code Viewer - #2553
- Update docs for configuring Apache airflow - #2569
- Update CLI export command and documentation - #2574
- Fix broken link to runtime image topic - #2568
- Address Metadata UI inconsistencies - #2559
- Bump tf version in container image - #2558
- Remove dependency on jupyter_server test utils - #2557
- Update docs that describes how to create custom runtime images - #2547
- Fix error handling when replace used w/o schemaspace - #2540
- Add/update empty metadata instance list message - #2537
- Add setting to specify node double click behavior - #2517
- Update to JupyterLab release 3.3.0 - #2519
- Remove references to deprecated 'elyra-examples-airflow-catalog' package - #2529
- Sanitize KFP input/output params in kwargs - #2533
- Update Makefile python and pip calls to use python3 - #2536
- Simplify integration tests for runtime configs - #2530
- Add a refresh button the header of Metadata Widget - #2531
- Move release template into elyra repo - #2521
- Rename test file from application.spec.ts to services.spec.ts - #2523
- Use well-defined EntryData return values in Airflow catalog connectors - #2520
- Update built-in connectors to use new connector API - #2518
- Allow pipelines to be opened withe the JSON widget - #2511
- Add script editor output integration tests - #2507
- Support well-defined return values for catalog connectors - #2492
- Pin doc link to current release in elyra-pipeline cli - #2506
- Update to use JupyterLab 3.3.0rc0 - #2495
- Fix invalid KFP component URL references - #2503
- Update help link in VPE - #2505
- Update build to use prebuilt extensions - #2447
- Add integration tests related to output console - #2499
- Update examples for verification step and first issue label - #2496
- Add support for cli metadata export - #2448
- Remove support for component-registries schemaspace - #2497
- Bump kfp-tekton dependency - #2480
- Bump version requirement for nbformat, ipython, and traitlets - #2493
- Fix typo in git release configuration file (release.yml) - #2490
- Update some dependencies to avoid security vulnerabilities - #2487
- Fix submit file as pipeline dialog message - #2489
- Add support for custom requirements in Elyra container image build - #2478
- Document how to configure custom Airflow components for use in pipelines - #2485
- Create git release configuration configuration file - #2483
- Replace invalid characters in airflow parent node references - #2468
- Add a link to most recent blog to the documentation - #2486
- Fix templates for safe rendering of comments, pipeline & prop description - #2467
- Deprecate python 3.6 usage and include 3.10 in testing - #2479
- Associate user doc to pipeline custom component - #2474
- Add eslint rule for type-safe equality operators - #2475
- Bump follow-redirects from 1.14.7 to 1.14.8 - #2477
- Fix properties template for KFP inputvalue types - #2473
- Restore tag variable, update release script - #2465
- Sort runtime tiles alphabetically in launcher - #2449
Release 3.6.0 - 02/08/2022
- Update built-in connector reference - #2457
Release 3.6.0rc0 - 02/07/2022
- Add Airflow provider package catalog connector - #2438
- Update pipeline editor node pkg to 1.6.0 - #2454
- Move unit test file to proper test directory - #2452
- Add test for code snippet cloning - #2451
- Add airflow package catalog connector - #2437
- Improve Airflow parser functionality - #2418
- Add link to Apache Airflow tutorial - #2450
- Set 'EnumControl' property values to 'null' in properties JSON - #2432
- Add GUI support for metadata instance duplication - #2436
- Validate numeric fields in submit file dialog - #2383
- Restore dependency cap on click and pin black - #2446
- Revert removal of dependency caps - #2445
- Bump node-fetch from 2.6.1 to 2.6.7 - #2434
- Fix inconsistent dependency version caps - #2431
- Unpin click dependency - #2429
- Group component properties by inputs and outputs - #2407
- Fix git branch URL - #2421
- Fix typo in RTC documentation topic - #2412
- Bump ipython from 7.15.0 to 7.16.3 in /etc/generic - #2408
- Bump nanoid from 3.1.22 to 3.2.0 - #2411
Release 3.5.0 - 01/21/2022
- Update release script
- Fix kubeflow image dockerfile syntax
- Add Script Editor language-specific subclasses - #2388
- Add support for CLI metadata and OVPs using JSON or file contents - #2378
- Render user comments as docs of nodes in pipeline - #2396
- Bump trim-off-newlines from 1.0.1 to 1.0.3 - #2403
- Update Copyright headers with current year - #2390
- Update pipeline processor hierarchy diagram screenshot - #2402
- Bump follow-redirects from 1.14.5 to 1.14.7 - #2395
- Validation: improve detection of invalid pipeline version values - #2391
- Support GitLab as DAG repository for Apache Airflow - #2380
- Fix documentation for kubeflow local dev deployment - #2381
- Add flag to hide label for description field - #2394
- Remove KFP DSL export option from all pipeline types - #2382
- Promote validation error debug message to simplify troubleshooting - #2385
Release 3.4.1 - 01/07/2022
- Update pipeline editor package to 1.5.1 - #2377
- Fix incorrect Elyra version syntax in kubeflow Dockerfile - #2368
- Properly process GPU parameter in pipeline parser - #2370
Release 3.4.0 - 12/17/2021
Release 3.4.0rc1 - 12/16/2021
- Update pipeline editor package to 1.5.0 - #2367
- Fix runtime property display in pipeline editor UI - #2363
- Set default value for kfp component property - #2365
Release 3.4.0rc0 - 12/15/2021
- Update pipeline editor package to 1.5.0rc1 - #2364
- Allow Kubeflow node inputValues to consume outputPath outputs - #2350
- Enforce authentication type constraints in KFP RTCs - #2356
- Add explicit support for COS authentication types to runtime configurations - #2354
- Catch cloud storage connectivity issues before processing pipeline - #2362
- Fix KUBERNETES_SERVICE_ACCOUNT_TOKEN auth - #2358
- Fix version references in installation documentation - #2359
- Enable async component cache updates using SingletonConfigurable - #2349
- Fix code snippet language check - #2346
- Add support for AWS IRSA - #2335
- Rework docker image build - #2344
- Add Elyra 3.3 blog post to resources topic - #2351
- Fix typo in Kubeflow auth type setting name - #2353
- Re-add integration test for runtime specific components in the palette - #2340
- Add resources topic to overview - #2345
- Update Setup.py to Fix KFP requirements - #2342
- Add catalog type information to DAG for custom components - #2336
Release 3.3.0 - 12/03/2021
Release 3.3.0rc2 - 12/01/2021
- Update release script - #2334
- Update pipeline-editor version to 1.4 - #2331
- Reintroduce error handling for pipeline export - #2333
- Fix export file type options for KFP platform - #2327
- support operators with type hints - #2316
- Fix component catalog UI sorting - #2330
Release 3.3.0rc1 - 11/30/2021
- Update pipeline version to 6 and pin versions - #2321
- Set the default xcom_push for Airflow operators - #2313
- Fix export dialog title for generic pipelines - #2320
- Add error to Troubleshooting guide when on z shell - #2326
- Fix typo in overview documentation - #2325
- Document migration strategies for BYO schemas - #2318
- Update pipeline styles - #2236
- Add packaging section to installation documentation - #2315
- Fix generic export corner case - #2314
- Add support for runtime type resources - #2305
- Add component catalog guide to VPE - #2304
Release 3.3.0rc0 - 11/17/2021
- Update hybrid runtime support topic in overview doc - #2310
- Fix incorrect app data runtime parameter name - #2312
- Fix incorrect reference to upstream operator when duplicate exists - #2306
- Refactor Pipeline Editor UI to better support Runtime Types - #2287
- Update components section with migration instructions - #2302
- Exclude markdown 3.3.5 in documentation build requirements - #2308
- Make component examples an optional Elyra feature - #2286
- Add support for data exchange between airflow operators - #2244
- Remove redundant entry from pipeline validation endpoint - #2303
- Fix frontend metadata title - #2296
- Bump postcss from 7.0.35 to 7.0.39 - #2295
- Bump path-parse from 1.0.6 to 1.0.7 - #2294
- Bump tmpl from 1.0.4 to 1.0.5 - #2289
- Bump tar from 4.4.13 to 4.4.19 - #2290
- Bump ws from 5.2.2 to 5.2.3 - #2291
- Bump axios from 0.21.1 to 0.21.4 - #2292
- Add hidden flag for fields not to be displayed in editor - #2288
- Add new component catalogs schemaspace - #2282
- Remove display_name property from schema - #2267
- Add support for runtime types - #2263
- Add 'BYO component catalog connector' topic to 'developer guide' - #2280
- Reduce airflow component parser output - #2285
- Improve KF authentication handling - #2257
- Enable building Elyra docker image from current source code - #2274
- Fix contents handler path handling - #2279
- Update to Kubeflow image to Jupyter base 1.4
- Update to JupyterHub Single User image version 1.2.0
- Improve error messaging for comparisons involving entrypoints - #2276
- Sort palette nodes by component label - #2277
- Add environment variable for
max_readers
in CatalogConnector - #2271
- Generalize component reading and processing for BYO catalog-types - #2241
- Check for major version only in bootstrapper test - #2264
- Sort palette alphabetically - #2250
- Update validation checks for non remote submission scenarios - #2251
- Support per-catalog cache updates for improved performance - #2253
- Fix validation checks for malformed inputpath in kfp pipelines - #2226
- Add yarn install steps to development workflow - #2252
- Update README with badge and link to Elyra website
- Upgrade kfp-tekton dependency to 1.0.1 - #2215
- Remove determination of absolute path value in KFP processor - #2234
- Refactor add pipeline launcher buttons / file > new menu logic - #2225
- Add additional details in elyra-pipeline describe command - #2221
Release 3.2.1 - 10/18/2021
- Fix run name issue for KubeFlow v1.4 - #2237
- Replace missing
metadata_class_name
in Component Registry schema - #2233
- Support KFP with LDAP Dex auth - #2212
- Fixes issue that produces invalid container image on migration - #2231
- Use ServerApp.root_dir to set directory for cypress tests - #2235
- Add front end integration tests for python and R editor operations - #2216
- Clean up changelog
Release 3.2.0 - 10/12/2021
- Make small changes to KFP DSL export template - #2222
- Validate runtime image format with regex - #2213
- Update developer testing documentation - #2207
- Exclude kfp dependency version 1.7.2 - #2209
- Tolerate components w/ no dependencies, add tests with custom components - #2206
- Fix ability to override pipeline name at submission - #2205
- Refactor kubeflow pipelines flow and improve dex auth - #2167
- Support data exchange between KFP components - #2094
- Use tmpdir fixture instead of /tmp/lib in bootstrapper test - #2200
- Clean up svg files - #2195
- Fix metadata class links - #2198
- Fix pipeline name calculation algorithm - #2181
- Update component registry schema to enforce length for categories - #2193
- Implement Bring Your Own Schemas and Schemaspaces feature - #2109
- Add stub for 'custom pipeline components' topic to docs - #2179
- Document issue management workflow - #2035
- Refactor tests to common parent folder to better code sharing - #2160
- Add link to KFP custom component tutorial - #2178
- Add link to hackmd dev meeting notes to documentation - #2177
- Add daily dev meeting info to docs - #2176
- Parallelize reading of component definitions in registry - #2169
- Remove unnecessary files from Elyra python distro
- Update root readme with daily scrum info - #2172
- Add 'properties' element to run as pipeline template - #2170
- Add rollback to metadata when post_save/delete hooks throw - #2163
- Add manage pipeline components content to user guide - #2104
- Update docs for Troubleshooting and Contribution sections - #2149
- Fix caching to update immediately after component registry modifications - #2157
- Comment out support for '[item1,item2]'; breaks int, bool, number
- Handle non-quoted items in array
- Attempt to coerce string values for array types to lists
- Catch argument errors and display formatting hints
- Add argo icon to ui-components - #2156
- Refactor different runtimes into its own folder/module - #2125
- Enable json option for pipeline cli commands - #2118
- Add export pipeline to Python DSL test case - #2142
- Reformat the processor registration logging - #2155
- Make improvements to Airflow DAG render - #2131
- Properly describe empty pipelines using Pipelines CLI - #2115
- Fix pipeline upload on Windows system - #2150
Release 3.1.1 - 09/15/2021
- Update Pipeline Editor to version 1.2.0 - #2143
- Add notes about packaging changes - #2148
- Fix module name for KFP export template - #2141
- Add additional safeguards to list and dictionary parameter types - #2127
- Update elyra installation documentation - #2137
- Bump elyra version in KF Dockerfile - #2132
- Update/add fixtures to setup factory metadata instances
- Small validation fixes for pipeline references and cleanup
- Fix Copyright year/attribution
- Fix instances of type attribute in processors - #2126
- Fix bootstrapper start_minio test fixture - #2122
- Update correct filename on publish goal of release script - #2123
Release 3.1.0 - 09/09/2021
- Update elyra docker image to install all extra pkgs
- Migrate component registry to the metadata service - #2083
- Refactor: Improve Kubeflow docker image - #2114
- Add support for validating pipelines via CLI - #2112
- Pipeline definition abstraction - #2082
- Fix path and capture problem determination data during execution - #2077
- Add support for private container image registries - #2092
- Add DAG repo to airflow submission response messages
- Treat doc build warnings as errors - #2099
- Fix mismatched runtime handling for run command - #2068
- Fix broken link in CLI documentation topic - #2098
- Expose pipeline description to runtime environments - #2086
- Move kfp-tekton dependency to extras - #2043
- Update pipeline-editor version to 1.1.0 - #2093
- Defer import of black to postpone logging noise - #2090
- Remove kfserving component file from config folder - #2078
- Add mention to pipeline 'describe' command to cli docs - #2074
- Add pipeline version validation rules and tests - #2071
- Minor refactoring based on Sourcery code analyses tool - #2027
- Add support for Schema Filters - #2062
- Improve validation output in elyra-pipeline CLI - #2070
- Add Describe Command to pipeline CLI - #1995
- Update release docs with environment setup requirements - #2063
- Add documentation note to GitHub PR template - #2064
- Block pipeline-editor from showing multiple error dialogs - #2045
- Fix typo on individual runtime extensions location
Release 3.0.1 - 08/18/2021
- Update release to publish individual runtime extensions
- Update pipeline CLI to avoid false-positive warning msg - #2057
- Account for components with no component parameters - #2056
- Enable release of individual Elyra runtime extensions - #2047
- Update pipeline cli to tolerate empty pipelines - #2050
- Requires minimum JupyterLab 3.0.17 - #2052
- Remove obsolete migration script - #2053
- Check for relative path when validating node label - #2030
- Relax kfp sdk and kfp-tekton dependency - #2034
- Standardize processing of custom component parameters types - #2038
- Update pipeline cli to handle errors without node info - #2041
- Make pipeline CLI preprocessing parameters optional - #2039
- Update GitHub issue-template.md - #2026
Release 3.0.0 - 08/03/2021
High level enhancements
- Enable creation of pipelines specific to a runtime
- Enable support for runtime specific components
- Increased Elyra pipeline version to 4 with auto-migration support enabled
- Integrate new content parser with support for refreshing environment vars from
notebooks and scripts
- New Pipeline validation service
- Support for KFP 1.6.3 / Tekton 0.8.1
- Fix DEX authentication issues
- Upgraded to new Pipeline Editor version 1.0.0 and Elyra Canvas to version 11.0.0
- Update to JupyterLab LSP 3.8.0 and migrate to python-lsp-server as the Python language server
- Update to JupyterLab Git 0.32.0
Security Fixes
- Update urllib3 to v1.26.5 and requests to v2.25.1 - #1841
Other enhancements and bug fixes
- Single node pipeline dependencies should be an array - #2015
- Remove KFServing from KFP Component Registry - #2013
- Update pipeline-editor version to 1.0.0 - #2011
- Update JupyterLab LSP to version 3.8.0 - #2011
- Update Jupyterlab GIT to version 0.32.0 - #2011
- Pin click dependency to KFP 1.6.3 required version - #2010
- Remove slack operator base class definition from palette - #2007
- Add missing node label for single file pipeline submission - #2005
- Update link to requirements-elyra.txt in runtime specific docs
- Update pipeline validation label check - #2004
- Integrate Pipeline CLI with new validation service - #1993
- Migrate to use python-lsp-server as the Python language server - #1996
- Document install-server make task for backend build - #1980
- Refactor airflow-notebook package back into elyra core - #1925
- Re-enable tests for KFP pipelines with custom components - #1990
- Update validation service to accept missing optional fields - #1992
- Convert exception to string for error handling - #1988
- Properly evaluate list params when processing KFP components - #1983
- Improve 'run notebook' KFP component specification - #1987
- Handle connection error when fetching kfp session cookie - #1972
- Update pipeline-editor version to 0.11.3 - #1985
- Fix error case where error handler throws error - #1984
- Pipeline validation service initial implementation - #1664
- Uncap jinja2 and nbconvert dependency version - #1971
- Refactor component location to jupyter/shared/components/runtime - #1974
- Fix CI dialog selector after Lab 3.1 release - #1973
- Resolve component name errors in component registry - #1969
- Fix computation of absolute path for url-based KFP components - #1957
- Properly display description/type information in node properties - #1970
- Set KFP component display name to the provided node label - #1968
- Derive elyra extension from ExtensionApp - #1876
- Update JupyterLab launcher page image in README - #1917
- Make 'name' optional when parsing a component registry entry - #1958
- Use enter key to save and submit metadata editor form - #1962
- Followup refactor to component & category parsing - #1948
- Update 'runtime image configuration' topic in User Guide - #1933
- Update operation naming for airflow custom components - #1961
- Update tutorial references in documentation overview - #1919
- Update pipeline-editor to v0.11.2 to fix env-vars refresh - #1952
- Update Airflow operation naming for uniqueness - #1950
- Prettify pipeline json on migrate - #1947
- Update pipeline editor dialog message for unsupported files - #1935
- Update Apache Airflow jinja template DAG creation logic - #1945
- Update pipeline properties error message theme - #1939
- Improve how type info is inferred during component parsing - #1936
- Avoid deleting test resources during make clean - #1946
- Fix Pipeline node property resources fields style - #1942
- Restructure pipeline JSON to prevent custom components from breaking - #1882
- Fix Open File command for pipeline nodes - #1937
- Fix exporting generic pipelines to python script - #1927
- Rename KFP NotebookOp to ExecuteFileOp
- Merge support for KFP operator into main Elyra repo
- Set 'required' attribute default to True for KFP components - #1916
- Add descriptions to component types in palette - #1913
- Log and skip pipeline components with invalid location - #1872
- Enable migration from previous pipeline versions - #1860
- Update 'pipelines' topic in User Guide - #1848
- Add Python 3.9 to CI integration test matrix - #1908
- Fix and enable linting on package init files - #1909
- Initialize component defaults when double clicking palette nodes - #1902
- Update kfp component files to include optional parameter - #1854
- Add 'Pipeline components' topic to the user guide docs - #1839
- Fix icon related console warnings and errors - #1897
- Move doc images to proper directory location - #1898
- Run lint in fix mode when building, but in check mode in CI - #1894
- Update Pipeline Editor to 0.10.1 - #1891
- Update material-ui version to 4.12.1 and fix console error - #1885
- Update list of component parameters to avoid parsing errors - #1887
- Update to KFP v1.6.3 and KFP-Tekton v0.8.1 - #1884
- Update KFP Notebook to 0.26.0
- Add ‘extensions’ to palette for Pipeline generic components - #1828
- Update palette JSON to support new pipeline editor features - #1863
- Update build step to not rely on a globally installed lerna - #1865
- Enable and enforce import orders on python lint - #1861
- Add support for left palette panel in PipelineEditor props - #1844
- Update Pipeline Editor to 0.9.0 and Canvas to 11.0.0 - #1864
- Add snapshot testing for pipeline files - #1792
- Refactor pipeline component parsing to be owned by processors - #1801
- Add runtime images button to pipeline editor toolbar - #1858
- Document best practices for file-based nodes in user guide - #1803
- Add basic caching to metadata file storage - #1846
- Fix binder build failures - #1853
- Adjust CI tests to new IPython kernel release - #1855
- Update docs/recipe KFP version reference to 1.4.0 - #1852
- Add integration tests for pipeline export options - #1842
- Update Pipeline Editor to 0.8.0 - #1847
- Update urllib3 to v1.26.5 and requests to v2.25.1 - #1841
- Add support for ELYRA_RUN_NAME environment variable - #1732
- Update KFP Notebook to 0.25.0 - #1840
- Check pipeline version before run/submit pipeline with CLI - #1830
- Update CLI to consider runtime specific pipelines - #1805
- Add integration tests for runtime specific pipelines - #1815
- List 'Apache Airflow' as supported runtime for Pipeline Editor - #1826
- Update node property array control css to use all real state - #1800
- Update incorrect kfp component reference in catalog - #1825
- Update Pipeline Editor to 0.7.0 and Canvas to 10.9.0 - #1822
- Make clean was not unlinking pipeline-editor - #1817
- Update jupyterlab-git to v0.30.x and NBDime to v3.1 - #1820
- Add back artifact/log collection for cypress tests - #1819
- Avoid using null default values for component parameters - #1802
- Finalize initial list of components for KFP and Airflow - #1791
- Update jupyterlab-lsp to version 3.7.0 - #1818
- Update Airflow template to use operation agnostic names - #1808
- Validate that component catalog location exists - #1811
- Adds caching and parallelization to GitHub Actions CI - #1671
- Properly handle empty pipeline in Pipeline Editor clear button - #1796
- Update yarn.lock with Pipeline Editor v0.6.0
- Support runtime specific component parameter type - #1764
- Temporary remove KFP Python DSL export option - #1770
- Update Airflow DAG jinja template to correct package imports - #1788
- Update missing server-side pipeline node properties - #1790
- Fix runtime configuration location on pipeline json - #1776
- Update Pipeline Editor to version 0.6.0 - #1794
- Add loader animation to Pipeline Editor - #1793
- Support exporting pipelines for KF DEX secured envs - #1758
- Remove Pipeline Editor dead/obsolete code - #1779
- Reduce the number of duplicate calls to backend services - #1757
- Fix runtime specific component support for dict parameters - #1775
- Ensure MetadataManager.get() has a value for 'name' - #1778
- Add support for global pipeline properties - #1708
- Do not show iconLabel in Command Palette - #1774
- Add test case for Pipeline node properties array item bug - #1496
- Add tooltip to Python Editor output buttons - #1754
- Made code snippet tag text truncate if it's too long - #1744
- Add support for pipeline runtime specific components - #1620
- Update "Contributing to the Elyra documentation" docs section - #1743
- Updated code snippets image on documentation - #1731
- Update documentation for running integration tests
- Update Readme/Docs feature overview outline - #1720
- Update docs to recommend using pip3 instead of pip - #1718
- Normalize KFP endpoint URL on KFP Processor - #1711
- Move note on pip version to top of pip section
- Add metadata type to delete confirmation dialog message - #1697
- Add make dependency graph utility script - #1705
- Add ODH/Kubeflow 1.3 deployment instructions - #1694
- Set system-owned envs after user-provided envs - #1701
- Update TSConfig and fix errors - #1670
- Add R kernel installation to dev clean script - #1682
- Dereference symlinks in node dependency archive - #1689
- Add indicator for runtime in Pipeline Editor toolbar - #1683
- Fix Pipeline Editor open/close panel tooltip - #1688
- Only update stable binder link on non pre-releases - #1690
- Update Elyra version on KF-Notebook Dockerfile - #1685
- Fix tooltip for Pipeline Editor in launcher icons - #1681
- Re-pin stable binder link to v2.2.4 - #1684
- Update "Deploying Open Data Hub with Elyra" doc recipe - #1574
- Add prepare-changelog goal to release script help
- Update documentation with proper release steps
- Refactor ui-components to use React best-practices - #1657
- Add support for updating env vars to Pipeline Editor - #1654
- Update to Pipeline Editor 0.3.0 and Canvas 10.7.0 - #1679
- Fix Script editor output prompt alignment - #1678
- Add runtime configuration validation section to docs - #1676
- Add indication of runtime into operation's environment - #1668
- Pin stable version binder link to 2.2.4
- Update the Getting Started > Overview section in the docs - #1669
- Add missing dependencies to useCallBack array - #1667
- Fix Pipeline label in tab context menu - #1666
- Fix pipeline editor integration test timeout failures - #1660
- Use GatewayKernelManager from Jupyter Server - #1655
- Fix KF Dex authentication bug - #1642
- Update kubeflow installation link on documentation - #1644
- Remove unused NotebookSubmissionDialog.tsx file - #1639
- Add tested runtime version info to prerequisites - #1641
- Fix Cypress integration tests timeouts - #1640
- Add configuration instruction for KF 1.3 - #1635
- Enable creation of pipelines specific to a runtime - #1591
- Update node properties UI style on pipeline editor - #1631
- Update Python/R labels in file menu - #1633
- Fix resources input alignment on node properties - #1630
- Add more details to Pull Request Template - #1585
- Fix failing pipeline integration tests - #1621
- Update to KFP v1.4.0 and KFP-Tekton v0.7.0 - #1622
- Properly store runtime images name instead of display name - #1626
- Update binder link to latest stable release - #1627
- Update release documentation
- Update release script to support beta releases
- Update release script to generate changelog
- Fix custom notebook/script code fonts with ligatures - #1618
- Add python tests for contents handler - #1589
- Move cos_secret parameter back into original cos category - #1617
- Update airflow-notebook version to v0.0.7 - #1619
- Allow secure connections to s3 object storage - #1616
- Only allow for KFP Notebook patche releases
- Exclude single-line comments from content parsing - #1601
- Display message when no code snippet or tag is defined - #1603
- Update README release doc links to specific Elyra version - #1588
- Update submit button labels and dialog - #1598
- Fix links to pipelines documentation topic - #1604
- Use unittest mock module to avoid flake8 failure - #1607
- Update OpenAPI spec to cover new contents/properties endpoint - #1579
- Switch to using the new pipeline editor package - #1221
- Serve pipeline configuration from server - #1551
- Exported KFP pipeline yaml missing cos_directory parameter - #1563
- Update jupyterlab-git extension to v0.30.0 - #1584
- Build elyra-image from released artifacts for non dev tags - #1536
- Improve messaging for COS credential exceptions - #1575
- Adds material ui dependency to ui-components package - #1567
- Refactor to use Python 3.x super invocation - #1577
- Update docs with link to Kubeflow Notebook Server recipe - #1561
- Add cos_secret option to runtime metadata configuration - #1529
- Expose user_namespace parameter in Airflow runtime schema - #1545
- Update Elyra container image makefile target on docs - #1533
- Fix language check on inserting code snippets into Script Editor - #1527
- Update list of documented Makefile targets - #1553
- Refactor environmental variable discovery into backend service - #1460
- Use yarn lock for Elyra builds - #1555
- Update project MANIFEST.in with missing files - #1552
- Update Airflow Notebook to 0.0.5 - #1548
- Fix description of the exported Apache Airflow DAG file - #1539
- Pin the testutils and filebrowser version - #1541
- Refactor container related Makefile targets - #1531
- Add Code Snippet CLI documentation and refactor existing content - #1528
- Add new build/publish container images targets to Makefile - #1526
- Update kf-notebook container image documentation - #1514
- Fix dependency suggestion in submit notebook dialog - #1510
2.2.4 (4/26/2021)
- Move cos_secret parameter into original cos category #1624
- Add cos_secret option to runtime metadata configuration #1529
- Update Makefile to simplify publishing container #1623
2.2.3 (4/26/2021)
- Update airflow-notebook version to v0.0.7 #1619
- Expose user_namespace parameter in Airflow runtime schema #1545
- Allow secure connections to s3 object storage #1616
- Only allow for KFP Notebook patche releases
- Display message when no code snippet or tag is defined #1603
- Update submit button labels and dialog #1598
- Use unittest mock module to avoid flake8 failure #1607
2.2.2 (4/19/2021)
- Adds material ui dependency to ui-components package #1567
- Fix Elyra version when creating kf-notebook docker image #1523
- Fix dependency suggestion in submit notebook dialog #1510
- Pin the testutils and filebrowser version #1541
- Update Jupyterlab-git extension to v0.30.0 #1582
2.2.1 (3/31/2021)
- Update KFP Notebook to 0.22.0
- Pin flake8 dependency to avoid trans-dependency conflict
- Fix default node properties when using submit button #1508
- Update build scripts to publish new R editor
2.2.0 (3/31/2021)
High level enhancements
- R Editor with the ability to run R scripts from JupyterLab UI
- Add CLI tool for running and submitting pipelines
- Add Elyra image compatible with Kubeflow notebook launcher
- Brought up JupyterHub and Binder support after issues with their latest releases
Other enhancements and bug fixes
- Add R Editor - #1435
- Pin version range of autopep8 due to version conflict - #1504
- Remove obsolete parameter on build-server make task - #1503
- Update Release Notes formatting (changelog.md)
- Update lint auto-fix suggestions
- Update build tools version on GitHub Actions CI script
- Fix submit button submitting most recent file - #1501
- Fix pipeline node properties dark mode - #1487
- Add elyra-pipeline cli tool - #1246
- Fix pipeline node properties overriding wrong node property - #1492
- Update KFP Notebook to 0.21.0 - #1494
- Add Elyra image compatible with Kubeflow notebook launcher - #1466
- Fixed css scrollbar bug in pipeline node properties - #1484
- Add inputs for resource usage in submit notebook/script - #1483
- Refactor script processors, include brief detail on generic errors - #1485
- Fix container image build command - #1488
- Replace outdated reference to docker-image target - #1489
- Provides better error messages for KFP namespace errors - #1469
- Use node labels instead of filename as operation names - #1468
- Enable extensions as both Notebook/Jupyter Server extensions - #1476
- Use pip legacy resolver to fix binder build - #1456
- Update remaining notebook imports to jupyter_server - #1471
- Remove close button from pipeline node properties editor - #1465
- Add offical logos for Python and R - #1452
- Created RuntimeImagesWidget for customized UI - #1461
- Add schema_name parameter to CLI runtime config examples - #1462
- Fix pipeline properties css bug in Safari - #1449
- Fix properties editor node deletion bug - #1459
- Remove empty values from pipeline node properties - #1463
- Update Binder release information to 2.1.0 - #1454
- Fix code quality Issues reported by analysis tool - #1432
- Add default / placeholder to dropdown field in metadata editor - #1443
- Expose error details on Python node local execution - #1411
- Fix css issues after upgrading to Canvas 10.2.0 - #1451
- Enable support for adding R Script to Pipeline - #1418
- Fix Material UI style specificity issues in Metadata Editor - #1434
- Properly remove string array from pipeline node properties - #1447
- Update release docs with steps to update docker images
2.1.0 (3/15/2021)
High level enhancements
- Support for running pipelines on Apache Airflow 1.x runtimes
- Elyra and Apache Airflow tutorial
- Support for submitting Python Scripts as batch jobs
- Enhanced Pipeline Editor node properties ui (now as a right side panel)
- Enhanced metadata editor UI
- Documentation refresh
Other enhancements and bug fixes
- Propagate operation input/output in sorted way #1427
- Update error dialog message when no runtimes configured #1423
- Remove error label when user fixes invalid metadata field #1402
- Fix css alignment in add runtimes dropdown #1425
- Add pytest suite for airflow processor #1317
- Handle no runtimes configured on run/export/submit #1404
- Update resource validation to check for null values #1413
- Add GitHub link to Runtimes UI #1410
- Use absolute path when exporting Airflow DAG to local file #1415
- Validate node resource requests for zero or negative values #1394
- Add warning before submitting modified notebook/script #1385
- Add reference documentation link to MetadataEditor #1386
- Fix pipeline error message not updating #1406
- Add reference to Apache Airflow tutorial to documentation #1310
- Update to canvas version 10.1.0 #1378
- Improve error handling when pipeline export pushes artifacts to COS #1377
- Update runtime configuration documentation topic #1393
- Add PyYAML version range based on kfp-tekton requirements #1392
- Fix dark mode for metadata editor UI #1369
- Add additional property for pipeline submission response #1364
- Include object storage requirement in Apache Airflow configuration guide
- Update Apache Airflow deployment documentation #1367
- Update release script to support release candidate #1365
- Update Tornado to release 6.1.0 #1272
- Add support for multiple schemas in Metadata Editor #1327
- Expose Github exceptions in a more user-friendly way #1366
- Update documentation with new Submit script feature #1357
- Formalize titles and descriptions in runtime schemas #1352
- Switch to using Material UI in metadata editor #1293
- Update Runtime configuration topic in the docs #1353
- Add support for submitting scripts as pipeline #1330
- Add pipeline source annotations to container ops #1331
- Refresh Apache Airflow configuration documentation #1311
- Add placeholder values to runtime configuration metadata #1345
- Group metadata tags with name and description #1347
- Update links in extension tracker documentation #1348
- Refactor Apache Airflow github functions to the utility module #1316
- Handle default field on metadata editor
- Add default url for github api endpoint
- Update KFP Notebook to 0.20.0 #1344
- Fix invalid documentation references #1342
- Honor default values for missing metadata properties #1336
- Tweak runtime metadata definitions for Airflow and Kubeflow #1296
- Improve pipeline node properties dark theme #1328
- Add support for K8s pod labels and annotations for KFP #1284
- Fix issues causing false circular dependency during validation #1309
- Properly propagate runtime info when submitting notebook #1306
- Update runtime image metadata configuration documentation #1283
- Add ability to include image pull policy with runtime image - #1279
- Add tags to Apache Airflow metadata schema #1294
- Update developer workflow documentation #1288
- Experimental support of Airflow as a pipeline runtime #490
- Fix watch mode by including source files in the package #1269
- Properly propagate namespace on exported Python DSL #1275
- Update KFP to 1.3.0 and KFP-Tekton to 0.6.0 #1276
- Fix dark theme for properties panel #1262
- Add details on how to determine workflow engine type
- Update docs to clarify definition of public registry #1258
- Refresh Elyra 2.x installation instructions #1255
- Document how to create/publish Elyra release #1247
2.0.1 (1/27/2021)
- Update to kfp-tekton 0.5.1rc1
- Update NBFormat to release 5.1.2
2.0.0 (1/26/2021)
High level enhancements
- Add support for JupyterLab 3.x
- Add new Language Server Protocol (LSP) capabilities
- Add support for Kubeflow Pipelines using Argo and Tekton engines
- Publishing Elyra images to both docker.io and quay.io
- Multiple updates to overall documentation
- Increased test coverage
Other enhancements and bug fixes
- Add support for running pipelines on Argo and Tekton #1239
- Add support for pipeline node level resource configuration #1203
- Update KFP Notebook to 0.18.0
- Rename application package to services #1231
- Use kernel display name on Python editor dropdown #1224
- Reenable git extension support #1202
- Re-add support for showing resource utilization on status bar #1204
- Replace pipeline node properties dialog with side pane #1084
- Add 'Save as code snippet' from editor selection #1186
- Add jupyterlab-lsp 3.0.0 integration #1176 #1184
- Update to Jupyter Server 1.2.0 #1178
- Update KFP Notebook to 0.17.0 and KFP 1.1.2 #1162
- Update release script with publish option #1151
- Update KFP Notebook to 0.16.0
- Enables removal of optiona metadata fields #1155
- Set minio python package dependency to version <7 #1143
- Enable display of metrics and metadata in KFP UI #1054
- Enable Elyra image to auto-start JupyterLab
- Update to JupyterHub SingleUser 0.10.6 docker image
- Upgrade KFP to version 1.1.0 #1104
- Update Jupyter Client minimum version to 6.1.7 #1099
- Add support to JupyterLab 3.0 RC #1063
- Attribute Elyra copyright notice to Elyra authors #1097
- Properly handle references to missing schema files #1096
- Multiple enhancements to stabilize CI tests on GitHub actions slower environments
- Enhance pipeline circular reference detection #1080
- Update Elyra Canvas to release 9.2.1 #1082
- Implements "Add to Pipeline" context menu for py files #1079
- Create a dropzone component for Pipeline Editor #1062
- Update NodeJS to version 12.18 on CI environment
- Update Cypress to version 5.6.0
1.5.3 (1/12/2021)
- Update Elyra deployment documentation for Open Data Hub #1182
- Remove 'enzime' dependency on Pipeline Editor tests #1169
1.5.2 (12/14/2020)
- Update KFP Notebook to release v0.17.0
- Update KFP to release 1.1.2
- Add link to GitHub discussion forum to docs #1150
- Add "getting help" section to documentation #1100
- Update the metrics visualization content #1156
- Add visualization recipe to documentation #1057
- Enables removal of optiona metadata fields #1155
1.5.1 (12/11/2020)
- Update KFP Notebook to release v0.16.0
- Update release script with publish option
1.5.0 (12/10/2020)
- Update KFP Notebook to 0.15.0 release
- Enable display of metrics and metadata in KFP UI #1054
- Renames docker-image build target to container-image #1141
- Set minio python package dependency to version <7 #1143
- Upgrade KFP to version 1.1.0 #1104
1.4.2 (12/04/2020)
- Enable Elyra image to auto-start JupyterLab
- Update to JupyterHub SingleUser 0.10.6 docker image #1135
- Remove workdir setting from Elyra docker image #1135
- Build both docker.io and quay.io tagged images #1135
- Update Jupyter Client minimum version to 6.1.7 #1099
- Properly handle references to missing schema files #1096
- Support namespace configuration when using dex with kfp #1081
- Update canvas version #1082
1.4.1 (11/14/2020)
- Use JupyterLab SessionManager to execute Python scripts #1071
- Update to JupyterLab-git 0.23.1 #1065
- Ensure local notebook nodes use local env #1061
- Code Snippet drag and drop feature #1043
1.4.0 (11/09/2020)
- Add the ability to search/filter to the metadata explorer #985
- Update documentation on containers and public container registries #1039
- Flow kernel name to Jupyter Enterprise Gateway #1031
- Add tags and descriptions to default runtime images #1023
- Propagate local env when running local python node #1047
- Fix variable formatting in jinja template used by export #1027
- Update JupyterLab Git extension to version 0.22.3 #1017
- Build source distro for individual extensions #1018
- Update UI integration tests to use non-standard port #1024
- Update install docs on how to install individual extensions #1009
1.3.3 (10/23/2020)
- Package extension dependencies with Elyra single extension wheel #998
1.3.2 (10/23/2020)
- Update release to build 'elyra-server' before 'elyra' #997
1.3.1 (10/23/2020)
- Fix deployment of individual Elyra extensions #996
1.3.0 (10/22/2020)
- Use
python3
when executing local python operations #992
- Integrate with
nbresuse
to display local resource usage on status bar #987
- Enable local pipeline executions when server uses Enterprise Gateway #983
- Sort list of runtime images retrieved from service #982
- Update to Elyra Canvas 9.1.6 #986
- Increased test coverage #886 #751 #940
- Update Binder build config to enable cloning git repos from ui #963
- Automate the release of independent Elyra package #973
- Add common format for pipeline process logging #950
- Add help icon to launcher #968
- Multiple updates to documentation #979 #947 #949 #945
- Add exported file location to response dialog #967
1.2.1 (09/23/2020)
- Fix dependency install in Elyra docker image #941
- Remove elyra build area to reduce image size #942
1.2.0 (09/22/2020)
- Add support for Python Script node on pipelines #722
- Update papermill transient dependencies on docker build #923
- Document OpenShift deployment #929
- Document how to "bring-your-own" runtime image #915
- Update JupyterLab Git to release 0.21.1 #922
- Add support for deploying Elyra on Red Hat Open Data Hub #918
- Add JupyterLab commands for existing metadata UIs #906
- Add tutorials on how to use Elyra #909
- Update default runtime images #908
- Update install documentation on how to run Elyra from docker #907
- Add JSON UI and optional sort for metadata widget #877
1.1.0 (08/26/2020)
- Add support to run pipelines in-place locally #860
- Enable pipeline submission to DEX protected Kubeflow Pipeline environment #866
- Add support for adding files to pipelines using the file browser context menu #882
- Enable adding dependencies in pipeline node properties #881
- Enable updating associated node file from pipeline node properties #867
- Add notebook existence validation to Pipeline Editor #860
- Add initial support for supernodes in Pipeline Editor #818
- Add jest unit tests to Pipeline Editor #818
- Include Python related kernels on Python Editor #875
- Add command to palette to open Runtime Images UI #835
- Add support for grouping metadata fields in metadata editor #871
- Confirm metadata editor reload with unsaved changes #853
- Multiple enhancements and bug-fixes to metadata service #840 #841 #866
- Add support for installing Elyra using conda #891
1.0.1 (08/19/2020)
- Add Elyra source distribution to PyPi in support for conda #876
1.0.0 (08/05/2020)
- Notebook Pipelines visual editor
- Ability to run notebooks as batch jobs
- Reusable Code Snippets
- Hybrid runtime support (based on Jupyter Enterprise Gateway)
- Python script execution capabilities within the editor
- Python script navigation using auto-generated outlines using Table of Contents
- Notebook navigation using auto-generated Table of Contents
- Notebook versioning based on Git integration
- Reusable configuration and editor for runtimes
- JupyterHub Support
- Ability to try Elyra from Binder
- Ability to try Elyra locally using Docker
1.0.0rc3 (08/01/2020)
- Update KFP Notebook to 0.11.0 release
- Tolerate Notebook 6.1.0 release
- Add custom Elyra launcher #782
- Update to Elyra Canvas 9.0.3 #788 #794 #797
1.0.0rc2 (07/25/2020)
- Update KFP Notebook to 0.10.3 release
- Remove
cos_secure
requirement from Runtimes metadata #774
- Add indicator for invalid node properties #752
- Add error message on attempt to create circular references #744
- Migrate to the Elyra Canvas 8.0.32 #758
- Fix CLI output when no instances and json is requested #764
- Update notebook node to allow multiple input links #759
1.0.0rc1 (07/15/2020)
- Update KFP Notebook to 0.10.2 release
- Disable toolbar buttons on empty pipeline editor #741
- Remove escape when inserting markdown snippet to markdown file #749
- Fix code snippet deletion bug #748
- Allow code editor to be resized #729
- Add support for metadata instance classes #725
- Enable CLI JSON output for script consumption #746
1.0.0rc0 (07/08/2020)
- Rename python-runner to python-editor #721
- Add support for JupyterLab Dark theme #706
- Improve dependency management and archive generation #702
- Properly set pipeline version on new pipelines #698
- Make pipeline process and export asynchronous #695
- Use absolute form of export path when exporting pipelines #690
- Validate pipeline and export submission dialogs #684
- Create metadata editor #589
Note: Pipeline nodes that currently do not list any dependencies but have 'Include Subdirectories' enabled,
will not have the intended result. Instead, those node properties must be updated to include '*' in the dependencies list.
However, use of '*' with 'Include Subdirectories' is not recommended and finer grained dependency lists should be utilized.
Note: With the rename of the python-runner
extension, we suggest uninstalling previous versions of Elyra before updating it.