👋 Hey there, I am Waylon Walker
I am a Husband, Father of two beautiful children, Senior Python Developer currently working in the Data Engineering platform space. I am a continuous learner, and sha
I am would like to request the ability to add two DataCatalog objects together to get the addition of the two. This will improve the ability to reuse pipelines and catalogs from existing projects.
Example
Let's say I already have two DataCatalogs loaded in c1 and c2. I would like the ability to add them together.
full_catalog = c1 + c2
Context
I am trying to combine pipelines from two different projects. Kedro natively gives me the ability to add the pipelines together, but not the DataCatalog
Possible Implementation
Create a new DataCatalog using dictionary unpacking from the individual DataCatalogs. In the case of duplicates the second catalog will take preference.
I learned how to combine kedro catalogs and submitted it as a feature request.
[KED-1512] Ability to add catalogs together #302
Description
I am would like to request the ability to add two
DataCatalog
objects together to get the addition of the two. This will improve the ability to reuse pipelines and catalogs from existing projects.Example
Let's say I already have two
DataCatalogs
loaded inc1
andc2
. I would like the ability to add them together.Context
I am trying to combine pipelines from two different projects. Kedro natively gives me the ability to add the pipelines together, but not the DataCatalog
Possible Implementation
Create a new DataCatalog using dictionary unpacking from the individual
DataCatalog
s. In the case of duplicates the second catalog will take preference.