store
table.store
Documentation
-- n/a --
Origin
Authors Markus Binsteiner (markus@frkl.io)
Context
Tags core
Labels package: kiara_modules.core
References source_repo:
https://github.com/DHARPA-Project/kia…
documentation:
https://dharpa.org/kiara_modules.core/
module_doc:
https://dharpa.org/kiara_modules.core…
source_url:
https://github.com/DHARPA-Project/kia…
Module config
Field Type Description Required
─────────────────────────────────────────────────────
constants object Value constants no
for this module.
defaults object Value defaults no
for this module.
value_type string The type of the yes
value to save.
compression string The compression no
to use when
saving the table.
Module config -- no config --
Python class
class_name StoreArrowTable
module_name kiara_modules.core.table
full_name kiara_modules.core.table.StoreArrowT…
Processing source code ─────────────────────────────────────────────────────
def process(self, inputs: ValueSet, outputs: Value…
value_id: str = inputs.get_value_data("value_i…
if not value_id:
raise KiaraProcessingException("No value i…
field_name = self.get_config_value("value_type…
if field_name == "any":
field_name = "value_item"
value_obj: Value = inputs.get_value_obj(field_…
base_path: str = inputs.get_value_data("base_p…
result = self.store_value(value=value_obj, bas…
if isinstance(result, typing.Mapping):
load_config = result
result_value = value_obj
elif isinstance(result, tuple):
load_config = result[0]
if result[1]:
result_value = result[1]
else:
result_value = value_obj
else:
raise KiaraProcessingException(
f"Invalid result type for 'store_value…
)
load_config["value_id"] = value_id
lc = LoadConfig(**load_config)
if lc.base_path_input_name and lc.base_path_in…
raise KiaraProcessingException(
f"Invalid load config: base path '{lc.…
)
outputs.set_values(
metadata=None, lineage=None, **{"load_conf…
)
─────────────────────────────────────────────────────