kaishi.tabular.aggregators.concatenate_dataframes

Class definition for concatenating tabular data files.

Module Contents

class kaishi.tabular.aggregators.concatenate_dataframes.AggregatorConcatenateDataframes

Bases: kaishi.core.pipeline_component.PipelineComponent

Concatenate all data frames.

__call__(self, dataset)

Perform concatenation on a given dataset (all files must have the same schema).

Parameters

dataset (kaishi.tabular.dataset.TabularDataset) – tabular dataset to perform operation on