mattertune.finetune.data_util

Classes

IterableDatasetWrapper(dataset, map_fn)

MapDatasetWrapper(dataset, map_fn)

class mattertune.finetune.data_util.MapDatasetWrapper(dataset, map_fn)[source]
Parameters:

  • dataset (Dataset[TDataIn])

  • map_fn (Callable[[TDataIn], TDataOut])

__init__(dataset, map_fn)[source]
Parameters:

  • dataset (Dataset[TDataIn])

  • map_fn (Callable[[TDataIn], TDataOut])

class mattertune.finetune.data_util.IterableDatasetWrapper(dataset, map_fn)[source]
Parameters:

  • dataset (IterableDataset[TDataIn])

  • map_fn (Callable[[TDataIn], TDataOut])

__init__(dataset, map_fn)[source]
Parameters:

  • dataset (IterableDataset[TDataIn])

  • map_fn (Callable[[TDataIn], TDataOut])