mattertune.configs.data.json_data
- class mattertune.configs.data.json_data.DatasetConfigBase[source]
- prepare_data()[source]
Prepare the dataset for training.
Use this to download and prepare data. Downloading and saving data with multiple processes (distributed settings) will result in corrupted data. Lightning ensures this method is called only within a single process, so you can safely add your downloading logic within this method.
- class mattertune.configs.data.json_data.JSONDatasetConfig(*, type='json', src, tasks)[source]
- Parameters:
type (Literal['json'])
src (str | Path)
tasks (dict[str, str])
- type: Literal['json']
Discriminator for the JSON dataset.
- src: str | Path
The path to the JSON dataset.
- tasks: dict[str, str]
Attributes in the JSON file that correspond to the tasks to be predicted.