hookeai.miscellaneous.pruning.pruning_dataset.setup_pruning_dirs

setup_pruning_dirs(pruning_dir, testing_types)[source]

Setup main pruning process directories.

Parameters:
  • pruning_dir (str) – Pruning main directory.

  • testing_types (tuple[str]) – Types of testing data sets used to assess the performance of the model trained on the pruned training data sets. Available testing types include: ‘in_distribution’, ‘out_distribution’ and ‘unused_data’.

Returns:

  • base_datasets_dir (str) – Base data sets directory.

  • prun_datasets_dir (str) – Pruned data sets directory.

  • full_dataset_dir (str) – Full data set directory.

  • test_dataset_dirs (dict) – Testing data set directory (item, str) for each testing type (key, str).