Confusion in splitting dataset (from imagefolder) into train, test and validation

[akt42]

@mariosasko I have a slight variation of the question here. Maybe you can help me?

Loading an imagenet-style image dataset with train/val directories

This is my dataset structure: ROOT | -- train | ---- class_1 | ---- class_2 | -- val | ---- class_1 | ---- class_2 I want to load this in to a DataSet. I’m expecting the resulting DataSet to have a train and val split, but I only get a 'train' partition from the following: from datasets import load_dataset dataset = load_dataset( "imagefolder", data_dir=ROOT ) >> dataset DatasetDict({ train: Dataset({ features: ['image', 'label'], num_rows: 20 }) }) I can r…