How to load randomly sampled k% from train set?

macabdul9 · January 16, 2023, 5:49am

lhoestq · January 23, 2023, 1:49pm

You can .shuffle() the dataset and then .select(range(int(percentage * len(ds))))

Topic		Replies	Views
Load a subset of a dataset 🤗Datasets	2	1997	April 19, 2023
Loading a fraction of data 🤗Datasets	5	5589	May 12, 2023
How to sample dataset according to the index 🤗Datasets	2	12537	January 10, 2022
How to sample a dataset Beginners	0	300	November 28, 2022
Downloading a subset of the Pile Beginners	1	782	August 23, 2024