Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
flair 's Collections
MastermindEval
Familiarity

MastermindEval

updated May 29

Prompting and multiple-choice (MCQ) benchmarks to evaluate reasoning capabilities of LLMs using Mastermind.

Upvote
-

  • flair/mastermind_24_mcq_random

    Viewer • Updated Mar 12 • 30.4k • 81

  • flair/mastermind_35_mcq_random

    Viewer • Updated Mar 12 • 37.1k • 85

  • flair/mastermind_46_mcq_random

    Viewer • Updated Mar 12 • 36.1k • 98

  • flair/mastermind_24_mcq_close

    Viewer • Updated Mar 12 • 30.4k • 82

  • flair/mastermind_35_mcq_close

    Viewer • Updated May 29 • 37.1k • 106

  • flair/mastermind_46_mcq_close

    Viewer • Updated Mar 12 • 36.1k • 79

  • flair/mastermind_24_prompt

    Viewer • Updated May 29 • 30.4k • 24

  • flair/mastermind_35_prompt

    Viewer • Updated Mar 7 • 37.1k • 25

  • flair/mastermind_46_prompt

    Viewer • Updated Mar 7 • 36.1k • 13

  • MastermindEval: A Simple But Scalable Reasoning Benchmark

    Paper • 2503.05891 • Published Mar 7 • 1
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs