Thank you @huggingface and @clefourrier for featuring our NPHardEval benchmark and leaderboard. Started later Jan, we update the test data monthly and will release updated evaluation (possibly with more models) the next Month. Have your favorite LLM in mind? Let us know!
New leaderboard: NPHardEval!View quoted post on X
It uses logical questions of diff. complexities as a proxy for reasoning abilities 💪
Since the questions can be generated automatically, it's going to be dynamic, updated monthly! 🚀
Congrats to @HuaWenyue31539 @LeegeoF !
huggingface.co/blog/leaderboa…