Pinned post
๐ฅ ๐ง๐ต๐ฒ ๐๐ถ๐ด๐ต๐ ๐๐ฒ๐ป๐ฐ๐ต๐บ๐ฎ๐ฟ๐ธ ๐ฅ
๐ผ ๐ฃ๐๐ฌ ๐๐ฅ๐ฅ๐ง๐ค๐๐๐ ๐๐ค๐ง ๐ฉ๐๐จ๐ฉ๐๐ฃ๐ ๐๐-๐๐๐๐ฃ๐ฉ๐จ
Whenever there is a new LLM-Model released I have a hard time evaluating it.
There are many benchmarks out there, like ๐๐ฅ๐-๐๐๐, ๐ฆ๐ช๐-๐๐ฒ๐ป๐ฐ๐ต etc.
They all have two problems:
1. It costs me a ton of money to run these benchmarks myself. ๐ฐ
2. they are ๐๐ข๐ฅ๐๐ก๐!!! ๐ด
I need some ๐ฑ๐ฟ๐ฎ๐บ๐ฎ.
I need them to ๐ฟ๐ฒ๐ฎ๐ฐ๐ to one another.
How can I tell which LLM is better?
So many tasks are subjective...
What isn't subjective is ๐ฑ๐ฒ๐ฎ๐๐ต.
๐๐ฒ๐ ๐๐ฒ๐ฒ ๐๐ต๐ผ ๐ฐ๐ฎ๐ป ๐ธ๐ถ๐น๐น ๐๐ต๐ฒ ๐ผ๐๐ต๐ฒ๐ฟ!
Attached is a duel between ๐๐ฒ๐บ๐ถ๐ป๐ถ and ๐๐ฟ๐ผ๐ธ.
Watch to the end to see who won. ๐
*๐ฟ๐๐๐๐จ๐๐ค๐ฃ ๐ข๐๐ ๐๐ฃ๐ ๐ธ๐ข๐ด ๐ช๐ฏ๐ท๐ฐ๐ฌ๐ฆ๐ฅ ๐ฆ๐ท๐ฆ๐ณ๐บ 25 ๐ง๐ณ๐ข๐ฎ๐ฆ๐ด, ๐ธ๐ช๐ต๐ฉ ๐ข ๐ด๐ค๐ณ๐ฆ๐ฆ๐ฏ๐ด๐ฉ๐ฐ๐ต ๐ต๐ข๐ฌ๐ฆ๐ฏ ๐ฆ๐ท๐ฆ๐ณ๐บ 5 ๐ง๐ณ๐ข๐ฎ๐ฆ๐ด.
๐ฎ๐๐๐๐๐ฟ๐ฒ ๐ฝ๐น๐ฎ๐ป๐:
โข Test all the models against each other (Gemini, Grok, Gpt, Claude, DeepSeek).
โข Increase frame rate input for better decision making.
โข Test more competitive ๐ฆ๐๐ฝ๐ฒ๐ฟ ๐ก๐ถ๐ป๐๐ฒ๐ป๐ฑ๐ผ games like Mario, street fighter etc.
โข Convince my wife it is NOT a waste of money (this costs a lot).
โข Open a Patreon after I fail convincing her.
In the meantime, ๐ณ๐ถ๐ฟ๐๐ ๐๐๐ผ ๐ฐ๐ผ๐บ๐บ๐ฒ๐ป๐๐ฒ๐ฟ๐ will have their own fight. Write down:
๐ฆ๐ฒ๐น๐ฒ๐ฐ๐๐ฒ๐ฑ ๐ฐ๐ต๐ฎ๐ฟ๐ฎ๐ฐ๐๐ฒ๐ฟ - the name of the character you want to play]
๐๐ป๐๐๐ฟ๐๐ฐ๐๐ถ๐ผ๐ป ๐ฝ๐ฟ๐ผ๐บ๐ฝ๐- I will give the model your prompt and have him fight accordingly
๐ฆ๐ฒ๐น๐ฒ๐ฐ๐๐ฒ๐ฑ ๐บ๐ผ๐ฑ๐ฒ๐น - GPT, Claude, DeepSeek, Gemini, Gork.
I'll post the result and tag you!
๐ผ ๐ฃ๐๐ฌ ๐๐ฅ๐ฅ๐ง๐ค๐๐๐ ๐๐ค๐ง ๐ฉ๐๐จ๐ฉ๐๐ฃ๐ ๐๐-๐๐๐๐ฃ๐ฉ๐จ
Whenever there is a new LLM-Model released I have a hard time evaluating it.
There are many benchmarks out there, like ๐๐ฅ๐-๐๐๐, ๐ฆ๐ช๐-๐๐ฒ๐ป๐ฐ๐ต etc.
They all have two problems:
1. It costs me a ton of money to run these benchmarks myself. ๐ฐ
2. they are ๐๐ข๐ฅ๐๐ก๐!!! ๐ด
I need some ๐ฑ๐ฟ๐ฎ๐บ๐ฎ.
I need them to ๐ฟ๐ฒ๐ฎ๐ฐ๐ to one another.
How can I tell which LLM is better?
So many tasks are subjective...
What isn't subjective is ๐ฑ๐ฒ๐ฎ๐๐ต.
๐๐ฒ๐ ๐๐ฒ๐ฒ ๐๐ต๐ผ ๐ฐ๐ฎ๐ป ๐ธ๐ถ๐น๐น ๐๐ต๐ฒ ๐ผ๐๐ต๐ฒ๐ฟ!
Attached is a duel between ๐๐ฒ๐บ๐ถ๐ป๐ถ and ๐๐ฟ๐ผ๐ธ.
Watch to the end to see who won. ๐
*๐ฟ๐๐๐๐จ๐๐ค๐ฃ ๐ข๐๐ ๐๐ฃ๐ ๐ธ๐ข๐ด ๐ช๐ฏ๐ท๐ฐ๐ฌ๐ฆ๐ฅ ๐ฆ๐ท๐ฆ๐ณ๐บ 25 ๐ง๐ณ๐ข๐ฎ๐ฆ๐ด, ๐ธ๐ช๐ต๐ฉ ๐ข ๐ด๐ค๐ณ๐ฆ๐ฆ๐ฏ๐ด๐ฉ๐ฐ๐ต ๐ต๐ข๐ฌ๐ฆ๐ฏ ๐ฆ๐ท๐ฆ๐ณ๐บ 5 ๐ง๐ณ๐ข๐ฎ๐ฆ๐ด.
๐ฎ๐๐๐๐๐ฟ๐ฒ ๐ฝ๐น๐ฎ๐ป๐:
โข Test all the models against each other (Gemini, Grok, Gpt, Claude, DeepSeek).
โข Increase frame rate input for better decision making.
โข Test more competitive ๐ฆ๐๐ฝ๐ฒ๐ฟ ๐ก๐ถ๐ป๐๐ฒ๐ป๐ฑ๐ผ games like Mario, street fighter etc.
โข Convince my wife it is NOT a waste of money (this costs a lot).
โข Open a Patreon after I fail convincing her.
In the meantime, ๐ณ๐ถ๐ฟ๐๐ ๐๐๐ผ ๐ฐ๐ผ๐บ๐บ๐ฒ๐ป๐๐ฒ๐ฟ๐ will have their own fight. Write down:
๐ฆ๐ฒ๐น๐ฒ๐ฐ๐๐ฒ๐ฑ ๐ฐ๐ต๐ฎ๐ฟ๐ฎ๐ฐ๐๐ฒ๐ฟ - the name of the character you want to play]
๐๐ป๐๐๐ฟ๐๐ฐ๐๐ถ๐ผ๐ป ๐ฝ๐ฟ๐ผ๐บ๐ฝ๐- I will give the model your prompt and have him fight accordingly
๐ฆ๐ฒ๐น๐ฒ๐ฐ๐๐ฒ๐ฑ ๐บ๐ผ๐ฑ๐ฒ๐น - GPT, Claude, DeepSeek, Gemini, Gork.
I'll post the result and tag you!
0:33