Twitxy Saved

Eran Broder

Verified account This account is verified. Learn more

@BroderEran

Joined December 2022
6 Following 6 Followers 10 Posts

Latest posts 5

Pinned post

Eran Broder Verified account @BroderEran
๐Ÿฅ‹ ๐—ง๐—ต๐—ฒ ๐—™๐—ถ๐—ด๐—ต๐˜ ๐—•๐—ฒ๐—ป๐—ฐ๐—ต๐—บ๐—ฎ๐—ฟ๐—ธ ๐ŸฅŠ
๐˜ผ ๐™ฃ๐™š๐™ฌ ๐™–๐™ฅ๐™ฅ๐™ง๐™ค๐™–๐™˜๐™ ๐™›๐™ค๐™ง ๐™ฉ๐™š๐™จ๐™ฉ๐™ž๐™ฃ๐™œ ๐™–๐™ž-๐™–๐™œ๐™š๐™ฃ๐™ฉ๐™จ

Whenever there is a new LLM-Model released I have a hard time evaluating it.

There are many benchmarks out there, like ๐—”๐—ฅ๐—–-๐—”๐—š๐—œ, ๐—ฆ๐—ช๐—˜-๐—•๐—ฒ๐—ป๐—ฐ๐—ต etc.

They all have two problems:
1. It costs me a ton of money to run these benchmarks myself. ๐Ÿ’ฐ
2. they are ๐—•๐—ข๐—ฅ๐—œ๐—ก๐—š!!! ๐Ÿ˜ด

I need some ๐—ฑ๐—ฟ๐—ฎ๐—บ๐—ฎ.
I need them to ๐—ฟ๐—ฒ๐—ฎ๐—ฐ๐˜ to one another.

How can I tell which LLM is better?
So many tasks are subjective...
What isn't subjective is ๐—ฑ๐—ฒ๐—ฎ๐˜๐—ต.

๐—Ÿ๐—ฒ๐˜ ๐˜€๐—ฒ๐—ฒ ๐˜„๐—ต๐—ผ ๐—ฐ๐—ฎ๐—ป ๐—ธ๐—ถ๐—น๐—น ๐˜๐—ต๐—ฒ ๐—ผ๐˜๐—ต๐—ฒ๐—ฟ!

Attached is a duel between ๐—š๐—ฒ๐—บ๐—ถ๐—ป๐—ถ and ๐—š๐—ฟ๐—ผ๐—ธ.
Watch to the end to see who won. ๐Ÿ‘€

*๐˜ฟ๐™š๐™˜๐™ž๐™จ๐™ž๐™ค๐™ฃ ๐™ข๐™–๐™ ๐™ž๐™ฃ๐™œ ๐˜ธ๐˜ข๐˜ด ๐˜ช๐˜ฏ๐˜ท๐˜ฐ๐˜ฌ๐˜ฆ๐˜ฅ ๐˜ฆ๐˜ท๐˜ฆ๐˜ณ๐˜บ 25 ๐˜ง๐˜ณ๐˜ข๐˜ฎ๐˜ฆ๐˜ด, ๐˜ธ๐˜ช๐˜ต๐˜ฉ ๐˜ข ๐˜ด๐˜ค๐˜ณ๐˜ฆ๐˜ฆ๐˜ฏ๐˜ด๐˜ฉ๐˜ฐ๐˜ต ๐˜ต๐˜ข๐˜ฌ๐˜ฆ๐˜ฏ ๐˜ฆ๐˜ท๐˜ฆ๐˜ณ๐˜บ 5 ๐˜ง๐˜ณ๐˜ข๐˜ฎ๐˜ฆ๐˜ด.

๐Ÿ”ฎ๐—™๐˜‚๐˜๐˜‚๐—ฟ๐—ฒ ๐—ฝ๐—น๐—ฎ๐—ป๐˜€:
โ€ข Test all the models against each other (Gemini, Grok, Gpt, Claude, DeepSeek).
โ€ข Increase frame rate input for better decision making.
โ€ข Test more competitive ๐—ฆ๐˜‚๐—ฝ๐—ฒ๐—ฟ ๐—ก๐—ถ๐—ป๐˜๐—ฒ๐—ป๐—ฑ๐—ผ games like Mario, street fighter etc.
โ€ข Convince my wife it is NOT a waste of money (this costs a lot).
โ€ข Open a Patreon after I fail convincing her.

In the meantime, ๐—ณ๐—ถ๐—ฟ๐˜€๐˜ ๐˜๐˜„๐—ผ ๐—ฐ๐—ผ๐—บ๐—บ๐—ฒ๐—ป๐˜๐—ฒ๐—ฟ๐˜€ will have their own fight. Write down:
๐—ฆ๐—ฒ๐—น๐—ฒ๐—ฐ๐˜๐—ฒ๐—ฑ ๐—ฐ๐—ต๐—ฎ๐—ฟ๐—ฎ๐—ฐ๐˜๐—ฒ๐—ฟ - the name of the character you want to play]
๐—œ๐—ป๐˜€๐˜๐—ฟ๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฝ๐—ฟ๐—ผ๐—บ๐—ฝ๐˜- I will give the model your prompt and have him fight accordingly
๐—ฆ๐—ฒ๐—น๐—ฒ๐—ฐ๐˜๐—ฒ๐—ฑ ๐—บ๐—ผ๐—ฑ๐—ฒ๐—น - GPT, Claude, DeepSeek, Gemini, Gork.

I'll post the result and tag you!
0:33
Eran Broder Verified account @BroderEran
๐Ÿงฌ Inbred slop.
That's what happens when I allow too much vibe coding to touch the crucial places without me bringing my own Shazam to the mix. ๐ŸŽง
So to repent, I will rewrite the entire repo again from scratch. ๐Ÿ”ฅ

A nice thing was born in the process โ€” pyblast. ๐Ÿ๐Ÿ’ฅ
I want to make sure I remaster python so I (yes I, the human ๐Ÿ™‹โ€โ™‚๏ธ) can make the decisions.

Attached is a link to my own dojo. ๐Ÿฅ‹
It helps me track topics ๐Ÿ“š, and has a contextual playground in the browser ๐Ÿงช

pyblast.netlify.app
0:31
Eran Broder Verified account @BroderEran
ืกืงื™ืœ ื ื—ืžื“ ืฉื”ื›ื ืชื™ ืœืขืฆืžื™ ืœื—ื™ืคื•ืฉ ื‘ื™ื“ 2

ื”ื•ื ืื™ื˜ื™ ื‘ื”ืชื—ืœื”, ืื‘ืœ ืื—ืœื” ื“ื‘ืจ ืœืฉืœื•ื— ืื•ืชื• ืœื—ื™ืคื•ืฉ ื•ืžื—ืงืจ

ืขื•ื‘ื“ ืขืœ ื”ื›ืœ - ืœื ืจืง ืขืœ ื“ื™ืจื•ืช

ืœื”ืชืงื ื”:

/plugin marketplace add eran-broder/yad2-search

/plugin install yad2-search@yad2-search

github.com/eran-broder/yaโ€ฆ
0:34
Eran Broder Verified account @BroderEran
AI ROI #3 ๐Ÿค–
How I got my kids to practice math (almost) every day.
Each kid has to show me X exercises at their level before screens. Guess or get one wrong โ†’ counter restarts.

3 months of daily use. Not because it's good โ€” because it's attached to their screen addiction.
0:56