Twitxy Saved

Marco🍞

Verified account This account is verified. Learn more

@marco_computers

I like computers, Korean, and computers-and-Korean.

Language+keyboard stuff @Google

Georgia Tech → 연세대학교 → 東京工業大学

Interested in high school CS education.
Tokyo theoreticallygoodwithcomputers.com Joined February 2021
2.1K Following 598 Followers 803 Posts

Latest posts 5

Pinned post

Marco🍞 Verified account @marco_computers
🚨 [Token][ization] Paper Alert 🚨

Tokenization is a wildly understudied area of language modeling despite it having effects across all of NLP. Over the past ~8 months, 32 (!) tokenizer researchers put together the most comprehensive survey of the field. Check it out!
6 replies 83 reposts 347 likes 41K views View on X
Marco🍞 Verified account @marco_computers
I recently contributed an article to @tokyodev_com about doing a PhD in Japan while working part time.

Doing my PhD this way was quite fun. The Japanese PhD system is not without flaws, but it also has some really nice advantages compared to the US/etc. Plus the added benefit of living in Japan, of course.

tokyodev.com/articles/doing…
www.tokyodev.com Doing a Machine Learning PhD While Working in Japan An American MEXT scholar shares the pros and cons of doing a PhD in Japan, from funding and part-time work to university life and career options.
2 replies 4 reposts 23 likes 1.8K views View on X
Marco🍞 Verified account @marco_computers
look, if you are a professional shadow puppeteer with a PhD in projective geometry i think you deserve to get the bag like this
go on, tell me
is this legit generalization for once, or did Anthropic and OpenAI buy a dataset from professional shadow puppeteers with Ph.Ds in projective geometry at 3x their hourly rates?
View quoted post on X
Marco🍞 Verified account @marco_computers
These types of papers always make me wonder how did anyone even stumble upon this?

Like I'm not surprised that this general effect exists, but I am surprised that _this specific family_ of instances exists.
Alexa R. Tartaglini @ARTartaglini Nov 3
Put a heart ❤️ next to a coding problem, and Claude & GPT write recursive code 100% of the time (0% baseline). They also can't tell you why!

Excited to share “A Heart Means Recursion” from my summer at @GoogleDeepMind, on how VLMs read & communicate with visual symbols. 🧵
View quoted post on X