Twitxy Saved

Yarin

@yaringal

Professor of Machine Learning, University of Oxford
@OATML_Oxford Group Leader
Expert Advisor to AISI
"One of the top machine-learning people" - Tim Berners-Lee
Oxford, England yarin.co Joined February 2014
266 Following 45K Followers 2.1K Posts

Latest posts 5

Yarin @yaringal
From my experience teaching research for the past 9 years, being able to verbalise your thoughts and write precisely and succinctly are things you have to learn through practice. Using LLMs to shortcut these before you learn how to do them proper you'd just never get these skills
Gal Sapir Verified account @galsapir_ Sep 26
More specifically to that discussion: The ability to "tame" fleeting thoughts and ideas in a format that won't let you "lie" with internal inconsistencies, or with half-formed ideas is itself I think at least one of the major goals of the scientific endeavour (and is therefore a cornerstone in scientific education).

About the use of LLMs there - I'm not sure we can afford not to use those to aid in these processes, but it's very clear where the scientific thinking of the author wasn't formed enough.
In those cases I think, our main goal is to teach (and learn together) younger researchers to identify themselves when ideas are half formed, when understanding isn't complete etc.

In many ways writing is one of the highest forms of thinking. And if as DFW wrote the goal of higher education is to teach you how to think - then we must let students write more.
View quoted post on X
Yarin @yaringal
This is my best suggestion: desk reject any paper that fails LLM watermarking detection. People should write their own papers. LLMs should at most give feedback
x.com/yaringal/statu…
Andrew Gordon Wilson Verified account @andrewgwils Sep 21
I'm a Program Chair for ICML 2027. We'd love any creative suggestions for a great conference! How to manage the explosion of AI slop and insane submission growth? How to manage reviewing? How to incentivize high quality creative work? How to reduce bureaucracy and overhead?
View quoted post on X
21 replies 3 reposts 125 likes 40K views View on X
Yarin @yaringal
I'm starting to think that arxiv should forbid LLM written papers altogether. If it gets flagged by watermarking etc, it should get rejected. Authors should use LLM reviews to improve language, not use LLMs to write the papers themselves
@yaringal @arxiv While we do detect LLM content, we are not trying to filter it out. It is a sign that the paper requires more careful scrutiny. Most authors who are applying LLMs are applying them to improve their writing, especially authors with less English skill.
View quoted post on X
8 replies 3 reposts 60 likes 13K views View on X
Yarin @yaringal
LLMs are *really* not good at doing science. Maybe LLMs are good at doing science that doesn't require interacting with the real world. But even for that -take a nontrivial research qs that doesn't have scaffolding/harness that directs you to the right answer and see what happens
JUNDE WU @JundeMorsenWu Sep 22
From another angle, maybe requiring humans to fully understand every piece of research right now is slowing down automated science. LLMs are already good at doing science, but much worse at explaining it to humans, they are speaking a language better suited to other agents, maybe we should create a dedicated space for AI-generated research, like a journal written by AI and read by AI.
View quoted post on X
11 replies 4 reposts 67 likes 7.9K views View on X