Twitxy Saved

AI Coffee Break with Letitia

@AICoffeeBreak

๐Ÿ“บ ML Youtuber youtube.com/AICoffeeBreak |
๐Ÿง  AI Researcher | ๐Ÿ‘ฉโ€๐ŸŽ“ PhD |
Impressum: t1p.de/q93um
YouTube โ†’ youtube.com/AICoffeeBreak Joined March 2018
397 Following 7K Followers 1K Posts

Latest posts 5

AI Coffee Break with Letitia @AICoffeeBreak
Kolibri is out ๐Ÿฆ (Apache 2.0) and new research ideas around measuring grounding and reducing hallucinations with Merlin-Arthur made it into the model.

This is just the beginning: lots of open questions, lots still to improve. But getting research ideas into an actual model, learning from them, and having an amazing in-house model training pipeline to iterate quickly is the fun part.
Aleph Alpha @Aleph__Alpha Oct 3
Small bird, fast wings, Kolibri is here.

78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe.

Now the weights are yours. Run it on your own hardware, under Apache 2.0.
View quoted post on X
7 replies 7 reposts 47 likes 2.1K views View on X
AI Coffee Break with Letitia @AICoffeeBreak
New AI Coffee Break video! ๐Ÿ”ฅโ˜•๏ธ
LLMs can hallucinate and give the correct answer for the wrong reason. What about teaching them to admit โ€œI donโ€™t knowโ€? This is what my research with colleagues at Aleph Alpha Research on Merlin-Arthur protocols is about. Here's a video to explain the complicated aspects of this work. Link below:
2 replies 3 reposts 17 likes 977 views View on X
AI Coffee Break with Letitia @AICoffeeBreak
Asking an LLM to cite its sources does not tell you whether its answer actually came from those sources.

Citations can sound perfectly plausible, while the answer itself came from memorization, spurious cues no human deems relevant, or a lucky guess.

So, we came up with a measure of how much of an answer actually came from the provided context in RAG & and a way to train for it.

More on Merlin, Morgana & Arthur in the blog post ๐Ÿ‘‡
Aleph Alpha @Aleph__Alpha Aug 19
Your model answers 9 of 10 questions correctly about a contract you gave it to check, but you donโ€™t know which one is wrong, so you check all 10. LLM training rarely rewards "I canโ€™t answer": abstaining pays less than guessing, so models guess plausibly, & thatโ€™s hallucination.๐Ÿงต
View quoted post on X
2 replies 1 reposts 13 likes 852 views View on X