Aleph Alpha

Small bird, fast wings, Kolibri is here.

78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe.

Now the weights are yours. Run it on your own hardware, under Apache 2.0.

Kolibri 1 is now supported in vLLM 0.33 🎉

Thanks to the @vllm_project and @huggingface communities for making it happen!

Kolibri can reason at four efforts: none, low, medium, and high. Our SFT training traces didn't have effort labels, so we had to label them post-hoc.

A new blog post by @L_Salewski explains how we did this, with interactive figures 🧵

Parsy is currently the best parsing model in the world.

Read on for how we built this model on top of our parsing harness. 🧵

How does the community evaluate multilingual capabilities of LLMs? Mostly by translating evaluation datasets, since most of them are predominantly in English. How does translation change what the eval actually measures?