Fabian David Schmidt

@fdschmidt

Member of Technical Staff @ Cohere | PhD from Uni of Würzburg on multilinguality & multimodality | prev. Mila & LTL@UniCambridge

fdschmidt93.github.io Joined December 2022

114 Following 187 Followers 125 Posts

Latest posts 5

Fabian David Schmidt @fdschmidt Feb 20, 2025

Introducing MVL-SIB, a massively multilingual vision-language benchmark for cross-modal topic matching in 205 languages!

🤔Tasks: Given images (sentences), select topically matching sentence (image).

Arxiv: arxiv.org/abs/2502.12852
HF: huggingface.co/datasets/WueNL…

Details👇

Fabian David Schmidt @fdschmidt Dec 12, 2024

📣Happy to (pre-)release my Fleurs-SLU benchmark to evaluate massively multilingual spoken language understanding on SIB & Belebele. Work done at @Mila_Quebec with @davlanade @gg42554 @licwu

Datasets:
huggingface.co/datasets/WueNL…
huggingface.co/datasets/WueNL…

Details to follow👇

Fabian David Schmidt @fdschmidt Nov 6, 2024

Excited to present NLLB-LLM2Vec at @emnlpmeeting Tuesday 2pm! Drop by our poster to chat about multilingual & multimodal research. NLLB-LLM2Vec can now easily be used with @huggingface AutoModels — try it esp. for embedding low-resource languages!

🌐 huggingface.co/fdschmidt93/NL…

huggingface.co fdschmidt93/NLLB-LLM2Vec-Meta-Llama-31-8B-Instruct-mntp-unsup-simcse · Hugging Face Sentence Similarity model with 8B parameters. Download, explore files and run it on Hugging Face.

Fabian David Schmidt @fdschmidt Jun 19, 2024

Introducing NLLB-LLM2Vec! 🚀

We fuse the NLLB encoder & Llama 3 8B trained w/ LLM2Vec to create NLLB-LLM2Vec which supports cross-lingual NLU in 200+ languages🔥

Joint work w/ Philipp Borchert, @licwu, and @gg42554 during my great research stay at @cambridgeltl

View quoted post on X

Fabian David Schmidt @fdschmidt Jun 19, 2024

Introducing NLLB-LLM2Vec! 🚀

We fuse the NLLB encoder & Llama 3 8B trained w/ LLM2Vec to create NLLB-LLM2Vec which supports cross-lingual NLU in 200+ languages🔥

Joint work w/ Philipp Borchert, @licwu, and @gg42554 during my great research stay at @cambridgeltl

Fabian David Schmidt @fdschmidt May 5, 2023

Gladly sharing that our work with @gg42554 and @licwu is accepted to #acl2023, takeaways: (1) averaging training checkpoints outperforms conventional model selection for cross-lingual transfer; (2) averaging checkpoints from multiple runs brings further gains if heads are aligned