Twitxy Saved

Yandex Research

@YandexResearch

research.yandex.com Joined June 2020
67 Following 1.6K Followers 160 Posts

Latest posts 5

Pinned post

Yandex Research @YandexResearch
Finishing two weeks of tabular DL announcements with the python package for TabPack ๐ŸŽ๏ธ
Yura Gorishniy @YuraFiveTwo Oct 30
Double announcement!

๐Ÿค– TabPack: an effective, practical baseline for medium-to-large tabular datasets. Competitive out of the box on benchmarks and trainable on a modern MacBook

๐Ÿ“ฆ TabPackage: a Python package for training TabPack and building similar models

๐Ÿ‘‡ Links & Thread
View quoted post on X
1 replies 1 reposts 15 likes 789 views View on X
Yandex Research @YandexResearch
๐Ÿ‘‚ ๐Ÿ‘€

Go see and talk to Dima about their latest work!
Discrete Diffusion Reading Group Verified account @diffusion_llms Oct 27
This Monday, Nov 2, Dmitry Baranchuk (@DmitryBaranchuk) will present his paper:

Representation-Space MMD for Diffusion Language Models

Project also co-led by Ilya Drobyshevskiy (@free001style) and Ilia Sudakov (@sudakov_il)!
View quoted post on X
1 replies 1 reposts 20 likes 854 views View on X
Yandex Research @YandexResearch
One more tabular ML release from our researchers, and a third one coming soon!

Stay tuned ๐Ÿฅ 
Ivan Rubachev Verified account @puhsuuu Oct 23
I've long argued for more diverse evaluation setups in tabular ML research. This will continue. It was a key motivation behind our new paper

A thread on data scaling in MLPs, GBDTs and tabular foundation models, and what it means for generalization.

arxiv.org/abs/2610.26794
View quoted post on X
Yandex Research @YandexResearch
Training neural networks for tabular regression? Our latest work may be of interest

And it's not only about which of the 18! regression objectives is best, but touches on the role of noise and global early stopping in tabular DL in general
arxiv.org/abs/2610.13909

Thread (1/N)
arxiv.org Revisiting Tabular Deep Regression: Objectives and the Limits of... While deep learning models for tabular data have recently received significant research attention, the choice of objective functions for regression tasks remains an understudied degree of freedom....
2 replies 5 reposts 59 likes 7.2K views View on X
Yandex Research @YandexResearch
Our diffusion team is branching into text!

arxiv.org/abs/2610.06648

We propose a simple post-training method for diffusion LMs: swap the usual training objective for kernel-based distribution matching in feature space.

Promising gains from small-scale experiments to 16B models!
arxiv.org Representation-Space MMD for Diffusion Language Models We introduce a post-training method for diffusion language models (DLMs) that minimizes Maximum Mean Discrepancy (MMD) between generated and reference distributions in the feature space of a...
Ilya Drobyshevskiy Verified account @free001style Oct 6
Introducing a simple method to post-train both discrete and continuous diffusion LMs.

It's based on Maximum Mean Discrepancy (MMD) that matches token-level feature distributions. Our method improves generation and speed on OWT/GSM8K and scales to 16B models. ๐Ÿงต
View quoted post on X