Antonin Raffin

@araffin2

Researcher in robotics and machine learning (Reinforcement Learning). Maintainer of Stable-Baselines.

Links to find me on other platforms are on my homepage 🦋

araffin.github.io Joined June 2018

338 Following 3.1K Followers 1.3K Posts

Latest posts 5

Pinned post

Antonin Raffin @araffin2 Mar 17, 2021

After several months of beta, we are happy to announce the release of Stable-Baselines3 (SB3) v1.0, a set of reliable implementations of reinforcement learning (RL) algorithms in PyTorch =D!

Blog post: araffin.github.io/post/sb3/
GitHub: github.com/DLR-RM/stable-…

Antonin Raffin @araffin2 Nov 18, 2024

See you on the other side (link on my homepage)
__ __
( \,/ )
\_ | _/
(_/ \_)

Antonin Raffin @araffin2 Nov 11, 2024

Quick Python tip to improve error messages.

When you throw an exception for an invalid value, give the user some feedback on what exactly that value was.

We tried to follow this principle in our gym env checker: github.com/DLR-RM/stable-…

An example of throwing more informative errors.
Where name is a tuple, it also prints the variable instead of just complaining it is not a string: f"'name' must be a string, not of type {type(name)}: {name}" vs "'name' must be a string"

Antonin Raffin @araffin2 Nov 10, 2024

A great collection of RL Q&A by James MacGlashan

What is the "horizon" in RL?

Why is the DDPG gradient the product of the Q-function gradient and policy gradient?

And more...

decisionsanddragons.com

Antonin Raffin @araffin2 Nov 5, 2024

Some news from Stable-Baselines3 (master branch):
- we added support for Gymnasium v1.0 (while being backward compatible with v0.29.1)
- we added CrossQ algorithm in SB3 Contrib (a sample efficient replacement for SAC, without target network)

SB3 v2.4.0 coming soon ;)