Twitxy Saved

Bella Chai

Verified account This account is verified. Learn more

@Jinyu_Chai

AI Researcher, engineer @OpenMachineAI @runboubou
San Francisco, CA bella-chai.com Joined January 2025
42 Following 317 Followers 84 Posts

Latest posts 5

Bella Chai Verified account @Jinyu_Chai
I turned my computer into Reachy Mini’s AI server.

Now it’s powered by local Qwen through Boubou, having a very serious conversation with Maya about… cooking ?

Boubou is open source: github.com/runboubou/boub…

And Reachy is just one example.

Any robot or app that supports OpenAI Realtime over WebSocket and lets you change the server URL can connect to Boubou, too.

Built on Hugging Face’s speech-to-speech pipeline, our local runtimes package supported models, voices, and dependencies together—ready to launch with one command.

Pick a runtime, fire it up on your computer, and point your device at it. You’re ready to talk.
0:50
2 replies 2 reposts 19 likes 1.4K views View on X
Bella Chai Verified account @Jinyu_Chai
Good point, thanks for adding this. Phones can slow down as they heat up, so a fast first run doesn’t tell us whether TTS can keep up with playback over a longer session.
Alen Požun | Termux & Android Verified account @termuxSolutions Nov 2
@Jinyu_Chai Good thread. On phones the gap problem gets worse because thermal throttling slows later chunks, so TTS that starts out real-time can fall behind after a few minutes. Worth testing sustained speed, not just the first run.

XDA: xdaforums.com/m/termuxsoluti…
View quoted post on X
Bella Chai Verified account @Jinyu_Chai
LLMs have llama.cpp. Can speech models run locally the same way?

Yes. The weights and config can go into a GGUF file. The runtime builds a computation graph for the model, and GGML runs it on your CPU or GPU.

Much of the engineering carries over, including model support, quantization and validation. Streaming speech also needs to keep up with playback and stop when the user interrupts.