Twitxy Saved

BK Jin · Adventists AI

@BKJinAI

Founder @ Adventists AI. Building open voice models that hear how you speak — DuplexJev · Sophon-Realtime (open weights soon). Melbourne.
Melbourne, Victoria github.com/adventists-ai Joined July 2019
66 Following 41 Followers 23 Posts

Latest posts 5

BK Jin · Adventists AI @BKJinAI
Sophon-Realtime v1.2 is out.
• Long replies are now spoken to the end, no cap on speech length.
• New: Flash-4bit — full-duplex voice chat on one 32 GB GPU, ~0.2 s first audio, barge-in + tool calls.
huggingface.co/adventists-ai
github.com/adventists-ai/…
huggingface.co adventists-ai (Adventists.ai) Org profile for Adventists.ai on Hugging Face, the AI community building the future.
BK Jin · Adventists AI @BKJinAI
Sophon-Realtime v1.1: zero-shot voice cloning in our open full-duplex model.

A few seconds of audio and it talks in that voice, live. No fine-tuning, no restart, one GPU.

Video: my voice from 11 s, then a colleague's from 9 s. Thanks @ModelScope2022!
x.com/ModelScope2022…
ModelScope Verified account @ModelScope2022 3d
Sophon-Realtime v1.1 from Adventists AI @BKJinAI adds zero-shot voice cloning to an open-weights, full-duplex voice model.

Drop a few seconds of someone's voice into model/voices/, set "voice" to its name, and talk to it in that voice in real time. No fine-tuning, no restart, one GPU. Barge-in and laughs still work, and a voice cloned from a clip in one language can speak another.

Available in the Tag and Flash builds on ModelScope. Live mode is a drop-in replacement for the OpenAI GPT-Live API, and an E2E build with 0.21 s to first audio is coming soon.

Please only clone voices you have permission to use. 🤖modelscope.ai/models/Adventi…
View quoted post on X
BK Jin · Adventists AI @BKJinAI
Thanks @ModelScope2022 for the feature! Sophon-Realtime v1 is open on ModelScope: it hears your tone and speaks with one.

Talk to it in your browser: modelscope.ai/studios/Advent…

Or self-host on one GPU with vLLM-Omni:
pip install sophon-realtime && sophon-realtime serve
modelscope.ai Sophon-Realtime - ModelScope Sophon-Realtime - An interactive demo by AdventistsAI on ModelScope. Open-source full-duplex voice chat with interruption, camera sharing, and customizable personas. Pow
ModelScope Verified account @ModelScope2022 5d
Adventists AI just open-sourced Sophon-Realtime v1 on ModelScope: a full-duplex voice model that hears how you speak, and answers with tone of its own.

• It keeps listening while you talk, answers ~0.4 s after you stop, and stops the moment you cut in
• It laughs, sighs and clears its throat when the conversation calls for it
• #1 among open full-duplex models on VoiceBench (82.8) and Big Bench Audio (81.8%)
• 48% Pass@1 on Full-Duplex-Bench v3 tool calling, ahead of Grok (43%)
Apache-2.0 weights. Built by @BKJinAI and team.
modelscope.ai/collections/Ad…
modelscope.ai/studios/Advent…
View quoted post on X