Twitxy Saved

Manuel Gauto

Verified account This account is verified. Learn more

@manuel_gauto_

Co-Founder @Vectoral_Labs
Semi-Professional Heckler and Ice Cream Aficionado
Ask me about airplanes
Chicago, IL Joined January 2021
30 Following 23 Followers 38 Posts

Latest posts 5

Manuel Gauto Verified account @manuel_gauto_
I am excited to announce the launch of SafetyD from @vectoral_labs!

The world of token security has gotten more interesting the deeper I dive into it.

I expected to see financial motivations or even folks using LLMs to amplify cyberattacks. Unfortunately, there was a much darker side of this world.

Actors were using LLMs to generate harmful content of every type, from blueprints for biological weapons to child abuse material. We also learned that there was quite an arms race underway between the actors trying to generate this content and the platforms defending themselves against it.

The key problem was not one of just accuracy but of speed. LLM-based detection models were not fast enough to be able to do the required analysis in real-time. So we set our sights on developing a solution that was:
- Fast enough to use in the inference hot-path
- Scalable enough to handle the throughput of our largest customers
- Agile enough to improve quickly as new threats arose

SafetyD is a set of models designed to run within your boundary, on CPU, and on your inference hot-path. We see most requests being fulfilled within 1ms while matching the accuracy we see from the LLM-based moderation models.

I am excited to bring such interesting technology to bear on such an important part of the token security problem.

Check out the first set of benchmarks for our preview version here: labs.vectoral.com/research/safet…

If you want to read more about SafetyD, check out the blog:
vectoral.com/blog/safetyd-t…

If you want to learn more about how you can integrate SafetyD with your systems to help prevent malicious prompts from internal or external sources, send me a note!
Manuel Gauto Verified account @manuel_gauto_
So excited for you guys! Great team and a great product!
Zach Moskow Verified account @zachmoskow 5d
Introducing Concentrate AI (@concentrateai), the first HIPAA-compliant AI gateway for healthcare and life sciences.

One API and one universal BAA with us for HIPAA-covered inference.

We handle provider agreements, inference, and billing for you, with spend controls and fallbacks built in. Customers are saving over 50% with lower-cost open-source models.

SOC 2 Type 2. HIPAA enabled. Built for personal and patient data (PII/PHI) across healthcare, pharma, legaltech, insurtech, and fintech.

Now generally available. Thanks to early customers: Pocket, Kinstead Health, Hummingbird Healthcare, and many more.

See what your AI setup is missing and book a demo: concentrate.ai/enterprise
View quoted post on X