Twitxy Saved

Prashant

Verified account This account is verified. Learn more

@prashant8124

Co-Founder and CTO at @openrelayinc
Joined December 2020
247 Following 89 Followers 136 Posts

Latest posts 5

Prashant Verified account @prashant8124
We are seeing so much software gains left on the table on these supposedly high optimized inference engines! Just by doing context aware routing and fused mega kernels we are getting 3-4x perf improvements in matter of hours. Future for inference is bright and increasingly low cost
Prashant Verified account @prashant8124
Agents should have full access to GPU compute with a budget just like humans! Future of HPC compute with agents in the loop is bright and cost efficient
OpenRelayInc Verified account @OpenRelayInc Oct 19
Your agent can manage its own compute on OpenRelay.

Ask for an H100 and it deploys the VM. Ask for a batch and it runs it overnight. It watches what it spends, live, and stops at the budget you set.

Give your agent an OpenRelay key, then let it cook.

docs.openrelay.inc/docs/cli/agents
View quoted post on X