Twitxy Saved

clockworkio

Verified account This account is verified. Learn more

@clockworkio

Clockwork.io builds software that optimizes GPU clusters for fault tolerance, deterministic performance and increased utilization.
Palo Alto, California clockwork.io Joined April 2021
112 Following 113 Followers 393 Posts

Latest posts 5

Pinned post

clockworkio Verified account @clockworkio
At scale, failures are routine. Losing the work has been routine too. Not anymore.

LinkedIn runs Clockwork.io in production. Together.ai is bringing TorchPass to its GPU cluster customers. SemiAnalysis measured the payback: goodput loss cut from 14% to under 3%.

Today we're launching an industry first, in preview: TorchPass Snapshots in addition to Asynchronous Application checkpoints. And announcing $31M in new funding.

๐Ÿ”น TorchPass Snapshots: save a whole running training job, across every node, with no code changes. Free the GPUs now. Resume later. Nothing lost. Platform teams stop waiting for application owners to add checkpointing.
๐Ÿ”น Async Application Checkpoints: checkpoint while you train, not instead of training. Save more often, lose less when something breaks, and get fresh weights to Reinforcement Learning rollouts sooner.

Our AI fault tolerance is already proven in production:
โœ… LinkedIn runs Clockwork.io LinkPass across its AI infrastructure fleet.
"In aggregate, Clockwork.io prevents tens of thousands of GPU-hours of downtime per month across our fleet." Raghu Hiremagalur, SVP, CTO Infrastructure, LinkedIn.
โœ… @togethercompute is bringing TorchPass to market as a service on its GPU Clusters.
"Our customers grade us on goodput, the share of their GPU-hours that actually move the model forward." Pavneet Singh Ahluwalia Ahluwalia, Product Lead, Together.ai
โœ… WhiteFiber is expanding Clockwork.io across its global GPU footprint. "We bring clusters up faster, and a customer's first training run lands on a fabric validated end-to-end, not just powered on." Tom Sanfilippo, CTO, WhiteFiber.

Quantifiable payback: "In our ClusterMAX, TorchPass cuts training goodput loss from 14% to under 3% for a gold-rated neocloud." Dylan Patel, @SemiAnalysis_ , @dylan522p. More than 11 points of GPU capacity back, measured independently.

New funding: $31M with @PremjiInvest, @Wing_VC, Seligman Ventures, New Enterprise Associates (@NEA), @etisalatandae

Pressure tested at scale with some of the worldโ€™s largest enterprises, neoclouds and hyperscalers. The job never stops.

Stop paying for job restarts. Preview access opens today, and we'll kill a GPU and a link live at PyTorch Conference with Together.ai. Schedule a demo and preview access in the first comment ๐Ÿ‘‡

#AIInfrastructure #FaultTolerance #DistributedTraining #GPU #PyTorch
clockwork.io Home - clockwork
clockworkio Verified account @clockworkio
Kill the GPU bill. Not the job.

At LinkedIn, Clockwork prevents tens of thousands of GPU-hours of downtime each month.

At #SC26, weโ€™ll kill a link or GPU live. Watch the workload keep progressing.

Booth #7205 ยท Nov. 17โ€“19 ยท Chicago

Full schedule in the video.
1:02
clockworkio Verified account @clockworkio
๐€๐ง๐ฒ๐จ๐ง๐ž ๐ซ๐ฎ๐ง๐ง๐ข๐ง๐  ๐ฅ๐š๐ซ๐ ๐ž ๐ญ๐ซ๐š๐ข๐ง๐ข๐ง๐  ๐ฃ๐จ๐›๐ฌ ๐ค๐ง๐จ๐ฐ๐ฌ ๐ญ๐ก๐ž ๐Ÿ๐š๐ฆ ๐ฉ๐š๐ ๐ž: ๐จ๐ง๐ž ๐ฅ๐ข๐ง๐ค ๐Ÿ๐ฅ๐š๐ฉ, ๐†๐๐” ๐Ÿ๐š๐ฎ๐ฅ๐ญ, ๐จ๐ซ ๐ง๐จ๐๐ž ๐Ÿ๐š๐ข๐ฅ๐ฎ๐ซ๐ž, ๐š๐ง๐ ๐ญ๐ก๐ž ๐ž๐ง๐ญ๐ข๐ซ๐ž ๐ฃ๐จ๐› ๐ข๐ฌ ๐๐จ๐ฐ๐ง.

One dead rank stalls every collective until the NCCL watchdog fires. Then checkpoint and restart: 45-90 minutes across every GPU in the job.

Next week at PyTorch Conference North America, Together AIโ€™s Pavneet Ahluwalia and Clockworkโ€™s Gavin Cohen walk through a training failover system built to keep the job running through all of it, and how to tell when live migration beats checkpoint-restart.

๐Ÿ—ฃ๏ธ ๐“๐จ๐ ๐ž๐ญ๐ก๐ž๐ซ ๐€๐ˆ + ๐‚๐ฅ๐จ๐œ๐ค๐ฐ๐จ๐ซ๐ค ๐ฃ๐จ๐ข๐ง๐ญ ๐ฌ๐ž๐ฌ๐ฌ๐ข๐จ๐ง
Self-Healing PyTorch Training Through Live GPU Migration
Wed Oct 21 ยท 12:20 PM PDT ยท Room LL20CD

โฐ ๐‘๐ข๐ ๐ก๐ญ ๐š๐Ÿ๐ญ๐ž๐ซ, ๐ฐ๐š๐ญ๐œ๐ก ๐ข๐ญ ๐ก๐š๐ฉ๐ฉ๐ž๐ง: ๐๐ž๐ฏ๐ž๐ซ ๐‡๐ข๐ญ ๐™๐ž๐ซ๐จ
Lin She, Clockwork.io
Wed Oct 21 ยท 12:45 PM PDT ยท Demo Theater, Community Expo
๐‘†๐‘’๐‘’ ๐‘–๐‘ก ๐‘–๐‘› ๐‘Ž๐‘๐‘ก๐‘–๐‘œ๐‘› ๐‘Ž๐‘  ๐‘ค๐‘’ ๐‘๐‘ข๐‘™๐‘™ ๐‘Ž ๐‘›๐‘’๐‘ก๐‘ค๐‘œ๐‘Ÿ๐‘˜ ๐‘๐‘Ž๐‘๐‘™๐‘’ ๐‘Ž๐‘›๐‘‘ ๐‘Ž ๐‘๐‘œ๐‘ค๐‘’๐‘Ÿ ๐‘๐‘Ž๐‘๐‘™๐‘’ ๐‘“๐‘Ÿ๐‘œ๐‘š ๐‘Ž ๐‘Ÿ๐‘ข๐‘›๐‘›๐‘–๐‘›๐‘” ๐‘—๐‘œ๐‘, ๐‘œ๐‘› ๐‘๐‘Ž๐‘š๐‘’๐‘Ÿ๐‘Ž.

๐Ÿ“ ๐๐จ๐จ๐ญ๐ก ๐๐Ÿ–, ๐‚๐จ๐ฆ๐ฆ๐ฎ๐ง๐ข๐ญ๐ฒ ๐„๐ฑ๐ฉ๐จ. Bring your failure modes. Book a 1:1 or a private live TorchPass demo.

#PyTorchConference #DistributedTraining #FaultTolerance #GPUClusters #NCCL
clockworkio Verified account @clockworkio
Last night we kicked off @CoreWeave 's Fully Connected 2026 โ€” a reception with robots pouring drinks, games, and some of the sharpest full-stack AI infra engineers all in one room.

๐ƒ๐š๐ฒ ๐Ÿ ๐ค๐ข๐œ๐ค๐ฌ ๐จ๐Ÿ๐Ÿ ๐ญ๐จ๐๐š๐ฒ ๐ฐ๐ข๐ญ๐ก ๐ข๐ง๐ฌ๐ฉ๐ข๐ซ๐ž๐ ๐ข๐ง๐ง๐จ๐ฏ๐š๐ญ๐ข๐จ๐ง๐ฌ ๐ข๐ง ๐ฉ๐ซ๐จ๐๐ฎ๐œ๐ญ๐ข๐จ๐ง ๐š๐œ๐ซ๐จ๐ฌ๐ฌ ๐ž๐ฏ๐ž๐ซ๐ฒ ๐ข๐ง๐๐ฎ๐ฌ๐ญ๐ซ๐ฒ, and culminates with ๐š ๐ซ๐ž๐š๐ฅ ๐๐š๐ญ๐ญ๐ฅ๐ž ๐จ๐Ÿ ๐ญ๐ก๐ž ๐๐จ๐ญ๐ฌ.

Catch us at the Clockwork booth in Pioneer Pavilion and see how we are built for production scale reliability, keeping AI runs alive through infra failures.

#FullyConnected #AIInfra #Battleofthebots #CoreweaveEvent
0:32
clockworkio Verified account @clockworkio
๐€๐ˆ ๐ค๐ž๐ž๐ฉ๐ฌ ๐ฆ๐จ๐ฏ๐ข๐ง๐  โ€” ๐ž๐ฏ๐ž๐ง ๐ฐ๐ก๐ž๐ง ๐š ๐†๐๐” ๐Ÿ๐š๐ข๐ฅ๐ฌ ๐จ๐ซ ๐š ๐ฅ๐ข๐ง๐ค ๐๐ซ๐จ๐ฉ๐ฌ.

At @CoreWeave's Fully Connected (Sept 29โ€“Oct 1, San Francisco), we're showing what Workload-Aware Fault Tolerance actually looks like: FleetLens audits the fleet and pinpoints the fault. TorchPass and LinkPass keep distributed workloads running.

๐‘Š๐‘’ ๐‘‘๐‘œ๐‘ข๐‘๐‘™๐‘’-๐‘‘๐‘Ž๐‘Ÿ๐‘’ ๐‘ฆ๐‘œ๐‘ข ๐‘ก๐‘œ ๐‘๐‘œ๐‘š๐‘’ ๐‘ ๐‘’๐‘’ ๐‘–๐‘ก ๐‘–๐‘› ๐‘Ž๐‘๐‘ก๐‘–๐‘œ๐‘›.

๐Ÿ”— Book time with the team: na2.hubs.ly/H080KZ30

#FullyConnected #AIInfrastructure #GPU #TorchPass #YOCO #LinkPass #workloadaware #faulttolerance #DARE