Perceptron AI

Today we're releasing Mk1.5: a new intelligence layer for embodied agents.

It flies drones, controls quadrupeds, powers smart glasses, tracks objects, searches the web, reasons visually, and dispatches its own sub-agents.

One model, no platform-specific retraining. 🧵

Introducing EgoHome: a new open benchmark for dense, sub-second egocentric understanding.

Human-annotated household-chore video with 4 annotation types on every clip: hand boxes, subtasks, hand actions, hand captions.

It features over 750 segments under 500ms.

Data, metrics, and judge prompts are all open. 🧵

Today we’re releasing Perceptron Egocentric 1.0: The frontier for egocentric annotations, now through a self-service API.
• Fine-grained subtasks matching Astra quality at ~1/8 the cost
• State-of-the-Art 2D and 3D hand tracking
• Individual timelines for every action on each hand and robot gripper

We were blown away by the projects we saw at @DubHacks this weekend. Teams spent the weekend building with Mk 1.5 and Isaac 0.5 on our Perception and Robotics tracks, and they came up with some incredible applications in just 24 hours. We've linked some of our favorites below and can't wait to see what these students build next!

Mk1.5 allows developers to build any embodied agent without training. Watch Mk1.5 control a quadruped to navigate a room, find the router in a server room, and identify the root cause of the issue.