Twitxy Saved

Will Smith

Verified account This account is verified. Learn more

@WillSmithVision

Cofounder/CSO @pxld_ai, Professor @UoY_CS, @YorkVGL group leader, vision/graphics/ML research, @Boro fan and climber @willsmithvision.bsky.social
York, UK www-users.york.ac.uk/~waps101/ Joined February 2019
656 Following 674 Followers 334 Posts

Latest posts 5

Will Smith Verified account @WillSmithVision
@Meta's new "Hologram Calls" feature composites full body video into your own environment. The harmonisation model we've built @pxld_ai can make it look like they're really in the room with you, relit to match the scene lighting and even casting shadows into the scene. Our DAWN model takes only the raw composite as input and directly outputs the harmonised result. Find out more about what we're doing: pxld.ai
0:14
0 replies 1 reposts 13 likes 360K views View on X
Will Smith Verified account @WillSmithVision
I wrote a blog post about how you can now do studio-quality virtual production with just a phone, no studio and our tools at @pxld_ai: www-users.york.ac.uk/~waps101/post/…

My examples use Unreal Engine scenes driven by our estimated camera poses, our matting model for compositing and our 360 harmonisation model to relight the people to match the Unreal scene and add shadows and reflections. Join our waitlist at pxld.ai or send me your own video and I will put you into a virtual scene.
www-users.york.ac.uk Virtual production on an iPhone | WILL SMITH Virtual production without the studio: shoot anywhere, in any light, track the camera, render a matching background in Unreal Engine, then use PXLD's AI matting and harmonisation to make the actors...
0 replies 2 reposts 6 likes 225K views View on X
Will Smith Verified account @WillSmithVision
I am incredibly excited to reveal our @UniOfYork spin-out @pxld_ai (pxld.ai), now out of stealth! Game-changing relighting, inverse rendering and harmonisation technology that lets you put yourself in any world with photoreal lighting and effects on the scene. You really can now get LED volume virtual production quality with nothing more than a phone and our tools.

I have worked on 3D computer vision, inverse rendering and relighting since my PhD back in 2003-2007. Before that, I was obsessed with the idea of VR and built a primitive VR system for my GCSE DT project! My interest was less about the VR hardware and more about the freedom that would come from being able to enter any real or imagined worlds. I've remained fascinated by this challenge and, when I think back to my PhD and our primitive attempts to edit the lighting on a face using shape-from-shading, I cannot believe how much progress we have made!

Have a look:
🔹 Rock solid surface normals and albedo maps, hair-perfect mattes and photoreal relighting and harmonisation into a scene pxld.ai/#passes
🔹 Click through the scenes for each video and see if you can tell which is the real one pxld.ai/#campaign
🔹 Check out how the video you record of yourself has a physical effect on the virtual world, almost like an interactive world model pxld.ai/#physical

Unlike a generative video model, our output isn't just conditioned on your recorded video (where your prompt and random seed luck will determine how well you and your performance are preserved). Your performance is kept exactly as recorded, pixel for pixel.

There are so many cool things you can do with these tools at your disposal. We'll be releasing demos over the coming days and weeks to illustrate some of the potential but I'm most excited about getting the tools into the hands of filmmakers, content creators and consumers to see what ideas we unlock!

Join the waitlist if you want access or send me a video of yourself and I'll put you in a new world.

Huge thanks to my cofounders @WillRowan3 and @JADGardner for bringing this vision to life.
pxld.ai PXLD. Keep the take. Change the world. PXLD keeps the real performance at the heart of the shot while transforming the world around it.
PXLD AI Verified account @pxld_ai Nov 9
Introducing DAWN: our foundation model for world harmonisation.

GenAI can change the world. Only PXLD does it with:
• The performance exactly as shot, not regenerated.
• Total 360 degree control of the world, no text prompts needed.
• Unlimited clip length and scenes, for film and high-end VFX.
View quoted post on X
4 replies 4 reposts 24 likes 464K views View on X
Will Smith Verified account @WillSmithVision
Excited to announce our latest (submitted to) SIGBOVIK 2026 @sigbovik paper: "SchmidhubAI: Accurate Historical Paper Attribution". We built an AI system that, given any modern AI paper, automatically determines which of its ideas were already published by Jürgen Schmidhuber.
5 replies 16 reposts 140 likes 62K views View on X
Will Smith Verified account @WillSmithVision
I am delighted (that pun will make sense in a second) that @AlistairFoggin's first paper, CroCoDiLight, has been accepted to ICLR. The idea came from a group discussion on the CroCo paper from @naverlabseurope and realising it might implicitly already understand relighting.
Alistair Foggin @AlistairFoggin Feb 27
Very excited to announce my first paper, CroCoDiLight! Co-authored with @WillSmithVision and accepted at #ICLR2026.

Image relighting, shadow removal, and albedo estimation, all in our single base model with swappable task components.

See you in Rio @iclr_conf! [1/7]
View quoted post on X