Roni Sengupta

@SenguptRoni

Asst. Professor @unccs, Prev. postdoc @uwcse (UW), Ph.D. @umiacs (Univ. of Maryland). Computer Vision & Graphics (she/her)

Chapel Hill, NC cs.unc.edu/~ronisen/ Joined April 2018

939 Following 2.6K Followers 889 Posts

Latest posts 5

Pinned post

Roni Sengupta @SenguptRoni May 22

Honored to receive an NSF CAREER Award! 🎉
Huge thanks to my students, mentors, the amazing colleagues at @unccs , and my family for making this possible. 🙏

We'll be working on Inverse Physics — teaching computers to infer shape, reflectance, lighting, material properties, and motion from images and videos, spanning both inverse rendering and simulation.
These algorithms will advance endoscopic and laparoscopic procedures with robotic guidance (supported by our NIH grants), help robots handle delicate materials in manufacturing, and various other scientific and engineering applications.

Roni Sengupta @SenguptRoni Oct 2

Excited to be part of this EngageAI Institute with @mohitban47 and Xiaoming Liu and collaborators across NCSU, Indiana, Vanderbilt, and Digital Promise.

Looking forward to developing efficient 3D World models for an engaging and personalized learning experience for K-12 students in STEM.

Mohit Bansal Verified account @mohitban47 Oct 2

🎉 Excited that our NSF AI Institute for Engaged Learning has been renewed for another 5 years 🙏

Looking forward to leading the core AI efforts on 3D world models for multimodal narrative environments and AI that adapts to student needs -- and collaborating with our wonderful partners (top experts in education and learning sciences) to produce transformative advances in our understanding of how students learn and fundamentally improve the learning outcomes for K-12 students!

🚨 We'll be hiring postdocs+ phd students etc. for the next 5 years for this, so apply+ping with any questions!
View quoted post on X

Roni Sengupta @SenguptRoni Oct 2

Can you estimate an object’s physical properties, such as its stiffness and velocity, from a single video?

Our @NeurIPSConf 2026 paper, MonoPhysics, answers this question.

Led by my students @daniel129911845, Jun, Matthew, and in colab with @DBiswadip.

Project Page: daniel03c1.github.io/MonoPhysics/

1/2

0:41

Roni Sengupta @SenguptRoni Dec 30, 2025

🚨 PhD Opening: 3D/4D SLAM & Inverse Rendering for Endoscopy (NIH funded) at @UNC_CS! 🚨

The Project:
🟩 Ideal for students with a strong background in 3D Computer Vision & interested in medical robotics & visualization.
🟩 Highly collaborative work with roboticists, medical imaging researchers, and clinicians (GI, ENT, Pulmonology).
🟩Aim to publish in top-tier CV/ML/Robotics/Medical Imaging venues.
🟩 Build on our prior works:
1⃣Endoscopy depth estimator: PPSNet [ECCV'24 - ppsnet.github.io]
2⃣ 3D SLAM for endoscopy: NFL-BA [NeurIPS'25 -asdunnbe.github.io/NFL-BA/]

Apply now! 📧 Email CV to ronisen@cs.unc.edu 📝 Formal UNC CS application required (Deadline soon!)

RTs appreciated! 🙏

Roni Sengupta @SenguptRoni Dec 24, 2025

Cool new work in collaboration with ILM (Lucasfilm) @danbgoldman

OVER++ uses scribbles + text prompts to create video effects (splash, dust, wake, shadows, smoke, etc.) by combining foreground and background layers using a video diffusion model.

Project Page: overplusplus.github.io

Check out our results below: 👇

Luchao Qi Verified account @QiLuchao Dec 23, 2025

🎉Thrilled to share our new work: Over++: Generative Video Compositing for Layer Interaction Effects! 🎉

We introduce a method for generating realistic interaction effects between foreground and background layers, with both mask-based and prompt-based control.

View quoted post on X