Xu Cao

Xu Cao 曹旭

Building AI agents that understand humans — and grow up with children.

I am a CS PhD candidate at the University of Illinois Urbana-Champaign, advised by Prof. James M. Rehg and Prof. Jimeng Sun. My research sits at the intersection of Vision-Language Models, Human Interaction Model, and Social AI. I am the 2026 Google PhD Fellow in Machine Perception.

Driven by my own history as a pediatric rare-disease patient, I co-founded PediaMed AI Lab to advance AI built specifically for pediatrics and child development — in particular, intelligent agents for the early identification, diagnosis, and treatment of cerebral palsy, autism, developmental disorders, and rare neurodevelopmental diseases.

News

Research — three pillars

01

Agent Learning from Children

Cognitive-learning-inspired Multimodal LLMs: studying how children acquire perception, language, and reasoning to build models that learn the same way.

RepresentativeChronoVision (EMNLP 2026) · CogSense (NeurIPS 2026) · RIG-Bench (NeurIPS 2026) · VCog-Bench (COLM 2025)

02

Human Interaction Models & Social AI

The core thread of my PhD: modeling how people interact through non-verbal social cues (gaze, gesture, and emotion) — moving from social perception toward theory of mind, on platforms like AR smart glasses.

Representative GRASP (NeurIPS 2026) · GazeAnywhere (CVPR 2026) · SocialGesture (CVPR 2025) · TransGesture (NeurIPS 2025)

03

Pediatric Foundation Models & Healthcare AI

Foundation models for child development and neurodevelopmental disorders, from autism screening to video-based disease progression simulation.

Representative ChildPose (NeurIPS 2026) · ChildGait (ECCV 2026) · MedDream (CHIL 2026 Best Paper) · AggPose (IJCAI 2022)

Startup

PediaMed AI

With Dr. Meihuan Huang, I co-founded and co-direct a lab of ten researchers building AI for pediatrics and child development — from cognitive multimodal LLMs to AI agents for neurodevelopmental disorders screening. We also run the AI4CHL (ICLR 2025) and CV4CHL (CVPR 2026) workshop series.

We are open to venture investment and collaboration in the US — feel free to reach out.

Selected publications

All publications →