R^3-VQA: “Read the Room” via Video Social Reasoning
Lixing Niu* Jiapeng Li* Xingping Yu Shu Wang Ruining Feng Bo Wu Ping Wei Yisen Wang Lifeng Fan^✉
Under Review
Arxiv (coming soon)

Learning Concept-Based Causal Transition and Symbolic Reasoning for Visual Planning
Yilue Qian Peiyu Yu Yingnian Wu Yao Su Wei Wang^✉ Lifeng Fan^✉
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
Paper Code (coming soon)

Evaluating and Modeling Social Intelligence: A Comparative Study of Human and AI Capabilities
Junqi Wang* Chunhui Zhang* Jiapeng Li Yuxi Ma Lixing Niu Jiaheng Han Yujia Peng^✉ Yixin Zhu^✉ Lifeng Fan^✉
Proceedings of the Annual Meeting of the Cognitive Science Society (CogSci), 2024
Paper Demo Code & Dataset Appendix

Smart Help: Strategic Opponent Modeling for Proactive and Adaptive Robot Assistance in Households
Zhihao Cao* Zidong Wang* Siwen Xie Anji Liu Lifeng Fan^✉
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Paper Code Data & Model Demo Poster

IntentQA: Context-aware Video Intent Reasoning
Jiapeng Li Ping Wei Wenjuan Han Lifeng Fan^✉
The IEEE International Conference on Computer Vision (ICCV), 2023.
Paper Supp Code Dataset Demo Oral

The Tong Test: Evaluating Artificial General Intelligence Through Dynamic Embodied Physical and Social Interactions
Yujia Peng Jiaheng Han Zhenliang Zhang Lifeng Fan Tengyu Liu Siyuan Qi Xue Feng Yuxi Ma Yizhou Wang Song-Chun Zhu^✉
Engineering, 2023.
Paper

Artificial Social Intelligence: A Comparative and Holistic View
Lifeng Fan Manjie Xu Zhihao Cao Yixin Zhu^✉ Song-Chun Zhu^✉
CAAI Artificial Intelligence Research, 2022.
Paper
中国科学报/科学网1 中国科学报/科学网2 北大新闻网 北大AI院官网 北大科研官微 北大新工科官微 北大AI院官微

Emergent Graphical Conventions in a Visual Communication Game
Shuwen Qiu* Sirui Xie* Lifeng Fan Tao Gao Jungseock Joo Song-Chun Zhu Yixin Zhu^✉
Conference on Neural Information Processing Systems (NeurIPS), 2022.
Paper Web

A Hierarchical Computational Framework for Social Interaction Understanding: Interactiveness, Shared Attention, Gaze Communication and Triadic Belief Dynamics
Lifeng Fan
Ph.D. Dissertation, 2021.
Paper

GRICE: A Grammar-based Dataset for Recovering Implicature and Conversational rEasoning
Zilong Zheng Shuwen Qiu Lifeng Fan Yixin Zhu Song-Chun Zhu^✉
ACL-Findings, 2021.
Paper Project

Learning Triadic Belief Dynamics in Nonverbal Communication from Videos
Lifeng Fan* Shuwen Qiu* Zilong Zheng Tao Gao Song-Chun Zhu Yixin Zhu^✉
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Paper Supp Code Dataset Demo Oral
MIT科技评论 DeepTech

Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Human-like Commonsense
Yixin Zhu^✉ Tao Gao Lifeng Fan Siyuan Huang Mark Edmonds Hangxin Liu Feng Gao Chi Zhang Siyuan Qi Yingnian Wu Joshua B. Tenenbaum Song-Chun Zhu
Engineering, Special Issue on Artificial Intelligence, 2020.
Paper

Understanding False-Belief by Joint Inference of Object States, Robot Knowledge, and Human (False-)Beliefs
Tao Yuan Hangxin Liu Lifeng Fan Zilong Zheng Tao Gao Yixin Zhu Song-Chun Zhu^✉
The IEEE International Conference on Robotics and Automation (ICRA), 2020.
Paper Demo

Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning
Lifeng Fan* Wenguan Wang* Siyuan Huang Xinyu Tang Song-Chun Zhu^✉
The IEEE International Conference on Computer Vision (ICCV), 2019.
Paper Code Dataset Demo

Inferring Shared Attention in Social Scene Videos
Lifeng Fan* Yixin Chen* Ping Wei^✉ Wenguan Wang Song-Chun Zhu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Paper Code Dataset Demo

Perception of Human Interaction Based on Motion Trajectories: from Aerial Videos to Decontextualized Animations
Tianmin Shu*^✉ Yujia Peng* Lifeng Fan Hongjing Lu Song-Chun Zhu
Topics in Cognitive Science, 2018.
Paper

Inferring Human Interaction from Motion Trajectories in Aerial Videos
Tianmin Shu* Yujia Peng* Lifeng Fan Hongjing Lu Song-Chun Zhu^✉
Proceedings of the Annual Meeting of the Cognitive Science Society (CogSci), 2017.
Paper Web Computational Modeling Prize