TradeCraft: an Arena for Long-term Strategic Social Reasoning and Planning
Junqi Wang* Shaoyang Cui* Chunhui Zhang* Yuan Zhang Jinkai Li Zhihao Cao Qi Liu Lifeng Fan^✉
Under Review
Arxiv (coming soon)

Mindmaster Roleplay: A Social Reasoning and Planning Benchmark
Zhihao Cao* Chunhui Zhang* Xiaoyi Chen Yin Tang Manjie Xu Liangru Xiang Federico Rossano Siyuan Qi Yujia Peng Song-Chun Zhu Yizhou Wang Yixin Zhu^✉ Lifeng Fan*^✉
Under Review
Arxiv (coming soon)

Read the Room: Video Social Reasoning with Mental-Physical Causal Chains
Lixing Niu* Jiapeng Li* Xingping Yu Xinyi Dong Shu Wang Ruining Feng Bo Wu Ping Wei Yisen Wang Lifeng Fan^✉
Under Review
Arxiv (coming soon)

R^3-VQA: “Read the Room” via Video Social Reasoning
Lixing Niu* Jiapeng Li* Xingping Yu Shu Wang Ruining Feng Bo Wu Ping Wei Yisen Wang Lifeng Fan^✉

Arxiv

Multi-Grained Compositional Visual Clue Learning for Image Intent Recognition
Yin Tang Jiankai Li Jiajun Song Hongyu Yang Xuan Dong Lifeng Fan Weixin Li^✉
Under Review
Arxiv

Trigger Modulation via Motion Awareness and Sparse Keyframe Injection for Video Backdoor Attacks
Min Li Tangfei Liao Chaojian Yu Lifeng Fan Xinge You
Under Review
Arxiv

Do Theory of Mind Benchmarks Need Explicit Human-like Reasoning in Language Models?
Yi-Long Lu*^✉ Chunhui Zhang*^✉ Jiajun Song Lifeng Fan Wei Wang^✉
Under Review
Arxiv

Learning Concept-Based Causal Transition and Symbolic Reasoning for Visual Planning
Yilue Qian Peiyu Yu Yingnian Wu Yao Su Wei Wang^✉ Lifeng Fan^✉
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
Paper

Evaluating and Modeling Social Intelligence: A Comparative Study of Human and AI Capabilities
Junqi Wang* Chunhui Zhang* Jiapeng Li Yuxi Ma Lixing Niu Jiaheng Han Yujia Peng^✉ Yixin Zhu^✉ Lifeng Fan^✉
Proceedings of the Annual Meeting of the Cognitive Science Society (CogSci), 2024
Paper Demo Code & Dataset Appendix

Smart Help: Strategic Opponent Modeling for Proactive and Adaptive Robot Assistance in Households
Zhihao Cao* Zidong Wang* Siwen Xie Anji Liu Lifeng Fan^✉
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Paper Code Data & Model Demo Poster

IntentQA: Context-aware Video Intent Reasoning
Jiapeng Li Ping Wei Wenjuan Han Lifeng Fan^✉
The IEEE International Conference on Computer Vision (ICCV), 2023.
Paper Supp Code Dataset Demo Oral

The Tong Test: Evaluating Artificial General Intelligence Through Dynamic Embodied Physical and Social Interactions
Yujia Peng Jiaheng Han Zhenliang Zhang Lifeng Fan Tengyu Liu Siyuan Qi Xue Feng Yuxi Ma Yizhou Wang Song-Chun Zhu^✉
Engineering, 2023.
Paper

Artificial Social Intelligence: A Comparative and Holistic View
Lifeng Fan Manjie Xu Zhihao Cao Yixin Zhu^✉ Song-Chun Zhu^✉
CAAI Artificial Intelligence Research, 2022.
Paper
中国科学报/科学网1 中国科学报/科学网2 北大新闻网 北大AI院官网 北大科研官微 北大新工科官微 北大AI院官微

Emergent Graphical Conventions in a Visual Communication Game
Shuwen Qiu* Sirui Xie* Lifeng Fan Tao Gao Jungseock Joo Song-Chun Zhu Yixin Zhu^✉
Conference on Neural Information Processing Systems (NeurIPS), 2022.
Paper Web

A Hierarchical Computational Framework for Social Interaction Understanding: Interactiveness, Shared Attention, Gaze Communication and Triadic Belief Dynamics
Lifeng Fan
Ph.D. Dissertation, 2021.
Paper

GRICE: A Grammar-based Dataset for Recovering Implicature and Conversational rEasoning
Zilong Zheng Shuwen Qiu Lifeng Fan Yixin Zhu Song-Chun Zhu^✉
ACL-Findings, 2021.
Paper Project

Learning Triadic Belief Dynamics in Nonverbal Communication from Videos
Lifeng Fan* Shuwen Qiu* Zilong Zheng Tao Gao Song-Chun Zhu Yixin Zhu^✉
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Paper Supp Code Dataset Demo Oral
MIT科技评论 DeepTech

Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Human-like Commonsense
Yixin Zhu^✉ Tao Gao Lifeng Fan Siyuan Huang Mark Edmonds Hangxin Liu Feng Gao Chi Zhang Siyuan Qi Yingnian Wu Joshua B. Tenenbaum Song-Chun Zhu
Engineering, Special Issue on Artificial Intelligence, 2020.
Paper

Understanding False-Belief by Joint Inference of Object States, Robot Knowledge, and Human (False-)Beliefs
Tao Yuan Hangxin Liu Lifeng Fan Zilong Zheng Tao Gao Yixin Zhu Song-Chun Zhu^✉
The IEEE International Conference on Robotics and Automation (ICRA), 2020.
Paper Demo

Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning
Lifeng Fan* Wenguan Wang* Siyuan Huang Xinyu Tang Song-Chun Zhu^✉
The IEEE International Conference on Computer Vision (ICCV), 2019.
Paper Code Dataset Demo

Inferring Shared Attention in Social Scene Videos
Lifeng Fan* Yixin Chen* Ping Wei^✉ Wenguan Wang Song-Chun Zhu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Paper Code Dataset Demo

Perception of Human Interaction Based on Motion Trajectories: from Aerial Videos to Decontextualized Animations
Tianmin Shu*^✉ Yujia Peng* Lifeng Fan Hongjing Lu Song-Chun Zhu
Topics in Cognitive Science, 2018.
Paper

Inferring Human Interaction from Motion Trajectories in Aerial Videos
Tianmin Shu* Yujia Peng* Lifeng Fan Hongjing Lu Song-Chun Zhu^✉
Proceedings of the Annual Meeting of the Cognitive Science Society (CogSci), 2017.
Paper Web Computational Modeling Prize