Haiteng Zhao (赵海腾)
Full-time researcher, Shanghai AI Lab
zhaohaiteng [AT] pku.edu.cn
Bio
Welcome! I am a researcher at Shanghai AI Lab, working on advanced reasoning, multimodal foundation models, autonomous agents, and AI for science.
I received my Ph.D. in Machine Learning and Intelligence from Peking University in 2025, where I also earned my B.S. in Psychology. Over the course of my research, I have gained hands-on experience contributing to trillion-scale foundation models, reinforcement learning systems, and advanced reasoning agents. My work has led to over 20 papers and preprints, with publications in top-tier venues such as ICLR, NeurIPS, ICML, ACL, EMNLP, COLM, and CVPR.
My research is broadly driven by the question of whether deep learning can effectively encode human-like intelligence. Currently, I focus on three main areas:
- Advanced Reasoning: Addressing compositional generalization challenges in deep models, which are crucial for achieving human-like intelligence. My research in this area mainly focuses on long-horizon reasoning and tackling highly complex mathematical challenges. Specifically, I explore how to scale the length and complexity of reasoning steps, and how to enable these reasoning capabilities to self-evolve during training.
- AI for Science: I am deeply interested in the potential of AI to drive scientific discovery. While today's AI demonstrates strong general capabilities, enabling it to autonomously conduct effective scientific research—reasoning through experiments and generating new insights—remains an open question. I bridge this gap by developing scientific multimodal foundation models.
- Foundations of Large Language Models: Investigating core topics such as foundation model architectures, generalization theory, and robustness. As large language models demonstrate impressive general capabilities, there is an urgent need to establish foundational theories and scalable architectures. In particular, my work focuses on improving current LLM frameworks and training paradigms, alongside developing theoretical tools to better predict and analyze their capabilities.
I am always happy to connect and collaborate with you. Feel free to reach out via email!
Publications
Most recent publications on Google Scholar.
‡ indicates equal contribution.
AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification
Lingkai Kong, Zijian Wu, Yuzhe Gu, Haiteng Zhao, Wenyong Huang, Shuang Sun, Zhicheng Xiong, Xiaotian Zhang, Shuya Zhao, Yan Wang, Disheng Xu, Wenwei Zhang, Kai Chen
arxiv preprint
Scalable Visual Pretraining for Language Intelligence
Yiming Zhang, Zhonghan Zhao, Wenwei Zhang, Haiteng Zhao, Tianyang Lin, Yunhua Zhou, Demin Song, Kuikun Liu, Haochen Ye, Haian Huang, Yuzhe Gu, Haijun Lv, Qipeng Guo, Bin Liu, Gaoang Wang, Kai Chen
arxiv preprint
Exploring Visual Pretraining for Learning Language Intelligence
Zhonghan Zhao, Yiming Zhang, Wenwei Zhang, Haiteng Zhao, Xingguang Wei, Zhangwei Gao, Kuikun Liu, Yuzhe Gu, Size Wu, Haian Huang, Jianfei Gao, Haijun Lv, Demin Song, Yunhua Zhou, Qipeng Guo, Gaoang Wang, Kai Chen
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2026
Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale
Intern-S1-Pro Team, Shanghai AI Laboratory
arXiv preprint
Achieving Olympia-Level Geometry Large Language Model Agent via Complexity Boosting Reinforcement Learning
Haiteng Zhao, Junhao Shen, Yiming Zhang, Songyang Gao, Kuikun Liu, Tianyou Ma, Fan Zheng, Dahua Lin, Wenwei Zhang, Kai Chen
International Conference on Learning Representations (ICLR) 2026
Long-horizon Reasoning Agent for Olympiad-Level Mathematical Problem Solving
Songyang Gao, Yuzhe Gu, Zijian Wu, Lingkai Kong, Wenwei Zhang, Zhongrui Cai, Fan Zheng, Tianyou Ma, Junhao Shen, Haiteng Zhao, Duanyang Zhang, Huilun Zhang, Kuikun Liu, Chengqi Lyu, Yanhui Duan, Chiyu Chen, Ningsheng Ma, Jianfei Gao, Han Lyu, Dahua Lin, Kai Chen
Conference on Language Modeling (COLM) 2026
Intern-S1: A Scientific Multimodal Foundation Model
Intern-S1 Team, Shanghai AI Laboratory
arXiv preprint
Semi-off-Policy Reinforcement Learning for Vision-Language Slow-Thinking Reasoning
Junhao Shen, Haiteng Zhao, Yuzhe Gu, Songyang Gao, Kuikun Liu, Haian Huang, Jianfei Gao, Dahua Lin, Wenwei Zhang, Kai Chen
Advances in Neural Information Processing Systems (NeurIPS) 2025
MUR: Momentum Uncertainty guided Reasoning for Large Language Models
Hang Yan, Fangzhi Xu, Rongman Xu, Yifei Li, Jian Zhang, Haoran Luo, Xiaobao Wu, Luu Anh Tuan, Haiteng Zhao, Qika Lin, Jun Liu
The 64th Annual Meeting of the Association for Computational Linguistics (ACL) 2026
ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflows
Qiushi Sun, Zhoumianze Liu, Chang Ma, Zichen Ding, Fangzhi Xu, Zhangyue Yin, Haiteng Zhao, Zhenyu Wu, Kanzhi Cheng, Zhaoyang Liu, Jianing Wang, Qintong Li, Xiangru Tang, Tianbao Xie, Xiachong Feng, Xiang Li, Ben Kao, Wenhai Wang, Biqing Qi, Lingpeng Kong, Zhiyong Wu
International Conference on Learning Representations (ICLR) 2026
Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoning
Fangzhi Xu, Hang Yan, Chang Ma, Haiteng Zhao, Qiushi Sun, Kanzhi Cheng, Junxian He, Jun Liu, Zhiyong Wu
Annual Meeting of the Association for Computational Linguistics (ACL) 2025
φ-Decoding: Adaptive Foresight Sampling for Balanced Inference-Time Exploration and Exploitation
Fangzhi Xu, Hang Yan, Chang Ma, Haiteng Zhao, Jun Liu, Qika Lin, Zhiyong Wu
Annual Meeting of the Association for Computational Linguistics (ACL) 2025
BioMaze: Benchmarking and Enhancing Large Language Models for Biological Pathway Reasoning
Haiteng Zhao, Chang Ma, Fangzhi Xu, Lingpeng Kong, Zhi-Hong Deng
arXiv preprint
Non-myopic Generation of Language Model for Reasoning and Planning
Chang Ma, Haiteng Zhao, Junlei Zhang, Junxian He, Lingpeng Kong
International Conference on Learning Representations (ICLR) 2025
Instruction-Based Molecular Graph Generation with Unified Text-Graph Diffusion Model
Yuran Xiang, Haiteng Zhao, Chang Ma, Zhi-Hong Deng
arXiv preprint
Empowering Large Language Model Agents through Action Learning
Haiteng Zhao, Chang Ma, Guoyin Wang, Jing Su, Lingpeng Kong, Jingjing Xu, Zhi-Hong Deng, Hongxia Yang
Conference on Language Modeling (COLM) 2024
Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoning
Yiqi Wang, Wentao Chen, Xiaotian Han, Xudong Lin, Haiteng Zhao, Yongfei Liu, Bohan Zhai, Jianbo Yuan, Quanzeng You, Hongxia Yang
arXiv preprint
GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot Learning
Haiteng Zhao, Shengchao Liu, Chang Ma, Hannan Xu, Jie Fu, Zhi-Hong Deng, Lingpeng Kong, Qi Liu
Conference on Neural Information Processing Systems (NeurIPS) 2023
ChatPathway: Conversational Large Language Models for Biology Pathway Detection
Yanjing Li, Hannan Xu, Haiteng Zhao, Hongyu Guo, Shengchao Liu
Conference on Neural Information Processing Systems (NeurIPS) 2023 AI for Science Workshop
Are More Layers Beneficial to Graph Transformers?
Haiteng Zhao, Shuming Ma, Dongdong Zhang, Zhi-Hong Deng, Furu Wei
International Conference on Learning Representations (ICLR) 2023
Retrieved Sequence Augmentation for Protein Representation Learning
Chang Ma, Haiteng Zhao, Lin Zheng, Jiayi Xin, Qintong Li, Lijun Wu, Zhihong Deng, Yang Lu, Qi Liu, Lingpeng Kong
Conference on Empirical Methods in Natural Language Processing (EMNLP) 2024
Certified Robustness Against Natural Language Attacks by Causal Intervention
Haiteng Zhao‡, Chang Ma‡, Xinshuai Dong‡, Anh Tuan Luu, Zhi-Hong Deng, Hanwang Zhang
International Conference on Machine Learning (ICML) 2022
Domain Adaptation via Mutual Information Maximization
Haiteng Zhao, Chang Ma, Qinyu Chen, Zhihong Deng
International Joint Conference on Artificial Intelligence (IJCAI) 2022 (Long presentation)
Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale
Intern-S1-Pro Team, Shanghai AI Laboratory
arXiv preprint
Intern-S1: A Scientific Multimodal Foundation Model
Intern-S1 Team, Shanghai AI Laboratory
arXiv preprint
ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflows
Qiushi Sun, Zhoumianze Liu, Chang Ma, Zichen Ding, Fangzhi Xu, Zhangyue Yin, Haiteng Zhao, Zhenyu Wu, Kanzhi Cheng, Zhaoyang Liu, Jianing Wang, Qintong Li, Xiangru Tang, Tianbao Xie, Xiachong Feng, Xiang Li, Ben Kao, Wenhai Wang, Biqing Qi, Lingpeng Kong, Zhiyong Wu
International Conference on Learning Representations (ICLR) 2026
BioMaze: Benchmarking and Enhancing Large Language Models for Biological Pathway Reasoning
Haiteng Zhao, Chang Ma, Fangzhi Xu, Lingpeng Kong, Zhi-Hong Deng
arXiv preprint
Instruction-Based Molecular Graph Generation with Unified Text-Graph Diffusion Model
Yuran Xiang, Haiteng Zhao, Chang Ma, Zhi-Hong Deng
arXiv preprint
GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot Learning
Haiteng Zhao, Shengchao Liu, Chang Ma, Hannan Xu, Jie Fu, Zhi-Hong Deng, Lingpeng Kong, Qi Liu
Conference on Neural Information Processing Systems (NeurIPS) 2023
ChatPathway: Conversational Large Language Models for Biology Pathway Detection
Yanjing Li, Hannan Xu, Haiteng Zhao, Hongyu Guo, Shengchao Liu
Conference on Neural Information Processing Systems (NeurIPS) 2023 AI for Science Workshop
Retrieved Sequence Augmentation for Protein Representation Learning
Chang Ma, Haiteng Zhao, Lin Zheng, Jiayi Xin, Qintong Li, Lijun Wu, Zhihong Deng, Yang Lu, Qi Liu, Lingpeng Kong
Conference on Empirical Methods in Natural Language Processing (EMNLP) 2024
AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification
Lingkai Kong, Zijian Wu, Yuzhe Gu, Haiteng Zhao, Wenyong Huang, Shuang Sun, Zhicheng Xiong, Xiaotian Zhang, Shuya Zhao, Yan Wang, Disheng Xu, Wenwei Zhang, Kai Chen
arxiv preprint
Achieving Olympia-Level Geometry Large Language Model Agent via Complexity Boosting Reinforcement Learning
Haiteng Zhao, Junhao Shen, Yiming Zhang, Songyang Gao, Kuikun Liu, Tianyou Ma, Fan Zheng, Dahua Lin, Wenwei Zhang, Kai Chen
International Conference on Learning Representations (ICLR) 2026
Long-horizon Reasoning Agent for Olympiad-Level Mathematical Problem Solving
Songyang Gao, Yuzhe Gu, Zijian Wu, Lingkai Kong, Wenwei Zhang, Zhongrui Cai, Fan Zheng, Tianyou Ma, Junhao Shen, Haiteng Zhao, Duanyang Zhang, Huilun Zhang, Kuikun Liu, Chengqi Lyu, Yanhui Duan, Chiyu Chen, Ningsheng Ma, Jianfei Gao, Han Lyu, Dahua Lin, Kai Chen
Conference on Language Modeling (COLM) 2026
Semi-off-Policy Reinforcement Learning for Vision-Language Slow-Thinking Reasoning
Junhao Shen, Haiteng Zhao, Yuzhe Gu, Songyang Gao, Kuikun Liu, Haian Huang, Jianfei Gao, Dahua Lin, Wenwei Zhang, Kai Chen
Advances in Neural Information Processing Systems (NeurIPS) 2025
MUR: Momentum Uncertainty guided Reasoning for Large Language Models
Hang Yan, Fangzhi Xu, Rongman Xu, Yifei Li, Jian Zhang, Haoran Luo, Xiaobao Wu, Luu Anh Tuan, Haiteng Zhao, Qika Lin, Jun Liu
The 64th Annual Meeting of the Association for Computational Linguistics (ACL) 2026
Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoning
Fangzhi Xu, Hang Yan, Chang Ma, Haiteng Zhao, Qiushi Sun, Kanzhi Cheng, Junxian He, Jun Liu, Zhiyong Wu
Annual Meeting of the Association for Computational Linguistics (ACL) 2025
φ-Decoding: Adaptive Foresight Sampling for Balanced Inference-Time Exploration and Exploitation
Fangzhi Xu, Hang Yan, Chang Ma, Haiteng Zhao, Jun Liu, Qika Lin, Zhiyong Wu
Annual Meeting of the Association for Computational Linguistics (ACL) 2025
Non-myopic Generation of Language Model for Reasoning and Planning
Chang Ma, Haiteng Zhao, Junlei Zhang, Junxian He, Lingpeng Kong
International Conference on Learning Representations (ICLR) 2025
Empowering Large Language Model Agents through Action Learning
Haiteng Zhao, Chang Ma, Guoyin Wang, Jing Su, Lingpeng Kong, Jingjing Xu, Zhi-Hong Deng, Hongxia Yang
Conference on Language Modeling (COLM) 2024
Scalable Visual Pretraining for Language Intelligence
Yiming Zhang, Zhonghan Zhao, Wenwei Zhang, Haiteng Zhao, Tianyang Lin, Yunhua Zhou, Demin Song, Kuikun Liu, Haochen Ye, Haian Huang, Yuzhe Gu, Haijun Lv, Qipeng Guo, Bin Liu, Gaoang Wang, Kai Chen
arxiv preprint
Exploring Visual Pretraining for Learning Language Intelligence
Zhonghan Zhao, Yiming Zhang, Wenwei Zhang, Haiteng Zhao, Xingguang Wei, Zhangwei Gao, Kuikun Liu, Yuzhe Gu, Size Wu, Haian Huang, Jianfei Gao, Haijun Lv, Demin Song, Yunhua Zhou, Qipeng Guo, Gaoang Wang, Kai Chen
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2026
Are More Layers Beneficial to Graph Transformers?
Haiteng Zhao, Shuming Ma, Dongdong Zhang, Zhi-Hong Deng, Furu Wei
International Conference on Learning Representations (ICLR) 2023
Certified Robustness Against Natural Language Attacks by Causal Intervention
Haiteng Zhao‡, Chang Ma‡, Xinshuai Dong‡, Anh Tuan Luu, Zhi-Hong Deng, Hanwang Zhang
International Conference on Machine Learning (ICML) 2022
Domain Adaptation via Mutual Information Maximization
Haiteng Zhao, Chang Ma, Qinyu Chen, Zhihong Deng
International Joint Conference on Artificial Intelligence (IJCAI) 2022 (Long presentation)
Vitæ
Full Resume in PDF.
-
Shanghai AI Lab July 2025 -Full-time Researcher
LLM Lab -
Shanghai AI Lab Oct 2024 - July 2025Research Intern
LLM Lab -
Tencent Mar 2024 - Oct 2024Research Intern
AI Lab NLP -
Bytedance Aug 2023 - Feb 2024Research Intern
Data-AML-US -
The University of Hong Kong Sep 2022 - July 2025Research Intern
HKU NLP -
Microsoft Research Asia Jan 2022 - Oct 2022Research Intern
Natural Language Computing (NLC) group -
Nanyang Technological University June 2021 - July 2025Collaborator
NAIL Group, NLP -
Peking University Sep 2020 - July 2025Ph.D. Student
CS, Machine Learning -
Peking University July 2018 - July 2020Research Assistant
Sigma Lab, Department of Machine Intelligence -
Peking University Sep 2016 - July 2020B.Sc. Student
Psychology