About

Hi, I’m Shi Qiu (仇是), a senior undergraduate student at the School of Physics, Peking University. I’m also an incoming Ph.D in Computer Science at UNC Chapel-Hill, advised by Prof. Huaxiu Yao.

My research focuses on AI Agents and AI4Physics, with a particular emphasis on self-evolving autoresearch systems for scientific discovery — agents that iteratively generate hypotheses, design and run experiments, and write papers with minimal human intervention. My work explores two complementary directions: (1) building robust, self-evolving agentic frameworks that automate the full research loop; and (2) leveraging domain-specific physics knowledge to ground agents in rigorous scientific reasoning.

My open-source work has collectively earned over 22,000 GitHub stars, and I am a core contributor to AutoResearchClaw, MetaClaw, and Agents.

I’ve also been collaborating with Prof. Dawn Song’s team at UC Berkeley, and with the AI4Physics research group led by Professors Hua Xing Zhu, Qing-Hong Cao, and Ming-Xing Luo at the School of Physics, Peking University. Also, I’m honored to be the only undergrad advisor of AlphaXiv.

News

Show earlier news
  • Sep 2025Honored to receive the National Scholarship award!
  • Sep 2025Our papers PHYBench, MJ-Video (Spotlight) and SuperGPQA were accepted by NeurIPS 2025! See you all in San Diego in December~
  • Sep 2025Our paper GLIMPSE was accepted as an Oral at EMNLP 2025 Main Conference!
  • May 2025We released PHYBench, the first large-scale reasoning benchmark within a physical context.
  • Feb 2025Our paper MJ-Video was released on arXiv.
  • Jan 2025Our paper MMIE was accepted by ICLR 2025 as an Oral presentation!
  • 2024Honored to receive the Excellence in Research Award for contributions in AI and intelligent systems.

Contact

Publications

PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Models

Shi Qiu, Shaoyang Guo, Zhuo-Yang Song, Yunbo Sun, Zeyu Cai, Jiashen Wei, Hua-Xing Zhu et al.

NeurIPS 2025 · Project

AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration

Jiaqi Liu, Shi Qiu, Mairui Li, Bingzhou Li, James Zou, Caiming Xiong, Huaxiu Yao et al.

arXiv preprint, 2026 · Code

ClawArena: Benchmarking AI Agents in Evolving Information Environments

Haonian Ji, Kaiwen Xiong, Siwei Han, Peng Xia, Shi Qiu, Yiyang Zhou, Jiaqi Liu, Bo Li, Zeyu Zheng, Cihang Xie, et al.

arXiv preprint, 2026

OmniMem: Autoresearch-Guided Discovery of Lifelong Multimodal Agent Memory

Jiaqi Liu, Zipeng Ling, Shi Qiu, Yanqing Liu, Siwei Han, Peng Xia, Haoqin Tu, Zeyu Zheng, Cihang Xie, Charles Fleming, Mingyu Ding, Huaxiu Yao

arXiv preprint, 2026

PRBench: End-to-End Paper Reproduction in Physics Research

Shi Qiu, Junyi Deng, Yiwei Deng, Haoran Dong, Jieyu Fu, Mao Li, Zeyu Li, Hua Xing Zhu et al.

arXiv preprint, 2026

MetaClaw: Just Talk — An Agent That Meta-Learns and Evolves in the Wild

Peng Xia, Jianwen Chen, Xinyu Yang, Haoqin Tu, Jiaqi Liu, Kaiwen Xiong, Siwei Han, Shi Qiu, Haonian Ji, Yuyin Zhou, Zeyu Zheng, Cihang Xie, Huaxiu Yao

arXiv preprint, 2026 · Code

An End-to-End Architecture for Collider Physics and Beyond

Shi Qiu, Zeyu Cai, Jiashen Wei, Zeyu Li, Yixuan Yin, Qing-Hong Cao, Chang Liu, Ming-xing Luo, Xing-Bo Yuan, Hua Xing Zhu

arXiv preprint, 2026 · Code

The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey

Jaewoo Kim, Xiangru Liu, Zhun Wang, Shi Qiu, Bo Li, Wenbo Guo, Dawn Song

arXiv preprint (survey), 2026

Show earlier publications

Iterated Agent for Symbolic Regression

Zhuo-Yang Song, Zeyu Cai, Shutao Zhang, Jiashen Wei, Jichen Pan, Shi Qiu, Qing-Hong Cao, Tie-Jiun Hou, Xiaohui Liu, Ming-xing Luo, Hua Xing Zhu

arXiv preprint, 2025

GLIMPSE: Do Large Vision-Language Models Truly Think With Videos or Just Glimpse at Them?

Yiyang Zhou*, Linjie Li*, Shi Qiu*, Zhengyuan Yang, Yuyang Zhao, Siwei Han, Yangfan He, Kangqi Li, Haonian Ji, Zihao Zhao, Haibo Tong, Lijuan Wang, Huaxiu Yao

EMNLP 2025 Main (Oral)

Minos: A Multimodal Evaluation Model for Bidirectional Generation Between Image and Text

Junzhe Zhang, Huixuan Zhang, Xinyu Hu, Li Lin, Mingqi Gao, Shi Qiu, Xiaojun Wan

arXiv preprint, 2025

From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Pedagogical Visualization

Haonian Ji, Shi Qiu, Siyang Xin, Siwei Han, Zhaorun Chen, Hongyi Wang, Dake Zhang, Huaxiu Yao

ICLR 2026

SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines

Xeron Du, Yifan Yao, Kaijing Ma, Bingli Wang, Tianyu Zheng, King Zhu, Minghao Liu, Yiming Liang, Xiaolong Jin, Zhenlin Wei, Shi Qiu, …, Jiaheng Liu, Ge Zhang

NeurIPS 2025

MJ-Video: Fine-Grained Benchmarking and Rewarding Video Preferences in Video Generation

Haibo Tong, Zhaoyang Wang, Zhaorun Chen, Haonian Ji, Shi Qiu, Siwei Han, Kexin Geng, Zhongkai Xue, Yiyang Zhou, Peng Xia, Mingyu Ding, Rafael Rafailov, Chelsea Finn, Huaxiu Yao

NeurIPS 2025 (Spotlight)

MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models

Peng Xia*, Siwei Han*, Shi Qiu*, Yiyang Zhou, Zhaoyang Wang, Wenhao Zheng, Zhaorun Chen, Chenhang Cui, Mingyu Ding, Linjie Li, Lijuan Wang, Huaxiu Yao

ICLR 2025 (Oral) · Project

Agents: An Open-source Framework for Autonomous Language Agents

Wangchunshu Zhou, Yuchen Eleanor Jiang, Long Li, Jialong Wu, Shi Qiu, et al.

ICLR 2024 Workshop on LLM Agents · Code

Honors and Awards

Education

Peking University — B.S. in Astronomy, School of Physics. Beijing, China, 2022 – Present. Overall GPA 3.64/4.0.

Research Experience

Sunblaze Group, UC Berkeley — Research Intern (2025 – present). Mentor: Prof. Dawn Song.

AI4Physics Group, Peking University — Research Intern (2025 – present). Mentors: Prof. Hua Xing Zhu, Prof. Qing-Hong Cao, and Prof. Ming-Xing Luo.

UNC-Chapel Hill — Research Intern (2024 – present). Mentor: Prof. Huaxiu Yao.

AIWaves — Research Intern (Jun – Aug 2023).

CUPT Team, Peking University (Mar – May 2023).

Projects

Skills

Beyond Research

Athletics. President of the Peking University Jump-Rope Team — National Online Jump Rope Competition: ranked #29; Beijing College League: 1st place (Men’s 30s Double Under), 2nd place (Mixed 1-on-1 30s Single Under, broke the event record), 3rd place (Consecutive Triple Under). Member of the Physics Dept. Badminton Team — 3rd place in the Beijing University Cup team competition.

Leadership & community. Class Monitor of Class 8, 22nd Undergraduate Cohort; key member of the Peking University Blockchain Association.

Literature & writing. A personal collection of essays lives in my Literature repository. Favorite authors: Richard Powers, Amor Towles, and Anthony Doerr.

Photography. Collaborated with Mengshu Yu and Dannni Luo on a series of self-made postcards — see the Postcards collection.

Games. Clash Royale — ladder rank #31 and tournament rank #46 on the Chinese server; reached #1 using Evo RG (video proof); 3rd place in the Clash Royale Chinese University League. Battle of Balls — ranked #7 on the Zhejiang Province ladder, July 2018.

Trains & fishing. A passionate train enthusiast, and I enjoy fishing in my leisure time.