😉 About Me
I am an undergraduate student pursuing dual degrees in Information Engineering and Public Administration at Shandong University. My research interests lie in the intersection of Large Language Models (LLMs) and Software Engineering, particularly in code translation, automated program repair, and automated program understanding.
I have led multiple research projects in collaboration with Shandong University’s Research Center for Architecture and Embedded Systems and Shandong University’s Smart National Governance Laboratory, under the guidance of Dr. Zhen Yang and Prof. Liguo Fei. In the summer vacation of 2024, I also had the honor to go to Key Laboratory of High Confidence Software Technologies, Ministry of Education (Peking University) for scientific research internship, where my supervisors are Prof. Zhi Jin and Prof. Ge Li.
I have published in top-tier venues including IEEE Transactions on Software Engineering (TSE) (CCF-A) and International Symposium on Software Testing and Analysis (ISSTA) (CCF-A). My research has been recognized with prestigious awards, such as the Presidential Scholarship (Research Innovation)—Shandong University’s highest undergraduate honor.
🔥 I am actively looking for a Ph.D. position in AI for Software Engineering (AI4SE). 🔥
📖 Education
Shandong University (ARWU Top 101-150)
B.Eng in Information Engineering & B.A in Public Administration
Sept 2022 - Present
🔥 News
- 2025.03: 🎉🎉 One paper accepted at International Symposium on Software Testing and Analysis (ISSTA)!
- 2025.03: 🏆 Selected as Student of the Year (Academic and Research Category) at Shandong University — only 3 students (undergrad, master’s, Ph.D.) received this top academic honor university-wide!
- 2024.12: 🏆 Awarded Presidential Scholarship (Research Innovation), Shandong University’s highest undergraduate honor!
- 2024.10: 🏆 National Scholarship recipient from China’s Ministry of Education!
- 2024.10: 🎉🎉 One paper accepted at IEEE Transactions on Software Engineering (TSE)!
📝 Publications

Automated commit message generation with large language models: An empirical study and beyond
Pengyu Xue, Linhao Wu, Zhongxing Yu, Zhi Jin, Zhen Yang*, Xinyi Li, Zhenyu Yang, Yue Tan.
IEEE Transactions on Software Engineering (CCF-A Journal), 2024
[PDF] | [Code]
- Led first comprehensive evaluation of LLMs for commit message generation
- Developed ERICommitter framework achieving 49.32% robustness improvement
- Curated high-quality dataset through multi-step filtering (360+ person-hours)

Escalating LLM-based code translation benchmarking into the Class-level era
Pengyu Xue, Linhao Wu, Zhen Yang*, Chengyi Wang, Xiang Li, Yuxiang Zhang, Jia Li, Ruikai Jin, Yifei Pei, Zhaoyan Shen, Xiran Lyu, Jacky Wai Keung.
arXiv preprint arXiv:2411.06145, 2024 (Accepted at ISSTA 2025) [PDF]
- Built ClassEval-T benchmark covering Python/Java/C++
- Designed three novel translation strategies for real-world scenarios

Exploring and lifting the robustness of LLM-powered automated program repair with metamorphic testing
Pengyu Xue, Linhao Wu, Zhen Yang*, Zhongxing Yu, Zhi Jin, Ge Li, Yan Xiao, Shuo Liu, Xinyi Li, Hongyi Lin, and Jingwen Wu.
arXiv preprint arXiv:2410.07516, 2024 [PDF]
- Created MT-LAPR testing framework with 9 metamorphic relations
- Integrated CodeT5-based model improving code readability by 32%

A volunteer allocation optimization model for disaster response using improved Dempster–Shafer theory
Pengyu Xue, Liguo Fei, Weiping Ding
Expert Systems with Applications (CCF-C Journal, JCR Q1), 2024 [PDF]
- Propose effective methods for conflict evidence fusion based on differential evolution.
- Consider volunteers’ preferences, competencies and victims’ satisfaction in volunteer assignments.
- Use linguistic type-2 fuzzy sets and evidence theory to reduce uncertainty in decision-making.
IJDRR 2024
Identification of the critical factors in flood vulnerability assessment based on an improved DEMATEL method under uncertain environments, Pengyu Xue, Shuoqi Huang, Kaiwei Xie, Yuyue Sun, Liguo Fei, *International Journal of Disaster Risk Reduction (JCR Q1), 2024 [PDF]
🎖 Honors and Awards
-
Student of the Year (Academic and Research Category), Shandong University (2024)One of the highest individual honors at Shandong University, awarded for outstanding academic and research excellence.Only 3 students across the entire university (undergraduate, master’s, and Ph.D. levels) received this distinction in 2024, representing approximately 0.0045% of the student population.
-
Presidential Scholarship – Research Innovation Category, Shandong University (2024)
The highest honor awarded by Shandong University, recognizing outstanding research achievements.
Only 3 undergraduates received this award in the Research Innovation category in 2024, representing less than 0.01% of the student population. -
National Scholarship, Ministry of Education, China (2024)
Awarded to the top 0.2% of students nationwide for exceptional academic excellence. -
Peixin Excellence Scholarship, Shandong University (2024)
Recognizing top 0.8% of students, this award honors exceptional academic and extracurricular achievements. - National Second Prize, 19th “Challenge Cup” Academic Competition (2024)
- Honorable Mention, Interdisciplinary Contest in Modeling (ICM) (2024)
- Innovation and Entrepreneurship Advanced Individual, Shandong University (2023 & 2024)
- Research Innovation Excellence Award, Shandong University (2023 & 2024)
- First-Class Outstanding Student Award, Shandong University (2023 & 2024)
🏢 Internship Experience
-
Peking University – Key Laboratory of High-Confidence Software Technology
- Position: Research Assistant
- Project: Automated Commit Message Generation with Large Language Models
-
Shandong University – Research Center for Architecture and Embedded Systems
- Position: Research Assistant
- Project: Class-Level Code Translation Benchmark: ClassEval-T
-
Shandong University – Smart National Governance Laboratory
- Position: Research Assistant
- Project: AI-Driven Dynamic Decision-Making for Catastrophic Emergency Response
📊 Academic Activities
- Oral Presentation: China Information Fusion Conference 2023
- Poster Presentation: National Big Data & Social Computing Conference 2024
- Research Grants:
- ¥40,000 from SDU Graduate School (2024)
- ¥10,000 National Innovation Program (2024)