Journal of Computer Applications ›› 2026, Vol. 46 ›› Issue (10): 3288-3297.DOI: 10.11772/j.issn.1001-9081.2025091078
• Computer software technology • Previous Articles
Donghui LI1, Yingying LI2, Chunyan ZHANG1, Peng LIU3(
)
Received:2025-09-19
Revised:2025-11-10
Accepted:2025-11-12
Online:2025-12-18
Published:2026-10-10
Contact:
Peng LIU
About author:LI Donghui, born in 2001, M. S. candidate. His research interests include fuzzing, polyhedral compilation optimization, large language models.Supported by:通讯作者:
刘鹏
作者简介:李东辉(2001—),男,河南三门峡人,硕士研究生,CCF会员,主要研究方向:模糊测试、多面体编译优化、大语言模型基金资助:CLC Number:
Donghui LI, Yingying LI, Chunyan ZHANG, Peng LIU. Multi-strategy compiler fuzzing system based on large language models[J]. Journal of Computer Applications, 2026, 46(10): 3288-3297.
李东辉, 李颖颖, 张春艳, 刘鹏. 基于大语言模型的多策略编译器模糊测试系统[J]. 《计算机应用》唯一官方网站, 2026, 46(10): 3288-3297.
Add to citation manager EndNote|Ris|BibTeX
URL: https://www.joca.cn/EN/10.11772/j.issn.1001-9081.2025091078
测试 用例数 | 工具 | 测试用例 存储开销/MB | 代码覆盖 行数 | 函数 覆盖数 | 测试用例 总行数 |
|---|---|---|---|---|---|
| 100 | Csmith | 11.400 | 98 805 | 12 552 | 139 476 |
| YARPGen | 2.600 | 74 290 | 10 112 | 41 281 | |
| DHFUZZ | 0.352 | 91 615 | 12 176 | 3 648 | |
| 1 000 | Csmith | 104.000 | 101 091 | 12 632 | 1 387 900 |
| YARPGen | 27.000 | 74 306 | 10 112 | 478 226 | |
| DHFUZZ | 3.800 | 101 291 | 12 671 | 37 672 | |
| 10 000 | Csmith | 1 014.700 | 103 413 | 12 763 | 13 826 527 |
| YARPGen | 286.090 | 74 332 | 10 784 | 4 898 184 | |
| DHFUZZ | 40.500 | 115 936 | 14 144 | 360 883 |
Tab. 1 Experimental results for generating 100, 1 000, 10 000 test cases
测试 用例数 | 工具 | 测试用例 存储开销/MB | 代码覆盖 行数 | 函数 覆盖数 | 测试用例 总行数 |
|---|---|---|---|---|---|
| 100 | Csmith | 11.400 | 98 805 | 12 552 | 139 476 |
| YARPGen | 2.600 | 74 290 | 10 112 | 41 281 | |
| DHFUZZ | 0.352 | 91 615 | 12 176 | 3 648 | |
| 1 000 | Csmith | 104.000 | 101 091 | 12 632 | 1 387 900 |
| YARPGen | 27.000 | 74 306 | 10 112 | 478 226 | |
| DHFUZZ | 3.800 | 101 291 | 12 671 | 37 672 | |
| 10 000 | Csmith | 1 014.700 | 103 413 | 12 763 | 13 826 527 |
| YARPGen | 286.090 | 74 332 | 10 784 | 4 898 184 | |
| DHFUZZ | 40.500 | 115 936 | 14 144 | 360 883 |
| 工具 | 核心相似度 | 分布特征 | 优势 | ||||||
|---|---|---|---|---|---|---|---|---|---|
词法 相似度 | 结构 相似度 | 功能 相似度 | 度量 相似度 | 综合 相似度 | 高相似度 (>0.9) | 中等相似度 (0.7~0.9) | 低相似度 (<0.7) | ||
| DHFUZZ | 0.231 | 0.429 | 0.465 | 0.764 | 0.390 5 | 0.003 6 | 0.115 0 | 0.881 4 | 综合多样性全面领先 |
| YARPGen | 0.294 | 0.658 | 0.687 | 0.715 | 0.523 9 | 0.001 2 | 0.138 0 | 0.849 7 | 度量控制能力最佳 |
| Csmith | 0.266 | 1.000 | 0.577 | 1.000 | 0.621 8 | 0.002 0 | 0.394 0 | 0.604 0 | 高相似度规避性强 |
Tab. 2 Diversity comparison of program generation tools
| 工具 | 核心相似度 | 分布特征 | 优势 | ||||||
|---|---|---|---|---|---|---|---|---|---|
词法 相似度 | 结构 相似度 | 功能 相似度 | 度量 相似度 | 综合 相似度 | 高相似度 (>0.9) | 中等相似度 (0.7~0.9) | 低相似度 (<0.7) | ||
| DHFUZZ | 0.231 | 0.429 | 0.465 | 0.764 | 0.390 5 | 0.003 6 | 0.115 0 | 0.881 4 | 综合多样性全面领先 |
| YARPGen | 0.294 | 0.658 | 0.687 | 0.715 | 0.523 9 | 0.001 2 | 0.138 0 | 0.849 7 | 度量控制能力最佳 |
| Csmith | 0.266 | 1.000 | 0.577 | 1.000 | 0.621 8 | 0.002 0 | 0.394 0 | 0.604 0 | 高相似度规避性强 |
| 实验组 | 行覆盖数 | 行覆盖 下降率/% | 函数 覆盖数 | 函数覆盖 下降率/% |
|---|---|---|---|---|
| DHFUZZ(完整) | 185 621 | — | 23 445 | — |
| 组1(无LLM策略) | 102 334 | 44.9 | 12 110 | 48.3 |
| 组2(无自适应) | 170 231 | 8.3 | 20 111 | 14.2 |
| 组3(无验证) | 124 238 | 33.1 | 13 265 | 43.4 |
| 组4(无变异) | 162 345 | 12.5 | 15 783 | 32.7 |
Tab. 3 Ablation experimental results
| 实验组 | 行覆盖数 | 行覆盖 下降率/% | 函数 覆盖数 | 函数覆盖 下降率/% |
|---|---|---|---|---|
| DHFUZZ(完整) | 185 621 | — | 23 445 | — |
| 组1(无LLM策略) | 102 334 | 44.9 | 12 110 | 48.3 |
| 组2(无自适应) | 170 231 | 8.3 | 20 111 | 14.2 |
| 组3(无验证) | 124 238 | 33.1 | 13 265 | 43.4 |
| 组4(无变异) | 162 345 | 12.5 | 15 783 | 32.7 |
| [1] | Zhang X, Zhang C, Li X, et al. A survey of protocol fuzzing[J]. ACM Computing Surveys, 2025, 57(2): No.35. |
| [2] | Zhong R. Advanced fuzzing method for software security[D/OL]. (2023) [2025-08-11].. |
| [3] | Wu F, Luo Z, Zhao Y, et al. Logos: log guided fuzzing for protocol implementations[C]// ISSTA 2024. New York: ACM, 2024: 1720-1732. |
| [4] | Chen Y, Chen L, Lun A T L, et al. edgeR v4: powerful differential analysis of sequencing data with expanded functionality and improved support for small counts and larger datasets[J]. Nucleic Acids Research, 2025, 53(2): No.gkaf018. |
| [5] | 王琴应,许嘉诚,李宇薇,等.智能模糊测试综述:问题探索和方法分类[J].计算机学报,2024,47(9):2059-2083. |
| Wang Qinying, Xu Jiacheng, Li Yuwei, et al. A survey on smart fuzzing: problem exploration and method classification[J]. Chinese Journal of Computers, 2024, 47(9): 2059-2083. | |
| [6] | Nama P. Integrating AI in testing automation: enhancing test coverage and predictive analysis for improved software quality[J]. World Journal of Advanced Engineering Technology and Sciences, 2024, 13(1): 769-782. |
| [7] | 任泽众,郑晗,张嘉元,等.模糊测试技术综述[J].计算机研究与发展,2021,58(5):944-963. |
| Ren Zezhong, Zheng Han, Zhang Jiayuan, et al. A survey of fuzzing technology[J]. Journal of Computer Research and Development, 2021, 58(5): 944-963. | |
| [8] | Sîrbu A G, Czibula G. Automatic code generation based on abstract syntax-based encoding. application on malware detection code generation based on MITRE ATT&CK techniques[J]. Expert Systems with Applications, 2025, 264: No.125821. |
| [9] | Asveld P R J. Fuzzy context-free languages — Part 1: generalized fuzzy context-free grammars[J]. Theoretical Computer Science, 2005, 347(1/2): 167-190. |
| [10] | Zhang Z, Ao T, Zhang Y, et al. Semantic gesticulator: semantics-aware co-speech gesture synthesis[J]. ACM Transactions on Graphics, 2024, 43(4): No.136. |
| [11] | Yang X, Chen Y, Eide E, et al. Finding and understanding bugs in C compilers[C]// PLDI 2011. New York: ACM, 2011: 283-294. |
| [12] | Joshi H, Cambronero Sanchez J, Gulwani S, et al. Repair is nearly generation: multilingual program repair with LLMs[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 2023, 37(4): 5131-5140. |
| [13] | Zalewski M. Technical “whitepaper” for AFL-fuzz[R/OL]. [2025-08-11].. |
| [14] | LLVM Compiler Infrastructure. libFuzzer — a library for coverage-guided fuzz testing[EB/OL]. [2025-09-18].. |
| [15] | 欧先飞,蒋炎岩,许畅.语义可感知的灰盒编译器模糊测试[J].软件学报,2025,36(7):2947-2963. |
| Ou Xianfei, Jiang Yanyan, Xu Chang. Semantics-aware greybox compiler fuzzing[J]. Journal of Software, 2025, 36(7): 2947-2963. | |
| [16] | Englhardt Z, Li R, Nissanka D, et al. Exploring and characterizing large language models for embedded system development and debugging[C]// CHI EA 2024. New York: ACM, 2024: No.150. |
| [17] | Shou C, Liu J, Lu D, et al. LLM4Fuzz: guided fuzzing of smart contracts with large language models[PP/OL]. arXiv (2024-01-20) [2025-10-05].. |
| [18] | Sahoo P, Singh A K, Saha S, et al. A systematic survey of prompt engineering in large language models: techniques and applications[PP/OL]. V2. arXiv (2025-03-16) [2025-10-01].. |
| [19] | 谢肖飞,李晓红,陈翔,等.基于符号执行与模糊测试的混合测试方法[J].软件学报,2019,30(10):3071-3089. |
| Xie Xiaofei, Li Xiaohong, Chen Xiang, et al. Hybrid testing method based on symbolic execution and fuzzing[J]. Journal of Software, 2019, 30(10): 3071-3089. | |
| [20] | Livinskii V, Babokin D, Regehr J. Random testing for C and C++ compilers with YARPGen[J]. Proceedings of the ACM on Programming Languages, 2020, 4(OOPSLA): No.196. |
| [21] | Even-Mendoza K, Sharma A, Donaldson A F, et al. GrayC: greybox fuzzing of compilers and analysers for C[C]// ISSTA 2023. New York: ACM, 2023: 1219-1231. |
| [22] | Böhme M, Szekeres L, Metzman J. On the reliability of coverage-based fuzzer benchmarking[C]// ICSE 2022. New York: ACM, 2022: 1621-1633. |
| [23] | Klees G, Ruef A, Cooper B, et al. Evaluating fuzz testing[C]// CCS 2018. New York: ACM, 2018: 2123-2138. |
| [1] | Mengjiao YU, Min JIN, Xinhua LIU. Agile enhancement development framework driven by human-multi-agent collaboration [J]. Journal of Computer Applications, 2026, 46(9): 2938-2947. |
| [2] | Yun BIAN, Haiquan WANG, Yi CHEN, Zhe CUI. Construction method of software defect prediction dataset with explainability [J]. Journal of Computer Applications, 2026, 46(9): 2948-2958. |
| [3] | Zhenhui GONG, Xiaoyu SHI, Yun LU, Yangcheng LIU, Mingsheng SHANG. Fair recommendation framework for large language models with sensitive attribute absence [J]. Journal of Computer Applications, 2026, 46(9): 2838-2846. |
| [4] | Yaoran HUO, Huizhi LI, Dahe ZENG, Zhenyu TANG, Chenmei LIU, Yan WU, Xiao ZHANG, Siqin CHEN, Houhui YANG. Contract review framework based on dynamic rule generation and neuro-symbolic reasoning using large language models [J]. Journal of Computer Applications, 2026, 46(9): 2820-2826. |
| [5] | Mengting WANG, Shuanliang GAO, Wenrui LIAO, Geng LI, Jiaxing ZHANG, Yuanfang ZHU, Tiange ZHAO, Yonghui LIU, Hongru LIANG. Message consistency parsing framework for aviation domain [J]. Journal of Computer Applications, 2026, 46(8): 2681-2690. |
| [6] | Yue ZHANG, Yuhan GUO. Ride-hailing spatio-temporal demand forecasting method via large language model-driven semantic quantification [J]. Journal of Computer Applications, 2026, 46(8): 2467-2476. |
| [7] | Xinliang LIU, Yushi XU, Dubai LI, Yanzhao REN. Survey of knowledge graph-based question answering methods [J]. Journal of Computer Applications, 2026, 46(8): 2394-2410. |
| [8] | Linkai ZHU, Lu YANG, Hongjie ZHANG, Zijin WU, Lu LIU. Smart contract generation framework driven by LLM and SWRL for cross-border data compliance across heterogeneous blockchains [J]. Journal of Computer Applications, 2026, 46(7): 2074-2084. |
| [9] | Yadian CHENG, Yingying LI, Ping ZHANG, Fangbing QIU, Xiaonan CHAI, Yuqiao SHU. Dual-role interaction mechanism-based large language model for psychological health [J]. Journal of Computer Applications, 2026, 46(7): 2054-2063. |
| [10] | Jiahang LI, Qilong HAN, Lijie LI, Hui ZHANG. Large language model-driven method for qualifier enhancement in hyper-relational knowledge graphs [J]. Journal of Computer Applications, 2026, 46(7): 2043-2053. |
| [11] | Didi HOU, Shaodong HONG, Yujie FU, Yunhe CUI, Guowei SHEN. Cybersecurity named entity recognition method based on large language model linking [J]. Journal of Computer Applications, 2026, 46(7): 2064-2073. |
| [12] | Yuqi WANG, Yangsen ZHANG, Pu WANG. High school English reading comprehension model integrating knowledge augmentation and contrastive learning [J]. Journal of Computer Applications, 2026, 46(7): 2096-2103. |
| [13] | Longyu XIONG, Shengdong DU, Haochen SHI, Jie HU, Yan YANG, Tianrui LI. Government affairs hotline question answering system based on knowledge-enhanced large language model architecture [J]. Journal of Computer Applications, 2026, 46(6): 1721-1727. |
| [14] | Jintao WANG, Zhilin GAO, Qixiang MENG, Fanliang BU. Legal case retrieval method via case information reformulation using large language model [J]. Journal of Computer Applications, 2026, 46(6): 1785-1792. |
| [15] | Yusheng YI, Zhaohao HUANG, Zihao DENG, Leilei KONG, Haoliang QI. CORER: collaborative multi-knowledge large language model prompt framework for IT application innovation database migration [J]. Journal of Computer Applications, 2026, 46(6): 1811-1817. |
| Viewed | ||||||
|
Full text |
|
|||||
|
Abstract |
|
|||||