Journal of Computer Applications ›› 2026, Vol. 46 ›› Issue (5): 1568-1577.DOI: 10.11772/j.issn.1001-9081.2025050598

• Multimedia computing and computer simulation • Previous Articles    

Pansharpening based on two-stage collaborative optimization

Jiaxin DUAN, Jing HU, Wu WEN, Zhenxia YU(), Yongjun ZHANG   

  1. College of Computer Science,Chengdu University of Information Technology,Chengdu Sichuan 610225,China
  • Received:2025-06-04 Revised:2025-07-25 Accepted:2025-08-27 Online:2025-11-07 Published:2026-05-10
  • Contact: Zhenxia YU
  • About author:DUAN Jiaxin, born in 2000, M. S. candidate. His research interests include remote sensing image fusion.
    HU Jing, born in 1986, Ph. D., professor. Her research interests include image processing.
    WEN Wu, born in 1979, Ph. D., associate professor. His research interests include artificial intelligence, high-performance computing.
    ZHANG Yongjun, born in 2004. His research interests include graphics and image processing.
  • Supported by:
    National Natural Science Foundation of China(42375148)

基于两阶段协同优化的全色锐化

段佳欣, 胡靖, 文武, 余贞侠(), 张永俊   

  1. 成都信息工程大学 计算机学院,成都 610225
  • 通讯作者: 余贞侠
  • 作者简介:段佳欣(2000—),男,四川南充人,硕士研究生,CCF会员,主要研究方向:遥感图像融合
    胡靖(1986—),女,四川成都人,教授,博士,主要研究方向:图像处理
    文武(1979—),男,四川蓬溪人,副教授,博士,主要研究方向:人工智能、高性能计算
    张永俊(2004—),男,广西南宁人,主要研究方向:图形图像处理。
  • 基金资助:
    国家自然科学基金资助项目(42375148)

Abstract:

Although deep learning-based pansharpening methods for remote sensing images have made certain progress, most of them rely on supervised training with downsampled data, making them susceptible to scale bias and difficult to maintain stable performance at full resolution. In contrast, unsupervised methods optimize directly on full-resolution images, avoiding issues caused by downsampling, but generally exhibit weak robustness due to the lack of explicit supervisory signals. Therefore, a pansharpening Network based on Two-stage Collaborative Optimization (TCONet) was proposed. In the first stage, through supervised training on downsampled data, and combining an Improved Multi-Resolution Analysis (IMRA) method with an attention mechanism, spatial details and spectral preservation capability were improved. In the second stage, an Unsupervised Information Compensation Network (UCIN) was constructed to directly optimize on full-resolution images, thereby compensating for information loss caused by scale inconsistency. Experimental results on three satellite datasets: QuickBird(QB), WorldView-2 (WV-2), and WorldView-4 (WV-4) indicate that TCONet outperforms comparative methods in terms of both visual quality and evaluation metrics.

Key words: pansharpening, supervised learning, unsupervised learning, image fusion, remote sensing image processing

摘要:

尽管基于深度学习的遥感图像全色锐化方法取得了一定进展,但它们多数依赖降采样数据进行监督训练,易受到尺度偏差影响,难以在全分辨率条件下保持性能稳定;相比之下,无监督方法可直接在全分辨率图像上优化,规避了降采样引发的问题,但由于缺乏明确的监督信号,方法的鲁棒性普遍较弱。因此,提出一种两阶段协同优化的全色锐化网络(TCONet)。第一阶段通过在降采样数据上进行监督训练,结合改进的多分辨率分析(IMRA)方法与注意力机制,提升空间细节与光谱保持能力;第二阶段构建无监督信息补偿网络(UICN),直接在全分辨率图像上优化,弥补尺度不一致带来的信息缺失。在4波段数据集QuickBird(QB)、8波段数据集WorldView-2 (WV-2)和4波段数据集WorldView-4 (WV-4)共3个卫星数据集上的实验结果表明,TCONet的视觉效果与评价指标均优于对比方法。

关键词: 全色锐化, 监督学习, 无监督学习, 图像融合, 遥感图像处理

CLC Number: