The modular structure of irregular fragments reconstruction based on contour feature was introduced, and a new traversing algorithm for the sequence of fragments merging was presented. In the algorithm, the locating and merging of a fragment were determined by the current matching-fragment and another fragment, which ensured the process of fragments merging. An example was given and experiment results illustrate the algorithm efficient.