The existing algorithms of Top-k query can not make full use of the powerful parallel throughput of Graphic Processing Unit (GPU) to timely return the query results. So, a segmented query algorithm based on Compute Unified Device Architecture (CUDA) model was proposed. By dividing the query process and using the strategy of segmented parallel process, the maximal calculation and comparison efficiency in query process could be obtained in this algorithm. The experimental results show that this algorithm has obvious performance advantages compared with four-thread parallel optimization algorithm on multi-core CPU. When the number of ordered lists is 6 and the traversal stride is 120, the optimal performance can be obtained which is 40 times faster than multi-core CPU algorithm.