Spectral clustering minimizing normalized cut criterion has a high computational complexity and an inaccurate result in color image segmentation. In order to overcome these disadvantages, the paper firstly used Fuzzy C-Means (FCM) to deal with three channels of color image, obtained pre-segmentation image from these channels cluster results to construct undirected weighted graph; and then minimized normalized cut criterion using discrete particle swarm optimization algorithm instead of spectral clustering; finally, pre-segmentation result was obtained by the optimal particle. The experimental results show that the method is less time-consuming, and obtains a precise segmentation result in color image segmentation.