关键词: 中文分词, n元模型, 上下文信息

Abstract: Chinese segmentation is a special and important issue in Chinese texts processing.The traditional segmentation methods based on an existing dictionary have an obvious defect when they are used to segment texts which may contain words unknown to the dictionary.And the probabilistic methods those consider the probabilistic model of the training set only also do a bad job on the texts of a specific domain.In this paper,a probabilistic segmentation method based on extracting context information was proposed,which adds the context information of the segmenting text into the segmentation probabilistic model so as to guide the processing.The method combining n-gram model and EM algorithm achieves a good effect in the close and opening test.

Key words: Chinese segmentation, n-gram model, context information