In order to solve the sorting technology problem in food production caused by more kinds of food and the big differences, and based on the parallel robot and visual technology, operation scheme of the sorting system was designed. At the present, the sorting system of domestic and foreign technology of the design is not mature in the area of complex packaging and small volume of food. According to the functional requirements of high-speed robot vision system, the hardware system of different food location and classification is more accurate, and complete the software design of control system. Through the research on the system that it can meet the design requirements, and improve the sorting and packaging efficiency of small food effectively,as well as reducing labor intensity.