This paper takes the dress pattern diagram as the research object, adopts the machine vision recognition method, simulates the process of pattern maker interpreting the pattern diagram, quantifies the characteristics of the dress pattern diagram, constructs a set of automatic recognition systems of dress pattern diagram, and realizes the rapid recognition of dress pattern diagram and the output of intelligent board information. The system will solve the problem of upgrading the labor cost of the traditional clothing industry to a certain extent, improve the production efficiency of flexible manufacturing, reduce the production cost, and adapt to the innovation of the clothing industry under the environment of big network data.