Draw textured yarn (DTY) packages is a significant raw material in manufacturing. Various defects will begenerated on surface during production and transportation, of which hairiness is the most common and intractable defect. Many methods have been applied for fabric surface defect detection, but little research is aimed at DTY packages hairinessdefects. In order to achieve the accuracy of DTY packages hairiness detection in industrial production, a method based onmulti-directional anisotropic Gaussian directional derivatives was proposed to accomplish the DTY packages hairiness defectdetection. Firstly, the original defect images were obtained by a device consisting of plane array light source, camera, andcomputer with image processing algorithm. Secondly, the gradient information of DTY packages images was constructed byanisotropic Gaussian directional derivative to characterize the defect. Then image response maps with all directions werefused to obtain the final response map. After that, a special difference of median (DOM) filter was proposed to removeuseless information. Finally, the segmentation result was obtained by threshold method and morphological processing. Compared with various classical methods, the proposed method obtained the best performance in our evaluation experimentsabout DTY packages hairiness detection.