Hyperparathyroidism (HPT) is an endocrine disorder characterized by the excessive synthesis and secretion of parathyroid hormone. The excessive parathyroid hormone can cause bone calcium loss, vascular calcification, and cardiovascular diseases. Because of the multiple and reversible distribution of HPT, the accurate localization of the lesion during clinical diagnoses is challenging, often resulting in misdiagnoses or missed diagnoses. The computer-aided diagnosis (CAD) can improve the diagnostic accuracy. The joint utilization of the Squeeze-and-Excitation (SE) attention module and deformable transformer networks can achieve excellent detection performance for HPT. By improving the weight mapping approach within the SE module, we effectively enhanced the joint network’s detection performance for HPT.