We are developing a capsule ultrasound (CUS) device - a pill with the capability to scan the gastrointestinal (GI) tract through ultrasound. In this paper, we discuss the design and fabrication of the main components of the CUS device including the CMUT array, front-end electronics, and the wireless transmitter. We demonstrate a successfully fabricated 128-element CMUT array with polydimethylsiloxane (PDMS)-filled trenches and show their input impedance in air. The front-end electronics, measuring 6 mm by 6 mm and the high-data rate wireless transmitter, measuring 1 mm by 1.76 mm, have been fabricated. Our preliminary power analysis indicates that our total power consumption is less than 20 mW for the CUS device. Our future work involves integrating these core components for imaging experiments.