Abstract Studies have shown that Tai Chi and conventional exercise can modify the brain through distinct mechanisms, resulting in different brain adaptations. Therefore, it is conceivable to speculate that these two exercise modalities may have different effects on improving cognitive function. This study was a parallel group, assessor-blinded, pilot randomized controlled trial comparing the effects of Tai Chi and conventional exercise on improving cognitive function in older persons with mild cognitive impairment (MCI). A total of 34 adults aged ≥ 50 years with MCI were randomized (1:1:1) to the Tai Chi group (TC, n = 10, 3 sessions of 60-min Yang-style Tai Chi training per week for 24 weeks), conventional exercise group (EX: n = 12, 3 sessions of 60-min fitness training per week for 24 weeks), or control group (CON: n = 12, no intervention). Global cognitive function assessed by the Hong Kong version of the Montreal Cognitive Assessment (MoCA-HK) and performance in various cognitive domains were examined at baseline, and 12 and 24 weeks of the intervention. Both exercise groups showed improved global cognitive function as measured by MoCA-HK compared with the control group after 12 and 24 weeks of the intervention, (all P