Purpose: Toshodaiji (Toshodaiji Temple) was founded by Ganjin (Jianzhen), who was skilled in Chinese medicine and pharmacology. Additionally, despite being blind, it is said that he was able to tell different drugs apart using his sense of smell, taste, and touch. Today, the Yakuen (medicinal herb garden) on the grounds of the temple has been restored and is partly open to the public. The aim of this study is to investigate the background of establishing the garden. Method: In addition to old books, other literature and reports, the author investigated the surviving texts at Toshodaiji Temple and conducted interviews with relevant persons. Results: The Yakuen at Toshodaiji Temple was established in 1988 as a passion project of the temple's 81st elder, Kyojun Morimoto. However, it was closed in 1999 for major repairs to the main hall, which was called as the major Heisei era repairs. This required the garden to be used as a holding area for the three Buddha statues normally housed in the temple. During this closure, part of the park was transplanted to Gifu Prefecture for safekeeping, where it remained there for many years. In 2018, a plan to restore the Yakuen was proposed at the request of the 88th elder, Myogen Nishiyama. In March 2022, the part of the Yakuen that had been transplanted to Gifu Prefecture was relocated back to Toshodaiji Temple. The Yakuen is scheduled to be fully restored by 2024, with work having already begun in April 2022. Conclusion: The Yakuen medicinal herb garden at Toshodaiji Temple had to be closed at one point due to temple maintenance work, but has been partially restored since 2022.