The recurrent carcinoma has been difficult to manage after surgery and radiotherapy, extensive resection of locally recurrent rectal cancer is associated with significant morbidity and mortality. Re-irradiation, even in combination with chemotherapy has shown very short survival. We assess the feasibility and efficacy of CT-guided interstitial permanent brachytherapy with I or Pd seeds for recurrent rectal cancer after multiple treatments. Fifteen patients with locally recurrent rectal carcinoma received I or Pd seed implants under CT guidance. The minimal peripheral dose of seed implants was 110-165 Gy (median 150 Gy). Two weeks after seed implantation, a 50 Gy of stereotactic radiotherapy was given to one patient; four patients received 2-4 cycles of chemotherapy. A median follow-up was 8 months (range 4-50 months). The duration of pain-free survival was 0-50 months (median 7 months). Local control was maintained for 3-50 months (median 7 months). The 1- and 2-year local controls were 16.2 and 8.1%, respectively. Eleven patients died: two (18.2%) of local recurrence, seven (63.6%) of local recurrence and metastases, and two (18.2%) of metastases. Four patients (26.7%) survived the median survival was 9 months. The 1- and 2-year actuarial overall survival rates were 42.9% and 10.7%, respectively. One patient (7.6%) experienced a grade 4 toxic event; there was no associated neuropathy. CT-guided radioactive seed implantation is feasible and safe as a salvage or palliative pain relief treatment for patients with recurrent rectal cancers after surgery and radiotherapy.