Clinical decision support (CDS) is a process for enhancing health-related decisions and actions with pertinent, organized clinical knowledge and patient information that can significantly improve health outcomes and healthcare delivery. However, their impact on clinical outcomes has been inconsistent. Rigorous and continuous evaluation of CDS is necessary for improving CDS. A User and Task analysis was conducted to understand the stakeholder roles, their goals and tasks involved in the evaluation of CDS. This study describes a framework for evaluating CDS effectiveness for improving quality outcomes based on the analysis.