Evaluating Your Programs

Measures and outcomes are part of an evaluation process. It is important to know and understand why you want to measure and what you intend to do with the results before you begin. Here you will find a description of CDC’s Framework for Program Evaluation, and possible sources of communication and health literacy measures.

CDC’s Framework for Program Evaluation

A strong evaluation approach ensures that the following questions will be addressed as part of the evaluation so that the value of program efforts can be determined and judgments about value can be made on the basis of evidence:

• What will be evaluated? (i.e., what is “the program” and in what context does it exist?)
• What aspects of the program will be considered when judging program performance?
• What standards (i.e., type or level of performance) must be reached for the program to be considered successful?
• What evidence will be used to indicate how the program has performed?
• What conclusions regarding program performance are justified by comparing the available evidence to the selected standards?
• How will the lessons learned from the inquiry be used to improve public health effectiveness?

Begin by identifying the communication and health literacy programs or activities in your organization and the context for these.

• Is communication a valued or undervalued area? Visible or invisible?
• Which programs and activities not explicitly labeled communication or health literacy include these elements?
• What do you already measure about communication?
• What types of systems do you have for collecting, analyzing, and reporting communication data?
• Who can reliably collect and report data for you?

Possible sources of communication and health literacy measures

1. Healthy People 2020
   1. Health literacy measures and data sources
2. National Action Plan to Improve Health Literacy
   1. Goals and strategies that can be translated into measures
3. National Standards on Culturally and Linguistically Appropriate Services
   1. Standards that can be translated into measures
4. Federal Plain Language Guidelines
5. Attributes of a health literate healthcare organization
   1. Organizational characteristics that can be translated into measures
   2. Example: Proportion of clinicians with patient contact trained to use the teach-back method; audited for their use of teach-back; and whose patients report use of teach-back
6. Core measures from National Academy of Medicine Roundtable on Value & Science-Driven Health Care
   1. Example: patient-centered measures about patient knowledge and understanding of care plan
   2. Example: coordination and communication measures about communication among healthcare team members, including the patient
7. Consumer Assessment of Healthcare Providers and Systems (CAHPS)
   1. Example: patient questions about their experience, including providers’ communication skills
   2. Example: specific health literacy provider module
8. The Joint Commission Accreditation Standards
   1. Example: 2010 Roadmap
9. Environmental assessments
   1. Example: partnering with community to walk your facilities and see it through their eyes
10. Individual organization’s satisfaction and experience surveys and qualitative assessments
11. CDC Clear Communication Index
12. Training evaluations