PHE 423 Final Project Guidelines and Rubric
Overview Your final project for this course is the creation of a mock program evaluation plan using the Centers for Disease Control and Prevention (CDC) Framework for Program Evaluation in Public Health. The mock evaluation plan will correspond to the CDC framework steps, including identifying stakeholders, describing the program that will be evaluated, selecting the evaluation design, suggesting credible evidence, and summarizing how these potential findings will be communicated.
Program evaluation in the public health field is a systematic investigation into the quality, value, or importance of a public health program. Evaluation methods provide the framework for public health practitioners to determine if a program is operating as expected or needs improvement, and to determine if the program has an impact on the short- and long-term health outcomes targeted. As a public health practitioner, you may be called upon to design a program evaluation and/or to review existing program evaluations to understand the strengths and weaknesses of a selected program.
For the final assessment in this course, you will have a chance to participate in the program evaluation process by creating a mock program evaluation plan. Your mock program evaluation plan will correspond to most of the CDC framework steps, including identifying stakeholders, describing the program that will be evaluated, selecting the evaluation design, suggesting credible evidence, and summarizing how these potential findings will be communicated. You may select one of the following public health programs below:
? GHWIC: Good Health and Wellness in Indian County (located under Healthy Tribes)
? HOP: High Obesity Program (located under Division of Nutrition, Physical Activity, and Obesity)
? REACH: Racial and Ethnic Applications to Community Health (located under Division of Nutrition, Physical Activity, and Obesity)
? SRCP: Sodium Reduction in Communities Program (located under Division of Heart Disease and Stroke Prevention)
? WISEWOMAN (located under Division of Heart Disease and Stroke Prevention) Ideally, the program you select to evaluate from the list above should be on a health topic in which you have an interest and see yourself using in the future, or one that has been used in a population on which you plan to focus. Visit the CDC website to learn more about each program. When visiting the site, click on the + under the section name provided in the list above to find a link to the program. Please Note: Although there are published evaluations of communities funded by the programs above (i.e. you will read one for REACH in one of your readings), these are to be used ONLY as a reference or guidance on how to complete your own mock evaluation rather than be submitted as original work, as this would reflect plagiarism. Once you have identified a program, you will need to narrow down what you are evaluating by identifying a specific community (population or city) where your chosen program is being implemented. Review the Community Examples list (located in Module One), which provides some options of actual cities/populations that you could use for your evaluation.
https://www.cdc.gov/chronicdisease/programs-impact/index.htm
This assessment addresses the following course outcomes:
? Develop evidence-based goals for evaluating public health programs that are designed to reach public health audiences
? Analyze specific communities through different social and behavioral lenses for informing program evaluations of public health programs
? Determine evaluation design components appropriate for evaluating the effectiveness of public health programs ? Develop valid and reliable measurement strategies to be used in evaluating public health programs in specific communities
The project is divided into two milestones, which will be submitted at various points throughout the course to scaffold learning and ensure quality final submissions. These milestones will be submitted in Modules Two and Four. The final mock program evaluation plan will be submitted in Module Seven.
Prompt Conduct research on the program you selected and create a plan for evaluating the success of the program. You should use at least four relevant sources to support your evaluation plan. Your evaluation plan must address the following critical elements:
I. Program Evaluation Background: In this section, you will distill the background research you conducted on the public health issue that was targeted by the program you selected.
A. Provide an overview of the issue targeted by the selected program, including the affected community, using current published literature. Be sure to support your response with any relevant programs, evaluations, campaigns, and/or studies that have addressed your selected issue.
B. Discuss what you are hoping to accomplish or determine by conducting an evaluation of the selected program and what audience(s) this evaluation would be most relevant for.
C. Develop goals for conducting your evaluation. Justify the appropriateness and relevance of your goals using current published literature. D. Analyze social theories, behavior models, health disparities, and social determinants of health for how they impact program evaluations for affected
communities. 1. Explain the social theories or health behavior models that apply to the selected program and affected community. Be sure to support your
explanation with specific examples from credible sources. 2. Describe how health disparities in the selected community will impact the conduct of this program evaluation. 3. Describe how social determinants of health within your selected community will impact the conduct of the program evaluation.
II. Program Evaluation Design: In this section, you will define and defend how you have focused your evaluation process, including what questions you intend
to answer in your investigation. A. Explain the type of evaluation you will use when evaluating the selected program, and justify why this type of evaluation will help you meet the
goals you have identified. B. Discuss the types of evaluation questions that can be addressed using your selected evaluation design. C. Defend how the evaluation type you have selected will ensure use of the findings and provide lessons learned that will continue to improve
programs targeting this issue.
III. Program Evaluation Methods: In this section, you will explain how you plan to collect the data you need to complete your evaluation of your chosen public health program.
A. Develop a measurement strategy for your program evaluation that defines the general methods and specific tools you will use to collect data. Consider: Will you use focus groups and/or surveys? What kinds of measurement tools are most appropriate for this evaluation?
B. Justify your measurement strategy in terms of validity. Be sure to address both the internal and external validity. C. Justify your measurement strategy using the concepts of reliability. Be sure to address both the internal consistency and stability of your
measurement strategy.
IV. Conclusion: Develop goals for communicating your findings to a variety of potential audiences. Consider: If you are communicating with a scientific audience, what information from your findings would you include? If you were meeting with community stakeholders, what would you prepare, and how would you communicate the information? Justify the appropriateness of your goals using current published literature.
Milestones Final Project Milestone One: The Program and Community Setting for the Evaluation In Module Two, you will summarize the program and community that you chose to focus on for your final project. You should describe the program in terms of the theoretical basis and evidence base for program effectiveness. Community needs will be described in terms of socio-demographic characteristics, the distribution of the health issue, and disparities and social determinants that impact risk and health outcomes. The purpose of this activity is to provide the program and community context for your final project. This submission will be graded with the Milestone One Rubric.
Final Project Milestone Two: Program Evaluation Design In Module Four, you will determine the most important evaluation questions and the evaluation design that you will use for your final program evaluation plan. The evaluation focus will depend on the program stage of development as well as what stakeholders want to learn about the program. The evaluation questions will be described in terms of the evaluation standards of utility, feasibility, propriety, and accuracy. The evaluation design will be described in terms of implementation, outcome, or mixed methods. The purpose of this milestone is to establish the priorities and methods that will be used to evaluate the program. This submission will be graded with the Milestone Two Rubric.
Final Project Submission: Program Evaluation Plan In Module Seven, you will submit your final mock program evaluation plan. It should correspond to the CDC framework steps, including identifying community stakeholders, describing the public health issue in the community and the program that will be evaluated, selecting the evaluation design, suggesting credible evidence that can be gathered, and summarizing how these potential findings will be communicated.
Note: The final program evaluation plan should include a revised introduction, along with a section on Program Evaluation Methods (Critical Element III) in which you will explain how you plan to collect the data needed to complete the evaluation of your chosen public health program (you prepared for this in the Module Five Short Essay task). In addition, the final program evaluation plan should include a conclusion (Critical Element IV) in which you develop goals for communicating your findings to a variety of potential audiences.
Be sure to incorporate all instructor feedback from your milestone assignments before you submit the final project. This submission will be graded with the Final Project Rubric (below).
Final Project Rubric Guidelines for Submission: Your program evaluation plan should be 810 pages (not including a cover sheet or reference page), use at least 4 current and relevant sources, 12-point Times New Roman font, double spacing, and must adhere to APA guidelines for formatting and for citing sources.
