Critique a Program Evaluation Report
For this work, the evaluator will critique the evaluation report of the Disability Support Program (DSP) (KPMG, 2015). The evaluation was conducted by KPMG. The report has certain design elements that make it easy to find and understand its information. First, it has an easy to read and understand title. Second, the report is well-structured. The focus and rationale of the evaluation are clearly provided. The report seems to address the management and administration of the program and the higher education provider. This is seen in the stated considerations of the evaluation process.
The report communicates a sound design and its implementation. It starts by providing the purpose of the evaluation and stating the research questions (KPMG, 2015). Then, it explains its use of a mixed-methods approach in data collection for addressing the evaluation questions. It provides a detailed explanation of the methods used in data collection (Royse et al., 2016). Both qualitative and quantitative data were collected. Multiple data sources were used including a document and policy review, program data, and primary data sources such as students and higher education providers. A survey and individual telephone-based interviews were used to collect primary data. The sampling method is not clearly presented. But, the report states that participants were selected based on their location which can be classified as convenience sampling.
The report presents its findings clearly. They are presented in three sections, that is, the findings on the appropriateness of the program, its effectiveness, and findings on administration and operational efficiency of the program (KPMG, 2015). The report has lightly addressed the questions of the program’s cost-effectiveness. This is seen in the mention of the burden of the program on the funders. But, a comparison of the costs and outcomes of the program needed to be addressed (Wang et al., 2015). The interpretation of the findings and recommendations are supported with sufficient evidence and literature.
KPMG (2015). Evaluation of Disability Support Program: Final Report, 1-109.
Royse, D., Thyer, B. A., & Padgett, D. K. (2016). Program evaluation: An introduction to an evidence-based approach (6th ed.). Boston, MA: Cengage.
Wang, L.Y., Vernon-Smiley, M., Gapinski, M. A., Desisto, M., Maughan, E., & Sheetz, A. (2014). Cost-benefit study of school nursing services. JAMA Pediatrics, 7(168), 642– 648.