The tool kits are produced by Context for Success, a research and practice
improvement project organized by HCM Strategists, LLC with support from the
Bill ...
Measuring Colleges’ Impact
WHAT CAN POLICYMAKERS DO WITH “INPUT-ADJUSTED” METRICS? A TOOLKIT This toolkit includes resources for policymakers, analysts and institutions that want to measure higher education’s performance but also want to fairly take into account the differences in student populations among institutions around the country. The metrics and standards used for such measurements are “input-adjusted”; that is, they build variation into the mix by attempting to distinguish which parts of institutions’ outputs are simply the result of having higher- or lower-performing incoming students, and which could be the result of institutional programs and practices. The research and policy papers produced for Context for Success address these issues in great detail—and reflect both consensus and debates within the higher education research community—but the toolkit components are intended to summarize some of the key issues in a more accessible format.
Matching the Question to the Answer Do you want to know how effective your institutions are, or how efficient they are? Improve your understanding of completion rates, or employment outcomes? This table provides suggestions to help policymakers implement research into input-adjusted metrics and understand the results.
Variables and their uses Commonly used and highly significant variables for input adjustments are provided here, with suggestions and warnings about each one.
Simple input-adjusted context tools One way to put outcomes in context is to show the difference between predicted and actual outcomes. Examples provided here, using a few simple institutional variables from IPEDS, show predicted graduation rates for community colleges and four-year schools based on values the user selects.
Resources The primary resources for further reading are the papers in the Context for Success series. The literature review by Bailey and Xu includes a comprehensive discussion of other research in the field. Other resources mentioned in this toolkit include: Higher Education Research Institute (bachelor’s degrees, freshmen at participating public and private four-year colleges) http://www.heri.ucla.edu/GradRateCalculator.php
The tool kits are produced by Context for Success, a research and practice improvement project organized by HCM Strategists, LLC with support from the Bill & Melinda Gates Foundation. These materials may not represent the opinions of all project participants. Readers are encouraged to consult the project website at: www.hcmstrategists.com/contextforsuccess.
1
Measuring Colleges’ Impact State of Florida (bachelor’s degrees, high school graduates attending public two- and four-year colleges in-state) http://www.cepri.state.fl.us/bacompletion/SixYear.cfm More Detail on State of Florida Graduation Prediction Calculations http://www.cepri.state.fl.us/ pdf/2002%20Cohort%20Report.pdf Ohio Board of Regents (graduation rates for four-year colleges grouped by average ACT scores) https://www.ohiohighered.org/files/uploads/data/statistical-profiles/student-progression/6-Year%20 Graduation%20Rates%20-%20Ohio%20PubPriv,%20Fall%2004.pdf Public Agenda, “With Their Whole Lives Ahead of Them” http://www.publicagenda.org/ theirwholelivesaheadofthem
The tool kits are produced by Context for Success, a research and practice improvement project organized by HCM Strategists, LLC with support from the Bill & Melinda Gates Foundation. These materials may not represent the opinions of all project participants. Readers are encouraged to consult the project website at: www.hcmstrategists.com/contextforsuccess.
