HSIP Project Evaluation

University Conducting HSIP Project Evaluations Using Empirical Bayes – Wisconsin

Wisconsin DOT contracted with the University of Wisconsin Traffic Operations and Safety (TOPS) Laboratory to investigate multiple project evaluation methods through a research grant for HSIP evaluation support. Initial research efforts included project evaluations based on before and after collision maps using the software Intersection Magic and before-after evaluations using benefit-cost analysis. From the beginning of the research, the intent was to use Empirical Bayes (EB) analysis in the project evaluations, but Wisconsin did not have safety performance functions (SPFs), which are required for the EB method. However, once the State acquired the SafetyAnalyst software, the TOPS Laboratory was able to incorporate the EB method into the project evaluations by using the SPFs contained in SafetyAnalyst. The SPFs in SafetyAnalyst were developed using national data and are intended to be calibrated to local conditions. While it was not possible to calibrate the SPFs to Wisconsin conditions due to lack of data, the TOPS Laboratory uses the SPFs to provide a comparison of performance in Wisconsin to that of the nation.

The TOPS Laboratory developed a process to extract the appropriate crashes (by location, type, and year) from the Wisconsin crash database based on the project location and scheduled start and completion dates for evaluation purposes. HSIP projects are evaluated based on five years of before data and three years of after data. Fatal and injury crashes are the focus of the evaluation, but the analysis also considers target crash types based on the nature of the improvement.

The TOPS Laboratory conducts a benefit-cost analysis based on results of both a simple before-after evaluation and an EB analysis to evaluate the projects from an economic perspective. This provides a simple comparison of the results of the two evaluation methods (In the table shown, “S. No.” refers to the site number for the project evaluated, and the “FOS (financial operating system) ID” is used by Wisconsin DOT as the specific project identifier.) and demonstrates how a simple before-after evaluation can overestimate the safety benefits.

Key Accomplishments

• Developed a project evaluation process incorporating Empirical Bayes analysis into all HSIP project evaluations.
• Demonstrated the importance of using statistical evaluations to reduce the overestimation of safety benefits due to regression-to-the-mean bias.