Project Performance Assessment

Overview

Project Performance Assessment

SACOG has launched the Project Performance Assessment tool to analyze transportation investments at the project level. The tool stems from a 2017 working group and its technical review of performance assessment methodologies. SACOG will use the Project Performance Assessment (PPA) tool in support of the 2018 agency funding round. Individual programs within the overarching 2018 funding round will use the PPA tool differently. Please see below for documentation and instructions of how each funding program will use the PPA tool in the 2018 round.

Regional Program

All project sponsors applying to the 2018 Regional Program are required to input their projects into the Project Performance Assessment data tool as a mandatory element of the Regional Program application. The sponsor will attach the completed PPA data output table as part of the completed application. Click here to access and run the online PPA data tool, used for all projects except transit vehicles. If your project is for transit vehicle maintenance or equipment, use the (forthcoming) Transit Asset Management data tool. The linked documentation further describes the various data indicators and data outputs used as part of the project performance assessment evaluation. PPA Documentation_Regional Program

Community Design

SACOG will run the Project Performance Assessment tool on all Community Design projects applying in the competitive categories. As the PPA analysis will be input and operated by SACOG staff, applicants will not be responsible or need to run the tool in their applications. SACOG is providing this service for Community Design as it is the first program to use the PPA tool.

For Community Design the tool will report a series of data indicators by Blueprint principle. The Community Design working group will use these data indicators, in tandem with the narrative and analysis provided by the project sponsor in the application itself, to consider the appropriateness of the proposed project in supporting the Blueprint principles, and the reasonableness of the projected performance outcomes. The Community Design Project Performance Assessment documentation describes the various indicators and data outputs used in this review. PPA Documentation_Community Design

Post

Meeting Summary – September 20, 2017

Project staff gave a brief presentation summarizing the working group, including charge, process and major activity at each meeting. Next, the working group discussed any final thoughts on the two methodologies covered in the process, and reviewed a synthesis of working group feedback. Finally, the working group discussed next steps, offering revisions to a list of working group takeaways.

Full Meeting Notes

Summary of PPA Working Group

Post

Meeting Summary – August 24, 2017

Project staff gave a brief update on progress on the Benefit Cost Analysis methodology since the last working group meeting. The remainder of the meeting focused on the Performance Outcomes methodology, where the working group walked through a demo of data layers, a presentation of the method’s spatial analysis, and an exploration of an evaluative framework using test project results. Finally, the working group received a demo of a draft mapping tool to support the Performance Outcomes proof of concept.

Full Meeting Notes

Presentation-Project Performance Assessment

Presentation-Sample Visualization

Post

Meeting Summary – July 20, 2017

Staff from DKS provided a memorandum and gave a summary presentation of the findings of Benefit Cost Analysis (BCA) approaches.  The memo presented an overview of BCA approaches that other MPOs/Agencies have across the country, and if they have performance measures not covered by SACOG’s process.  SACOG staff then presented a 4th round of BCA test project results and showed how a Performance Outcomes methodology would cover the same test projects. The working group provided feedback on the working tool, and discussed feasibility of new measures.

Full Meeting Notes

Post

Meeting Summary – June 21, 2017

Staff provided working group participants a recap of May’s modeling workshop that replaced the monthly working group meeting. Staff reviewed with the working group SACOG’s Travel Model as an underlying tool on different bundles of projects by project type. The working group delivered feedback to staff about the current scoring criteria.  Staff reviewed Performance Outcomes Analysis outcomes, factors and indicators.

Full Meeting Notes

Presentation-Benefit Cost Analysis Tool

Post

MEETING SUMMARY – April 26, 2017

Staff provided working group participants with a presentation on the methodology and metrics for the Benefit Cost Analysis. Staff from DKS gave a presentation on best practices and lessons learned from other regions performing project performance assessments.

Full Meeting Notes

Memorandum – Project Performance Assessment Current Practices Review

Presentation – Project Performance Assessment Case Studies

Presentation-BCA Overview

Post

Meeting Summary – March 21, 2017

SACOG staff welcomed working group participants and introduced staff from DKS associates that will be serving as an impartial technical resource to the working group.  Staff provided a quick summary of the previous meeting.  The working group then discussed the following agenda items:

  • Methodology: Performance Outcome Analysis
  • Introduction to seven outcomes of Performance Outcomes Analysis

Full Meeting Notes

Post

Meeting Summary – February 24, 2017

SACOG staff welcomed working group participants and provided an overview of the meeting goals and outcomes.  The workgroup discussed:

  • MTP/SCS and how performance assessment fits into the larger plan update.     
  • SACOG’s performance assessment work and initial performance evaluation methods at the project level specifically considering the Benefit-Cost Analysis as a potential new methodology.

Due to robust discussion, the Performance Outcomes Analysis agenda item will be discussed at the next meeting.