PBRF - Phase two evaluation
The government called for an evaluation strategy for the PBRF when the policy was first introduced.
This evaluation strategy features three distinct phases and operates for an approximate ten year period from mid 2004 to late 2014. This strategy was designed to begin after the first full quality evaluation round, and finish after the second full quality evaluation round (the 2006 quality evaluation being a partial round).
Phase two evaluation – Independent Strategic Review of the PBRF
Background
Phase two of the evaluation was an independent strategic review of the positive effects and unintended consequences of the PBRF on the sector. The review started on 11 February 2008.
The TEC commissioned an international expert, Dr Jonathan Adams of UK-based company Evidence Ltd, to conduct the independent strategic review.
Method
Dr. Adams’ work involved:
- an extensive series of individual interviews
- focus groups
- group interviews
- reading written submissions from interested parties
- reviewing a series of quantitative studies prepared by researchers at the TEC and Ministry of Education.
Findings
The report’s key finding is that the PBRF is effective:
- “the PBRF is already delivering important and appropriate outcomes of significant economic, social and cultural benefit”
- “the government’s objectives for the PBRF are being met on most counts”
Many of the issues raised in the report will be considered as part of the process of improving the PBRF in preparation for the 2012 Quality Evaluation round.
Quality Evaluation 2012
The next Quality Evaluation will be held in 2012. To prepare for this, the TEC is reconvening the Sector Reference Group (SRG), chaired by Professor John Hattie, which will consider a number of recommendations rising out of the 2006 Quality Evaluation. The findings arising out of the review will also inform the workings of the SRG as it prepares for the 2012 Quality Evaluation.
Resources for phase two evaluation
General resources
Evaluation of the UK assessment (PDF, 541 Kb) is a review of issues that have emerged from evaluation of the UK's Research Assessment Excercise (the RAE). The purpose of the review is to inform the New Zealand Performance Based Research Fund Evaluation.
A scan of research into questions of interest in phase two of the PBRF evaluation (PDF, 67 Kb)
Performance Based Research Fund (PBRF) Intervention Logic, Evaluation and Monitoring Framework Discussion Paper (PDF, 1.06 Mb)
Communication Programme for the Terms of Reference for the Independent Review of the PBRF (PDF, 30 Kb)
Terms of Reference for the Review of the PBRF (PDF, 54 Kb) confirmed by the Review Advisory Group.
More material supporting the second phase of the evaluation is also available from Education Counts.
Working papers
Baseline Trends in Research in the Tertiary Education Sector (PDF, 184 Kb)
Human Resource Trends in the Tertiary Academic Workforce (PDF, 413 Kb)
Staffing and Performance Trends in Research Subject Areas (PDF, 733 Kb)
Participation and Performance by Maori and Pacific Peoples Researchers (PDF, 469 Kb)
back to top