Helping universities recognise and assess non-traditional research outputs
We run NTO workshops that help universities develop the confidence and skills needed to assess not-traditionally submitted outputs (NTOs), such as software, datasets, exhibitions, performances and much more. Upcoming and past workshops are listed below.
What will you learn?
Through presentations, discussion and practical assessment exercises, participants will:
Explore the value of NTOs and why they are underrepresented in REF submissions.
Gain experience ass essing NTOs against the REF criteria of originality, significance and rigour.
Identify barriers to submitting NTOs and discuss practical ways to overcome them.
Consider how their institution could improve its approach to recognising and assessing a wider range of research outputs.
The workshops are interactive and provide opportunities to learn from colleagues across different disciplines and professional roles.
Bring an NTO workshop to your institution
Upcoming workshops
Durham University - 5 November 2026
University of Lancashire - 12 November 2026
Photo: The National Churches Trust - CC-BY 2.0
University of Oxford - 23 November 2026
Photo: Peter Trimming CC-BY-SA 2.0
University of Bath - 26 November 2026
Photo: Si Chun LAM CC-BY-SA 3.0
Why we need NTO workshops
The REF supports 21 categories of research outputs that range from data to musical compositions, but within HEIs publications are viewed as the predominant, and potentially the only, metric of research success. Over the last two REF exercises, a little over 97% of all submitted outputs were either journal publications or books. This is a problem for the sector because if we do not recognise everything and everyone vital to research, we limit our ability to conduct research.
The REF is a key driver for culture change within HEIs. It provides the community with an opportunity to change the way we think about who and what is important to research. The Hidden REF is working with Research England and the REF team to ensure that REF 2029 represents all of the work and people that are vital to research. Once identified, these changes can be supported in the long term by embedding them in local HEI policy. Ultimately, this will make research more equitable and more effective.
Typical NTO workshop agenda
- 0930 Arrive and refreshments
- 1000 An introduction from the university
- 1010 Talk on making research more equitable and more effective
- 1020 Exercise 1: which NTOs are vital to your research?
- 1030 Introduction to NTO assessment
- 1050 Break
- 1110 Exercise 2: NTO assessment practical
- 1210 Break and refreshments
- 1230 Feedback from assessment
- 1300 Close and wrap up