Research evaluations following the Strategy Evaluation Protocol

researchintelligence.ub@vu.nl

2 May 2024

What does Team RI do?

We demonstrate research impact by …

  • Collecting data on research
      for group, department, faculty
  • linking those data to indicators
      citations, media attention, impact on policy, SDGs
  • giving insight into impact to improve decision making.
      visualisations, interactive dashboards

How is this used?

  • Support for self-evaluation
  • Support for SEP
  • Possibilities for cooperation
  • Explore possibilities for appointments

Strategy Evaluation Protocol 2021-’27

…evaluate a research unit in light of its own aims and strategy…

…coherent narrative argument supported by factual evidence…

…leaves room for plurality with respect to the application and interpretation…

Strategy Evaluation Protocol 2021-’27

Main assessment criteria

Research Quality
Societal relevance

Viability

The unit addresses at least…

Open Science

PhD policy and training
Academic culture
Human resources policy

integral aspects of each of the main assessment criteria

Dora and Barcelona

DORA-compliant

No journal-based measures
Consider all research outputs
Be open and transparent

Open research information becomes the norm
Collaborate on the transition from closed to open research information

Indicators

Research quality Relevance for society
Products Products for peers Products for society
Use Use by peers Use by society
Recognition Recognition by peers Recognition from society
Research quality Relevance for society
Products Publications Relevance for theme (e.g. SDGs)
Use Citations Mentions in media, policy, guidelines
Recognition Top p% cited -

Enrichment

Research profile
Collaborations
Benchmark
% open access

Difficult

Software, data, preprint
Patents, startups
Media appearance
Authorship of policy

Data sources

Pure
Openalex (open source)
Altmetric

SEP Psychology (2023)