Background
In 2022, DLN acted on its commitment to developing a set of Key Performance Indicators (KPIs) for the centre’s activities, outputs, milestones and objectives. DLN's normative platform is built upon the framework for responsible research and innovation (RRI) established by the Research Council of Norway (RCN). This platform focuses on DLN's pivotal role as a 'lighthouse' for driving transformation in life science research throughout Norway.
KPI working group
To understand DLN's process and advancements towards this objective, as well as establish a framework for reporting and accountability, a KPI working group was formed in the spring of 2022. The working group consisted of the following members:
- Anders Braarud Hanssen (NTNU), DLN Senior adviser for RRI
- Randi Elisabeth Taxt (UiO), DLN Senior adviser for Innovation
- Elisabeth Gulbrandsen, Research Council of Norway (previously)
- Tom Pike (OsloMet), DLN board member industry representative
- Hanne Haslene-Hox (SINTEF), DLN project leader & Expert Task Force member
- Kjetill Sigurd Jakobsen (UiO), DLN project leader & Expert Task Force member
- Kam Sripada (NTNU), DLN Centre manager & Chair of KPI working group
Building on existing relevant material, the KPI working group initiated a fresh attempt to comprehensively understand the lessons and impact of DLN’s diverse initiatives and activities.
Why the term KPI?
The term KPI was chosen for this work as it is an established term. However, considering input from the DLN International Advisory Council, we recognize that these indicators also encompass related terms such as “performance directions,” "performance parameters,” and "experiences" and are also linked to "principles," "best practices" and “evaluative inquiry.”
Developing KPIs
According to DLN’s RRI framework, “The emphasis of impact evaluation is shifting from (end) product to process, and from verdicts/judgements to learning and improving" (Samfunnsansvarlig innovasjon – Et RRI-rammeverk). Therefore, DLN does not approach these KPIs as a pass/fail exam, but rather as an evaluative inquiry. Evaluative inquiry is an organizational learning model that combines social learning processes with systematic evaluation activities to foster individual, team, and organizational learning.
KPIs used within this context can be useful in terms of guiding activities, soliciting support for activities and promoting accountability, in particular towards RCN. In addition, they should be useful for centre constituents, practical to measure and aligned with the strategic goals of DLN. At the same time, they can draw attention to what DLN is funded to produce: culture change and transformative research in life science in Norway aligned with societal values. As the largest single recipient of biotechnology funding from RCN, DLN has a responsibility to function as a learning arena and deliver insights that can shape future initiatives.
Collecting and reporting KPIs
Over 2022, the KPI working group convened several times to identify and discuss the “tensions” at the heart of DLN’s mission and developed the following list:
I. Definitions of success
II. Outcomes
III. Who and where
IV. Collaboration
V. Culture change
VI. Open science
VII. Transdisciplinary
VIII. Climate sustainability
The working group developed a matrix tool for collecting and reporting KPIs to address the tensions outlined above. Beginning in 2023, members from each DLN competence area began to add information to the matrix tool on their reflections, experiences, anecdotes, success stories and other relevant data from their activities over the last year. Information from DLN projects is also being collected and used towards an understanding of KPIs in DLN.
This tool will be used to learn about DLN's performance towards transforming biotechnology in Norway and be referenced between major assessment activities, as a living document. The working group also began a summary document on conflicting values and considerations around KPIs anchored in DLN’s RRI framework and DLN aims to develop this further.
For more information, please contact:
Anders Braarud Hanssen
Senior adviser responsible research and innovation (RRI), employed at NTNU
Kam Sripada
Centre manager, employed at NTNU
kam.sripada@ntnu.no
+47 73 41 30 97