Why does assessment need to be developed?
Conduct of research and researchers' work have changed significantly in recent decades. Rather than exclusively consisting of writing research publications, the researcher's activities may also include teaching and supervision, research cooperation, promotion of open science, development of research infrastructures or societal interaction.
It has also been recognised that the quality of research or a researcher's competence cannot be reliably assessed using quantitative indicators alone, such as publication counts or citation figures. Research assessment is therefore being developed towards a more comprehensive approach that places qualitative assessment at its centre, with quantitative indicators used as supporting evidence. The aim is to better recognise the diversity of researcher's work, career paths, contributions and the impact of their research.
CoARA promotes responsible and diverse assessment
CoARA (Coalition for Advancing Research Assessment) is an international coalition that promotes the reform of research and researcher assessment. It supports the implementation of the Agreement on Reforming Research Assessment published in 2022, or the so-called CoARA Agreement, and brings together research organisations, research funders and other actors in the research community from around the world.
CoARA's goal is to strengthen assessment practices that identify the diversity of research contributions, careers in research and researchers’ competence. Assessment should be based primarily on qualitative assessment, with peer review at its core, supported by the responsible use of quantitative indicators where appropriate.
While CoARA defines common objectives for reforming assessment, each organisation decides how it will implement them in its specific operating environment. The solutions may, for example, vary depending on the organisation’s tasks, disciplines or national practices.
What does the CoARA Agreement contain?
The CoARA Agreement on Reforming Research Assessment comprises common principles and commitments on the basis of which organisations can develop their assessment practices.
The Agreement contains:
- common principles for reforming assessment,
- ten commitments on developing assessment practices; and
- a timeframe for implementing the reform.
The first four commitments are so-called core commitments that target assessment practices directly. They are complemented by six supporting commitments relating to such as implementing the reform, developing assessment processes and sharing experiences.
CoARA core commitments
The organisations committed to CoARA aim to:
- recognise the diversity of contributions to, and careers in, research,
- base research assessment primarily on qualitative evaluation for which peer review is central, supported by responsible use of quantitative indicators,
- abandon inappropriate uses in research assessment of journal- and publication-based metrics, in particular inappropriate uses of Journal Impact Factor (JIF) and h-index, and
- avoid the use of rankings of research organisations in research assessment.
The supporting commitments concern development of assessment practices, commitment of resources to assessment processes, guidance, communication, exchange of experiences and monitoring of reforms.
What does joining CoARA mean?
Signing the CoARA Agreement is a public commitment to developing research assessment in the organisation’s activities. While the Agreement is not legally binding, the signatory organisation commit to developing an action plan within one year of signing, outlining how it will seek to achieve the objectives of the Agreement. The organisation will also evaluate its progress after five years.
Organisations that have signed the Agreement may also become CoARA members. Membership enables their participation in CoARA's General Assemblies and international working groups and networks that develop assessment practices. Among others, the working groups produce recommendations, reports and practical tools to support the assessment reform. CoARA membership is free of charge, and the organisation may join it at any stage after signing the agreement. The members are organisations rather than individuals.
Finland’s national CoARA Chapter
CoARA National Chapter in Finland brings together Finnish research organisations and other research community actors to promote the development of research and researcher assessment. The Chapter operates as a national cooperation forum for sharing experiences, developing common practices and supporting the implementation of CoARA commitments in Finland. The goal of the CoARA National Chapter in Finland is to support the research community in achieving an assessment culture that emphasises qualitative assessment and recognises the diversity and impact of scientific work.
All Finnish universities and universities of applied sciences, some research institutes and other research community organisations are members of the National Chapter. Both organisations that have signed the CoARA Agreement and others interested in reforming research and researcher assessment can participate in the activities.
The CoARA Chapter in Finland is coordinated by the Federation of Finnish Learned Societies (TSV). TSV supports Finnish organisations in issues related to CoARA, coordinates national cooperation and serves as a link to the international CoARA community.