Welcome to our redesigned website! Let us know how the new site is working for you. The survey takes just a few minutes to complete. Take the survey.

Publication Forum checklist for identifying problematic practices in scientific journals

The checklist helps expert panels identify problems related to the editorial and peer review practices of scientific journals. It contains 19 practices that may raise concerns about the rigour and reliability of a publication channel's scientific quality assessment. The checklist is used to support the assessment of whether the criteria for Publication Forum Level 1 are met.

Invitations

  1. Researchers repeatedly receive spam emails inviting them to serve as authors, reviewers or editors.
  2. Researchers are invited to contribute to journals or special/thematic issues outside their areas of expertise.
  3. Prominent researchers are encouraged to serve as authors, reviewers or editors by offering discounts on or waivers of publication fees.

Editorial process

  1. Reviewer selection and/or publication decisions are automated without active decision-making by an editor.
  2. Editors have limited opportunities or face obstacles in influencing which reviewers are invited and which manuscripts are published.
  3. Editors are pressured or incentivised to increase the number of articles processed and/or accepted.
  4. Researchers are required to complete revisions, reviews or editorial work within unreasonably short deadlines.

Peer review

  1. Researchers frequently receive low-quality or superficial peer review reports.
  2. Reviews are provided by researchers who lack expertise in the specific field of the research being evaluated.
  3. Reviewers who request revisions to a manuscript are not given the opportunity to verify that the revisions have been adequately addressed before publication.
  4. Reviewers or editors who recommend rejection are removed from the process or replaced by someone else.

Publication decisions

  1. The journal regularly publishes articles that reviewers have recommended for rejection (in the same journal or another journal).
  2. The editorial or peer review process for special/thematic issues is often managed by a guest editor rather than the journal's regular editorial team.
  3. The journal publishes a large number of articles authored by its editors or editorial board members.
  4. The journal's publication volume increases exceptionally rapidly over a short period.

Published research

  1. The journal publishes research outside its stated scope, or its scope is vaguely defined.
  2. Articles published in the journal contain an unusually high number of citations to the journal itself or to the authors' own publications.
  3. Editors or reviewers regularly request the addition of citations to published articles without scientific justification.
  4. Published research is repeatedly of poor quality or contains research misconduct, questionable research practices or inappropriately AI-generated content.

Background of the checklist

This checklist was developed by the Publication Forum to help its field-specific expert panels assess whether a publication channel meets the criteria for JUFO Level 1. The checklist contains 19 practices that may indicate problems or raise concerns about the rigour and reliability of a journal's editorial and peer review practices.

The checklist is not intended to identify so-called predatory or questionable journals. Instead, it focuses on journals that seek to increase their publication volume and/or minimise the time spent on editorial work and quality assessment. Assessing such journals is becoming increasingly difficult because they may formally meet the Level 1 criteria, such as peer review and an editorial board consisting of experts, while scientific quality assessment may not be conducted with the same level of rigour and reliability across the board.

The checklist is a tool for identifying, documenting (whenever possible) and taking into account different problematic practices more systematically and comprehensively in journal-level assessments. Publication Forum panels are free to experiment with and adopt this tool in their assessment processes.

This is the first version of the checklist, and the Publication Forum Secretariat will continue to develop it in cooperation with the Steering Group, expert panels and other expert communities. If you have any questions or suggestions, please contact: julkaisufoorumi [at] tsv.fi (julkaisufoorumi[at]tsv[dot]fi)