Hi Fiona,

We’re starting a new project at the upcoming eLife Innovation Sprint (MERITS) which will aim to become a central repository for preprint and article ratings, with a view to (a) facilitating metaresearch, (b) increasing visibility of article evaluations, and (c) fostering innovation. We’re hoping to bring various forms of rating data to the sprint (e.g., journal ratings, platform ratings, metaresearch ratings), so that we can develop pipelines for converting different types of data into a common machine-readable format

I was wondering if the RepliCATS evaluation data is openly available, or could be made available for this purpose?

Let me know your thoughts!


Dear Dr Vincent,

I'm writing to find out if the ratings/evaluations that researchers give via Science Feedback are openly available, or if they could be made available in some way.

We’re developing a new open science project at the upcoming eLife Innovation Sprint (MERITS; [<https://sprint.elifesciences.org/projects2021/>](<https://sprint.elifesciences.org/projects2021/>)) which will aim to become a central repository for article ratings, with a view to (a) facilitating metaresearch, (b) increasing visibility of article evaluations, and (c) fostering innovation. We’re hoping to bring various forms of rating data to the sprint (e.g., journal ratings, platform ratings, metaresearch ratings), so that we can develop pipelines for converting different types of data into a common machine-readable format, and it would be great if Science Feedback data could be one of those sources.

API access would be ideal, but otherwise we'd happily accept data in any format.

Let me know!

Ps. I'm also keen to support Science Feedback by hosting a collective action campaign on Free Our Knowledge ([<https://freeourknowledge.org/>](<https://freeourknowledge.org/>)) at some point, but this will have to wait until I have more time later in the year or early next.

Cheers
Dr Cooper Smout
Founder, Free Our Knowledge

Hi team,

We’re starting a new project at the upcoming eLife Innovation Sprint (MERITS) which will aim to become a central repository for preprint and article ratings, with a view to (a) facilitating metaresearch, (b) increasing visibility of article evaluations, and (c) fostering innovation. We’re hoping to bring various forms of rating data to the sprint (e.g., journal ratings, platform ratings, metaresearch ratings), so that we can develop pipelines for converting different types of data into a common machine-readable format.

One of the types of data we'd like to include are binary certification data, like the 'Recommendations' (or rejections) that reviewers give to preprints via PCI. Is this data made available in some way, e.g. via an API? Or if not, could it be made available in some format for this purpose?