Last month, Patrício Câmara Araújo, a researcher at the Federal Institute of Maranhão (IFMA), received feedback from an expert reviewing a paper he wrote on the topics most addressed by teacher training studies in Brazil—he published the manuscript on the SciELO Preprints repository, a Brazilian website for sharing papers not yet peer reviewed, in 2024. In addition to highlighting positive aspects of the academic text, the assessment highlighted some points that could be improved or better explained.
“One of the reviewer’s observations was that I need to better conceptualize the definition I adopted for bibliometric review, an area concerned with analyzing scientific production using statistical and mathematical methods,” says Araújo, who is a professor of philosophy and scientific research methodologies at IFMA. “Despite having published in several journals, I am just beginning to venture into the field of bibliometrics, so I first sought to publish this work as a preprint,” he explains.
When he uploaded the paper to the repository, he selected an option authorizing it to be shared on the American open review website PREreview, which has had a partnership with SciELO since 2022. It was there that physicist Daniel Fontes, who is doing a PhD at the Inter-Unit Postgraduate Program in Science Teaching of the University of São Paulo (USP), found Araújo’s article and voluntarily produced a report containing several recommendations. Fontes learned about PREreview from a course he took on scientific publishing that covered the open peer-review process. One of the platform’s objectives is for young researchers to gain experience with the peer-review process.
“I found the idea interesting and thought it would be cool to contribute,” says the physicist, who is studying scientific collaboration networks in Brazil’s science education research community. He found Araújo’s article by searching the platform for Portuguese social science manuscripts and looking for the most recent ones in education. To provide or request reviews, authors and reviewers need to log on to the system using their ORCID ID, a sequence of numbers used to identify researchers. “I usually do reviews for national and international journals and they involve an element of judgment. In addition to evaluating the manuscript and suggesting corrections if needed, the objective is to help the editorial board decide whether to accept or reject the manuscript. But when reviewing a preprint, this is not the case and the objective is purely collaborative,” says Fontes, who also intends to submit a paper of his own for evaluation on the platform.
For now, there are still few who are aware of the service. According to data from PREreview, 3,307 authors and reviewers registered on the website between its creation in 2017 and mid-April this year, with 795 preprint reviews requested and 64 completed (8.1%). Of these requests, 526 came via SciELO Preprints. Brazil accounts for the third most visits to the website, behind researchers from the USA and the UK.
There are more preprints than experts willing to analyze them
The low membership figures reflect the difficulty preprints have in attracting readers and generating appreciation for their content. Of 3,330 manuscripts published on the SciELO server in the last three years, less than 5% received some form of review or comment. “This happens with other similar servers around the world. There are many more preprints than researchers available to analyze them,” notes technology and digital media specialist Alex Mendonça, coordinator of the Brazilian platform. One of PREreview’s weaknesses is that it does not have a system to notify all authors when their paper is reviewed—when a researcher uses the service via SciELO, for example, they are not notified and need to regularly visit the website to check for feedback. “When a review is published, we encourage reviewers to contact the authors and let them know that they have reviewed their work, if they wish,” the PREreview team said in an email to Pesquisa FAPESP. SciELO does not have a feedback notification system either.
There are two ways to request a review of a preprint on the platform: by uploading the manuscript to a repository integrated with PREreview, such as SciELO Preprints, or by stating the DOI (digital object identifier) of the document, if it is uploaded to a registered repository. Authors may receive short comments or longer, more structured reviews. Volunteer reviewers decide how they want to share their opinion and if they need help formulating their review, a template is available with a sequence of questions to be answered, such as whether the introduction adequately explains the objective of the research. There are also guidelines on behavior: reviewers should be respectful of the authors and give constructive feedback, for example.
A team of five works full-time for the website, which is supported by the Gates Foundation, the Mozzilla Foundation, and the Chan Zuckerberg Initiative. “The idea is to make peer review more transparent; it is still an opaque process controlled by large, for-profit publishers,” says librarian Edilson Damasio of the State University of Maringá (UEM). He is one of the platform’s volunteer ambassadors, so-called champions, whose task is to provide support and training to communities in their countries. Damasio highlights that every opinion receives an automatic DOI and is made available in the Zenodo repository. PREreview also offers training for those who want to improve as a reviewer: the platform’s team conducts live reviews of manuscripts and streams them online to train new reviewers. There are also workshops, some of them paid.
The website has a page with freely accessible guides and materials to train and guide reviewers. This content has been used by Brazilian information scientist Janaynne Carvalho do Amaral, who is currently doing a postdoctoral fellowship at the University of Illinois Urbana-Champaign, USA. She is researching open peer review and the importance of teaching researchers how to perform peer reviews. She has been training undergraduate and graduate students on the topic at the American university since 2023, using PREreview’s material in her workshops. At a recent session, she hosted 80 researchers from Kazakhstan who were visiting the university. “This type of initiative encourages collaboration and helps improve peer review,” says Amaral, who reported on her experiences of the first workshops in an article published in the journal Learned Publishing in February 2025.
The story above was published with the title “Feedback welcome” in issue 351 of May/2025.
Scientific article
AMARAL, C. J. et al. Librarians at the center of peer review training: Increasing collaboration among scholarly communication stakeholders. Learned Publishing. Vol. 38, n° 2. Feb. 2, 2025.
