Dr. Vaibhav Sahni holds dual specialisations in the fields of Oral and Maxillofacial Surgery as well as Periodontics. He also holds the MFDS RCPS (Glasg), MFDS RCSEd and the AssocFCGDent. His areas of expertise include, in addition to the general purview of oral health, maxillofacial injuries, point of care diagnostics, oral-systemic interactions, hostmicrobial interactions as well as computational systems as they relate to oral health and rehabilitation. He is currently a postdoctoral scholar at the Forsyth Institute, Cambridge, Massachusetts, USA. He is a member of the Cochrane Early Career Professionals Network. Here he looks at how and where systematic reviews are registered. 

Registration is an important aspect of conducting a systematic review as it helps in reducing research waste, decrease bias and enhances the overall transparency of the work (See here).

Registering a systematic review involves publishing details related to the project prior to its commencement. This enables one to verify whether the proposed methodology and reporting criteria were met after the review is concluded. 

In addition to these reasons, it makes sense to register a protocol and authors are no longer bound by the lack of free registries, as there are now many places to register. Some authors might be of the opinion that registering their protocol might lead to their ideas being hijacked by some other research team making their work irrelevant. On the contrary, authors should view this exercise as registering a claim on their idea and workflow. Another potential issue authors might think of is that developing a protocol is a time-consuming task which basically is of help to other reviewers. This process should be viewed in light of the fact that systematic reviews are conducted by more than one person and having a set protocol avoids confusion, miscommunications and bias within the team. Another advantage of an a priori protocol publication is that it strengthens confidence in the eventual report when the workflow has been followed, it conveys that the authors did not alter the work to suit their preferences. 

Some organizations such as Cochrane, which commission or conduct their own reviews maintain an exclusive registry of their published and ongoing work. From being merely an idea in Janury 2010, currently, the prospective registration of systematic reviews seems to have become an established practice. 

From an author’s perspective, a prospective register needs to:

a.    Allow authors to prospectively register their systematic reviews.
b.    Provide an overview of currently registered systematic reviews.
c.    Enable a search function for the sake of being user-friendly.

Duplication in conducting reviews is a significant issue. 3 It would serve authors well, to search registers and databases to ascertain whether their research is in fact new and not identical or similar to ones already out there.

Below is a summary and overview of some of the more popular prospective registers to house a systematic review protocol.

PROSPERO, INPLASY and Research Registry are specific for systematic reviews, while protocols.io and OSF Registries are generic in that they accept all study types. The systematic review registers have a structured registration form usually consisting of 24-28 fields which are mandatory. OSF Registries allow users to either select the ‘Open-ended-registration’ option or from varying forms, the former allows for authors to provide a narrative description of the review. All registers have the facility to search from registered systematic reviews, the optimization and utility of these tools, however, varies. PROSPERO tends to provide the most elaborate search options, but recent reports have deemed the search tools suboptimal (See here). 

PROSPERO, however, helpfully guides users through the process of navigating their process.

The registries also vary in terms of their eligibility criteria to accept entries. A case in point is PROSPERO which requires the systematic review being registered to possess a health-related outcome.

When making a decision regarding which registry to utilize, a significant point of contention would be to weigh the processing time against the cost of the service. A service such as INPLASY would charge authors but aims to provide faster turnaround times as compared to a service such as PROSPERO, which is free of charge, but has longer turnaround times due to its popularity.

Another issue with a popular service such as PROSPERO is that it is funded by the United Kingdom (UK) National Institute for Health Research (NIHR) which means that UK-based registrations are dealt with on a priority basis. This may become problematic for researchers outside the UK wishing to register.

There are also some other ways to attempt transparency in one’s methodology. Online data repositories such as Figshare, OSF and Zenodo, enable users to upload project-related data and documents which are tracked for their version, have a time-stamp and are assigned a DOI. re3data.org, a collection of research-based data repositories may also be searched to find other such platforms.

Some other options to look into may include the AHRQ Systematic Review Data Repository, CAMARADES (Collaborative Approach to Meta-Analysis and Review of Animal Data from Experimental Studies) and AsPredicted.

It appears that prospective registries for systematic reviews are fast becoming an essential component of the research process for a variety of reasons. Authors would find that investing some time in making the effort to register their projects would go a long way in aiding their research endeavour by eliminating research waste, enhancing transparency and decreasing bias.
 

- Dr. Vaibhav Sahni

• Learn more about Cochrane Early Career Professionals Network
• Early Career Professionals Network blog post: Learn more about GRADE

Cochrane Group members are spending between 3 hours to just 15 minutes a week on social media activities. How can you make the most out of that time for maximum impact? In this blog Roses Parker, Research Fellow, and Muriah Umoquit, Communications and Engagement Officer, share communication tips that are easy to implement and take minimal time.  

Often the people doing social media are for a Cochrane Group are doing it along side other responsibilities. To help with this capacity crunch, we've gathered our 5 best hacks to save you time but get the maximum output for any minutes you are able to invest!

1. Tap into the larger communication community on Cochrane Slack

What:  Core Cochrane staff are using Slack as their virtual office - if you are doing comms for a Cochrane Group, then you should be there too! In that workspace there is a 'channel' where suggested tweets are shared, graphics and top tips are posted, and you can ask questions and get help from others doing communications.
Why: It's easy to scan the chat in our channel for items that would be of interest to your audience and copy-and-paste relevant suggested tweets. And the biggest thing - you'll be part of a larger supportive community! 
Time commitment: 10 minutes every week.
Ongoing benefit: Once you have mastered the weekly scan and disseminating of suggested tweets, you can also use the channel to 'boost the signal' on your own news or ask questions. 
Links: Learn more about accessing Cochrane Slack and then head over to #all-comms-help

2. Use a social media posting scheduler 

What: An external tool that lets you manage your social media accounts from one place, allowing you to schedule posts at a later time. 
Why: You only have to sit down once a week and schedule all your social media posts at one time; these posts will automatically go out when you want, without you having to log-in.
Time commitment: 1 hour initial investment and then 10 minutes a day or less if you pair this with tip 1!
Ongoing benefit: Once you get the hang of scheduling, you can look at changing the messaging slightly so you can post about one review/topic multiple times for different audiences, time zones, or branching out into other social media platforms.
Links: We recommend Buffer (It's free for 3 social media channels and 10 posts at a time) and Cochrane UK has an helpful how-to video. 

3. Know your Dissemination Essentials

What: A checklist of 18 considerations when disseminating health evidence. There is a 1-page checklist that is great to print-out and keep handy; the full document is also available with some helpful examples.
Why: If you're low on time, then you are likely not going to be creating elaborate dissemination products but this checklist is fantastic to use as a reference when creating messaging for social media posts. By using the checklist, you will get information to the people who need it, when they need it, in a way they can understand and use it. 
Time commitment: One time commitment of 10 minutes to review the 1 page checklist and one hour to browse and review the supporting materials.
Ongoing benefit: Once you get familiar with the 18 items on the checklist and how to apply them, it can become more of a routine to communication messages. 
Links: Print the 1-page checklist and review the Dissemination Essentials supporting materials - a recorded webinar and the full document with examples. 

4. Keep track of how to reach your target audience

What: Create and maintain an Excel table that you can refer to that has common hashtags you can use to reach your audience and relevant organizations/association/advocacy groups/partners to tag. 
Why: You are likely to have more than one audience and it's likely not everyone from those audiences are following you on social media. Use hashtags and other trusted organizations to help get information you are trying to disseminate in front of the people who need to see it. 
Time commitment: 1 hour for initial set-up and a few minutes a week to update.
Ongoing benefit: Think of this as a long-term project you can build upon. It will become a personalized resource when planning out future dissemination.
Links: Start by looking at the Altmertic Scores of some of your recent top reviews (linked to on the review!) to see who is sharing your reviews and what hashtags they are using. You can also look up specific healthcare hashtags on Symplur.

5. Add a picture to your posts 

What: Add a relevant photo or graphic to your social media posts - Cochrane has a Dropbox of folder of helpful images which are free for you to use. 
Why: It's generally known that images get more attention on social media over not having an image - a small-scale study using Cochrane social media accounts showed this too! An 'Image Checklist' will help give you the confidence to select images and the Central Executive Team can help provide images to you for free. 
Time commitment: One time commitment of an hour to review the check-list and supporting materials and then an few minutes extra for each post.  
Ongoing benefit: You can tailor the pictures you use to your target audience demographics so that the pictures used are relatable and appropriate to your setting and culture. This may concern ethnicity, skin colour, gender roles, hierarchy, moral ideas and common behaviour, gestures, religious practices and places, food, meaning associated with colours or symbols, and design preferences. 
Links: View the Image Checklist with helpful examples and learn about getting access to a free Dropbox folder of images.

We hope you put some of these 5 hacks into action! If you found this helpful, take a look at these other communication blogs:

• 5 tips for a low-maintenance Cochrane group website
• Social media in 10 minutes a day

Cochrane’s revised policy on conflicts of interest (CoI) was launched in October 2020. Since then, Cochrane’s Research Integrity team has been working with authors and editorial teams to support the implementation of the policy and has been learning about the challenges that arise. One such challenge has been the suggestion of authorship changes by authors and editorial teams as a way to comply with the CoI policy. This blog post from Stephanie Boughton, Research Integrity Editor in Cochrane’s Research Integrity team, addresses why such authorship changes are not a solution to CoI policy breaches and what should be done instead.

The CoI Policy for Cochrane Library content (2020) differs from equivalent policies in many journals in that, as well as requiring declarations, it also limits or prohibits involvement in a particular Cochrane Review for individuals with certain conflicts.

Conflicts that entirely prohibit involvement in a Cochrane Review include employment by a commercial organization with a financial interest in the topic area of the review, or personal ownership of a relevant patent. Others, such as payments from commercial organizations with a financial interest in the topic area of the review, prohibit being first or last author.

The policy also places restrictions on the author team as a whole, with a requirement that two-thirds are free of all relevant financial CoI. Finally, there are also restrictions on what a review author who is also an author on a study that may be eligible for inclusion can do in relation to the review. 

Collectively, these measures aim to minimize CoI and maintain the highest levels of objectivity and user confidence in content published in the Cochrane Library.

In the 18 months since the policy launch the Research Integrity Team and CoI Panel have received a variety of CoI referrals and queries from Cochrane Review Groups and review authors as the policy has been applied to new protocols, reviews and updates. Among these, two recurring issues stand out – firstly how related CoI and authorship are, and secondly, the importance of collecting CoI declarations early in the process, before any work has begun, and ensuring that authors are aware of the importance of not gaining further relevant CoI while working on the review.

When are authorship changes not a solution to CoI policy breaches?
In situations when conflicts resulting in a breach of the CoI policy have come to light at a later stage in the review process, after work has begun, we have received questions about whether changes to authorship could resolve the issue.

An example is when a first or last author has declared a relevant CoI during the review process, and we have been asked if changes can be made to the order of authors, moving the conflicted author to an allowable position as a middle author.
 
We have also seen cases where there have been requests to remove a conflicted author from the author team after they have already worked on the review, either so that the author group meets the requirement for two-thirds of authors to be free of all relevant financial CoI, or so that someone with a CoI that prohibits involvement in Cochrane Library content is not listed as an author. 

In all these examples, changes in authorship are not a way to comply with the CoI policy because such changes do not remove any potential effect that the CoI may have already had on the review.  Instead, changing the authorship serves only to mask any effect the CoI may have had, and may be misleading. Furthermore, authorship changes at a late stage do not adhere to standards for authorship described below.

In these cases, to comply with the CoI policy, the review must start over with a new author team that complies with the policy, highlighting the importance of checking CoI early in the process.

The importance of collecting CoI declarations early
Under the CoI Policy for Cochrane Library content (2020), CoI declarations are collected at multiple stages before and during the review process. This starts with the collection of declarations of interest from all proposed authors before any work begins (at title registration, or before the decision is made to update).

Collecting and checking potential CoI at this early stage, coupled with review authors being made aware from the start of the importance of not gaining further relevant CoI during the review process, and the consequences of doing so, helps prevent problematic situations from arising later in the review process.

Authorship
As with collecting and checking CoI early on in the process, agreeing authorship and position in the author line up early on ensures everyone is aware of their role on the review and can prevent potential issues, such as authorship disputes, arising later in the process. 

In addition to Cochrane following guidance from the Committee on Publication Ethics (COPE) on authorship, such as obtaining written agreement from all authors for any changes in authorship after work has begun, we have also recently updated the authorship policy in the Cochrane Database of Systematic Reviews editorial policies to clarify that authorship changes, including changes in author order, are not a solution for resolving CoI breaches.

Further help and advice
Resources to help with applying the policy are available for Cochrane Review Groups and authors on the CoI portal, including answers to FAQs from Managing Editors and a quick guide to the CoI Policy for Cochrane Library content (2020) for authors.

Cochrane’s Research Integrity Team is also available to answer any queries about the CoI policy – either via our CoI referral process for those relating to a specific review, or via email to coiarbiter@cochrane.org for more general queries.

You can also learn more about the research projects the Research Integrity Team is involved in here. If you would like to get involved or have any suggestions for relevant projects, we’d love to hear from you at researchintegrity@cochrane.org.

Stephanie Boughton

Research Integrity Editor
Cochrane’s Research Integrity team

Dr. Luis Enrique Colunga-Lozano is both an internal medicine and a critical care physician from Guadalajara, México. He currently works at the COVID-19 intensive care unit at Hospital Civil de Guadalajara - Dr. Juan I Menchaca. He is also a junior professor at Universidad de Guadalajara, where he teaches evidence-based medicine. Dr. Colunga-Lozano received his Master’s degree in Health Research Methods from McMaster University under Prof. Gordon Guyatt’s supervision. Furthermore, he has been a member of Cochrane since 2013 and has been involved in the production of systematic reviews as part of various Cochrane Groups including the Metabolic and Endocrine Disorders Group, the Heart Group, and the Schizophrenia Group. He is also a member of the Geographical Group in Guadalajara, Mexico. Dr. Colunga-Lozano works closely with members of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group on guideline development projects.

The assessment of the certainty (quality) of evidence is an important task during evidence synthesis, with implications on evidence applicability in decision-making. Several methods are available to evaluate the certainty of evidence. However, the GRADE approach has become the preferred method due to its systematic process and transparency. This Cochrane Blog provides a summary for researchers that are not familiar with the GRADE approach. A more detailed description is available in the GRADE series published in the Journal of Clinical Epidemiology. Useful resources are also available on the GRADE working group’s website. Please visit: https://www.gradeworkinggroup.org/

What is GRADE?

The GRADE working group is a collaboration that began in 2000, with an interest of addressing the limitations of grading systems in health care. The GRADE working group developed a sensible and transparent approach to assess the certainty of evidence and strength of recommendations. To date, more than 110 organizations have adopted the GRADE approach as part of their methodology (e.g., WHO, UpToDate, Cochrane, DynaMed, the National Health Service, and the Centers for Disease Control and Prevention).

The first article describing the GRADE approach was published in 2004 in the British Medical Journal (BMJ). In 2008, the BMJ published a series containing guidance for clinicians to understand the GRADE approach, and from 2011 to the present day, more than 30-parts of a series expanding the GRADE concepts have been published in the Journal of Clinical Epidemiology, which aims to provide guidance on systematic reviews and clinical guideline development.

What are we grading?

There are two components that we rate when we are using the GRADE approach. Firstly, the certainty (quality) of the evidence, and secondly, the strength of recommendations. GRADE divides the certainty of the evidence as very low, low, moderate, and high confidence. It is important to remark that GRADE does not intent to assess single studies, it is about assessing bodies of evidence, ideally produced from systematic reviews. GRADE also classifies the x

What are the GRADE criteria for assessing the certainty of evidence?

Currently, there are specific criteria for assessing certain bodies of evidence (e.g., treatment (pairwise), network, diagnosis, and prognosis). For example, in the assessment of treatment effects, randomized controlled trials will start as high confidence, and observational studies will start as low confidence. However, confidence in the evidence can change based on the following domains. Evidence certainty will be downgraded by the following: risk of bias (-1, -2), inconsistency (-1, -2), indirectness (-1, -2), imprecision (-1, -2) and publication bias (-1, -2), and upgraded with the following: large effect (+1), dose response (1+), all plausible confounding (1+).

What are the GRADE criteria for assessing the strength of recommendations?

Recommendations are informed by the evidence and a strong recommendation implies that benefits outweigh the risk/hassle/cost. There are several determinants of the strength of a recommendation. We can consider three as very important: Firstly, the balance between desirable and undesirable effects. For example, if the desirable consequences outweigh the undesirable consequences, there is more likely to be a strong recommendation, or if the desirable and undesirable consequences are closely balanced, there is more likely to be a weak/conditional recommendation. Secondly, the higher the quality of the evidence, the higher the likelihood that a strong recommendation is warranted. Finally, if the guideline panel is very certain of the trade-off between the desirable and undesirable consequences of treatment, that means that the preference is similar between patients, there is more likely to be a strong recommendation. If the guideline panel is uncertain about patient values and preference, and they believe that this will be different across patients, there is more likely to be a weak recommendation. Other considerations include cost, importance of the problem, acceptability, feasibility, and equity (Evidence to Decision Frameworks).

What is the interpretation of a strong vs weak recommendations?

With a strong recommendation, the variability of patient preference will be less (i.e., almost all (>90%) of informed patients will decide on the same choice); whereas with a weak recommendation, informed patients will select different choices. With a strong recommendation (based on supporting evidence), interaction with the patient is to ‘inform’ the suggestion (e.g., I consider this should be the course of action, because of this…); whereas with a weak recommendation, the right choice may differ between patients, highlighting the need for a shared decision-making process to identify the right choice for each patient. Strong recommendations are considerations for quality of care, and weak considerations are not, because the right choice differs from patient to patient.

Conclusion

Healthcare professionals and policy makers need evidence summaries to help them during their decision-making, these summaries should report the quality of the evidence and the strength of recommendations. The GRADE framework provides explicit guidance on the assessment of the certainty of evidence and strength of recommendations. The GRADE approach is transparent and systematic, which may be one of the reasons it has been adopted by many international institutions.

• View Cochrane Training materials on GRADE
• Learn more about Cochrane Early Career Professionals Network
• Early Career Professionals Network blog post: Registering Protocols of Systematic Reviews

Jennifer Dawson, PhD has worked with Cochrane as the Wikipedia in Residence since 2016. Her role includes maintaining and building further relations with Wikipedia, connecting new editors to the Wikipedia community, and supporting requests for engagement in Wikipedia work from the Cochrane community. Here she shares a few of her top FAQs on how to fix what people are reading on the internet! 

Cochrane has been working with Wikipedia since 2014 to try and improve the health-related evidence that is presently being shared in the over 36,000 medical articles on English Wikipedia. Here are the top three questions that we get. 

I am interested in improving a health-related article on Wikipedia. How do I get started?

The best way to start improving Wikipedia is to register for an account and then go in and fix that mistake. “Being bold” is actually encouraged on Wikipedia! When ‘fixing’ a mistake be sure that your improvement is supported by a high-quality citation that meets Wikipedia’s guidelines! When you are ready to add more health-related evidence, visit the Cochrane-Wikipedia Project Page for more information.

I have found a Cochrane Review that may be helpful to use as evidence in an article. What is the next step?

I usually suggest that you spend some time reading the present version on the Wikipedia article first before jumping in with new ideas. This ensures that the evidence is not already shared in a different part of the article. Once you have a place where you feel that your evidence would be ‘useful’ to readers, here are a few tips:

• Paraphrase all evidence (we cannot use quotations from sources on Wikipedia)
• Be sure to integrate your evidence into the existing text. Often this means expanding on the existing background information section in the Wikipedia article.
• It is not appropriate to share the PICO details or other information about how the systematic review was conducted in the Wikipedia article. If people are interested in this information they can read the source.
• It is also not usually necessary to share the source of the evidence in the text of the article (e.g, please not note write “A 2021 Cochrane review found that….”) See below for an example of how to share evidence, taken from https://en.wikipedia.org/wiki/Cardiac_surgery.
• Pulling in other high-quality secondary sources in addition to the Cochrane review is also ideal.

BEFORE:

AFTER: