Using Meta-Research to Improve Science: A Participant-Guided “Learn by Doing” Course
Concerned about the reproducibility crisis? Wondering what you can do to improve scientific rigor & reproducibility? Want to learn skills to identify practices that contribute to poor reproducibility in your own field, and develop solutions? Looking for hands on experience?
Apply for the QUEST Center’s meta-research course, where students will learn about meta-research by working as a team to design, conduct and publish a meta-research study.
What is meta-research?
Meta-research is research on research. Meta-research, or science of science studies, can help us to improve science by identifying common problems with the design, conduct, analysis and reporting of scientific studies. This allows us to develop targeted solutions to improve scientific research. Meta-research may also examine other topics that influence research practices, including hiring and promotion practices, educational programs, journal guidelines and funding agency policies.
Please note that this is not a course on meta-analysis. Meta-analysis refers to the process of systematically identifying all studies that address a particular research question (systematic review), and combining the results of those studies to estimate the size and direction of an effect. While meta-research borrows some techniques from systematic reviews, there are clear differences.
Description - Course Overview
In this participant guided learn by doing course, students will work as a team to complete a meta-research study. All participants will be listed as authors on a meta-research paper, which will be submitted to a peer-reviewed journal for publication at the conclusion of the course. After completing the course, students will be able to apply the skills that they have learned to address problems in their own fields.
After completing the course, students will be able to:
- Define meta-research, and explain how scientists can use meta-research to improve science
- Critique study designs for systematic review/literature survey style meta-research studies by evaluating scientific rigor and feasibility
- Write screening, abstraction and analysis protocols for a meta-research study
- Implement procedures to train the study team in data screening and analysis
- Conduct a systematic review/literature survey style meta-research study
- Create a public repository containing the results of the meta-research study, including protocols, data and meta-data
- Use the results of the meta-research study to develop targeted solutions to the problems identified
- Prepare a communication strategy to explain the results of the meta-research study to active researchers
- Write a manuscript detailing the results of the meta-research study
The participation on this courese requires some research experience.
Certificates, ECTS & Time commitment
We will provide a packet (signed certificate/information on the course etc.) to help students obtain ECTS credit from their institution or department (estimated ECTS: 5-6 credits). As this course is open for students from various programs, obtaining formal approval from each program is not feasible. Students themselves are responsible for ensuring that they will receive credit for the course.
This elective course will run from late June to mid December. Students will participate in a 90-minute class video conference each week, which will combine a seminar to teach new material with active discussions about how to proceed with each phase of the meta-research project. Students will interact virtually through Microsoft Teams throughout the course. It is estimated that students will spend, on average, one day per week throughout the course working on course activities. The amount of time required may change depending on the project and study design that students select.
Dr. Weissgerber is a meta-researcher at QUEST (Quality | Ethics | Open Science | Translation) in Berlin. She completed her graduate work in physiology at Queen’s University (Canada), a post-doctoral fellowship at the Magee-Women’s Research Institute (USA), and was an Assistant Professor at Mayo Clinic (USA). Her 2015 paper on bar graphs (https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002128) has been viewed more than 375,000 times. This paper contributed to policy changes in many journals that encourage authors to replace bar graphs of continuous data with more informative graphics (dot plots, box plots, violin plots).
Student Assistants: Vartan Kazezian, Camila Baselly, Link to the Team-website
This course is funded by the Berlin University Alliance and is open to students in the biomedical or biological sciences at Charité - Universitätsmedizin Berlin, Humboldt-Universität zu Berlin, Freie Universität Berlin, or Technische Universität Berlin. The course is open to PhD students, medical students and MD/PhD students who actively participate in research. Masters students who have significant research experience may also apply.
Wednesdays 5:30-7pm, June 30 to December 15, 2021
It is estimated that students will spend, on average, one day per week throughout the course working on course activities. The amount of time required may change depending on the project and study design that students select.
For a detailed course outline and grading scheme follow this link.
Example paper from a previous international version of this course: Creating clear and informative image-based figures for scientific publications (plos.org)
Course language: English
Location: During the pandemic the workshop will be held online, via Microsoft TEAMS.
How to Apply: Students need to apply to participate in this intensive course. Email the brief application form to Claudia Kirchert, email@example.com by 9 pm on June 23, 2021.
Please note: Last year we received more than 40 applications for 15 places. Follow this link to the application form.
Contact for questions about the course:
Tracey Weissgerber, PhD, firstname.lastname@example.org