Meta-Research Methods – A Webinar Series

Presented by Dr. Tracey Weissgerber, BIH QUEST Center

Study:

• Weissgerber TL, Winham SJ, Heinzen EP, Milin-Lazovic JS, Garcia-Valencia O, Bukumiric Z, Savic MD, Garovic VD, Natasa M. Milic. Reveal, Don’t Conceal - Transforming Data Visualization to Improve Transparency. Circulation. 2019;140:1506–1518. https://doi.org/10.1161/CIRCULATIONAHA.118.037777.
• Weissgerber TL, Milic NM, Winham SJ, Garovic VD. Beyond Bar and Line Graphs: Time for a New Data Presentation Paradigm. PLoS Biol 13(4): e1002128. https://doi.org/10.1371/journal.pbio.1002128

Video

Presented by Prof. Malcolm MacLeod, The University of Edinburgh (UK), Edinburgh CAMARADES group

Video

Presented by: Maryann Martone

Study: Wilkinson, M., Dumontier, M., Aalbersberg, I. et al. The FAIR Guiding Principles for scientific data management and stewardship. Sci Data 3, 160018 (2016). https://doi.org/10.1038/sdata.2016.18

Video

Presented by Prof. Dr. Malte Elson, University of Bern (Switzerland) and Dr. Ian Hussey, Ruhr-Universität Bochum

Study: Elson M. Examining Psychological Science Through Systematic Meta-Method Analysis: A Call for Research. Advances in Methods and Practices in Psychological Science. 2019;2(4):350-363. https://doi.org/10.1177/2515245919863296.

Online Resources:

• Elson, M. (2016). FlexibleMeasures.com: Competitive Reaction Time Task. doi:10.17605/OSF.IO/4G7FV
• Elson, M. (2017). FlexibleMeasures.com: Go/No-Go Task. doi:10.17605/OSF.IO/GSX52

Video

Presented by Sarah McCann, BIH QUEST Center, CAMARADES Berlin

Study: McCann SK, Cramond F, Macleod MR, Sena ES. Systematic Review and Meta-Analysis of the Efficacy of Interleukin-1 Receptor Antagonist in Animal Models of Stroke: an Update. Transl Stroke Res. 2016 Oct;7(5):395-406. https://doi.org/10.1007/s12975-016-0489-z.

Video

Presented by Dr. Cassie Short, Carl von Ossietzky University Oldenburg

Study: Paul K, Short CA, Beauducel A, Carsten HP, Härpfer K, Hennig J, Hewig J, Hildebrandt A, Kührt C, Mueller EM, Munk A, Osinsky R, Porth E, Riesel A, Rodrigues J, Scheffel C, Stahl J, Strobel,A, Wacker J. The Methodology and Dataset of the CoScience EEG-Personality Project – A Large-Scale, Multi-Laboratory Project Grounded in Cooperative Forking Paths Analysis. Personality Science. 2022; 3, 1-26. https://doi.org/10.5964/ps.7177

Video

Presented by Maximilian Frank M.Sc., LMU Munich, Psychologie-Fachschaften-Konferenz (PsyFaKo)

Study: first hand experience report from an early career researcher (ECR)

Video

Presenter: Tracey Weissgerber, QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin

Description: Dr. Weissgerber will briefly discuss criteria to consider when selecting a meta-research project. She will then talk about why you need a communication strategy for your meta-research study, and how to design one that works.

Video

Presented by Dr. Kelly Cobey, University of Ottawa Heart Institute

Study: Cobey KD, Haustein S, Brehaut J, Dirnagl U, Franzen DL, Hemkens LG, Presseau J, Riedel N, Strech D, Alperin JP, Costas R, Sena ES, van Leeuwen T, Ardern CL, Bacellar IOL, Camack N, Britto Correa M, Buccione R, Cenci MS, Fergusson DA, Gould van Praag C, Hoffman MM, Moraes Bielemann R, Moschini U, Paschetta M, Pasquale V, Rac VE, Roskams-Edris D, Schatzl HM, Stratton JA, Moher D. Community consensus on core open science practices to monitor in biomedicine. PLoS Biol. 2023 Jan 24;21(1):e3001949. https://doi.org/10.1371/journal.pbio.3001949

Video

Presented by Dr. Anita Bandrowski, University of California at San Diego (USA)

Study: Babic Z, Capes-Davis A, Martone ME, Bairoch A, Ozyurt IB, Gillespie TH, Bandrowski AE. Incidences of problematic cell lines are lower in papers that use RRIDs to identify cell lines. Elife. 2019 Jan 29;8:e41676. https://doi.org/10.7554/eLife.41676

Video

Presented by: Tom Hardwicke, University of Melbourne Paper:

Study: Hardwicke Tom E., Mathur Maya B., MacDonald Kyle, Nilsonne Gustav, Banks George C., Kidwell Mallory C., Hofelich Mohr Alicia, Clayton Elizabeth, Yoon Erica J., Henry Tessler Michael, Lenne Richie L., Altman Sara, Long Bria and Frank Michael C. 2018. Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal. CognitionR. Soc. open sci.5180448180448, https://doi.org/10.1098/rsos.180448

Video

Presented by: Kaitlyn Hair, CAMARADES, The University of Edinburgh

Study: Hair, K., Macleod, M.R., Sena, E. et al. A randomised controlled trial of an Intervention to Improve Compliance with the ARRIVE guidelines (IICARus). Res Integr Peer Rev 4, 12 (2019). https://doi.org/10.1186/s41073-019-0069-3

Video

Presented by Prof. Olavo Amaral, Federal University of Rio de Janeiro (Brazil). Prof. Amaral will discuss tips, tricks and lessons learned for performing replication studies.

Video

Presented by Nicki Lisa Cole and Tony Ross Hellauer, Graz University of Technology and Know-Center GmbH

Study: Cole Nicki Lisa, Reichmann Stefan and Ross-Hellauer Tony. Toward equitable open research: stakeholder co-created recommendations for research institutions, funders and researchers. R. Soc. open sci.10221460221460, https://doi.org/10.1098/rsos.221460 

Video

Speaker: Roland Roberts, PLOS Biology

Video

Speaker: Marguerite O’Riordan, Aston University, TranspariMED

Paper: Are European clinical trial funders policies on clinical trial registration and reporting improving? A cross-sectional study 

Video

Speaker: Colby Vorland, Indiana University – Bloomington

Papers: Errors in the implementation, analysis, and reporting of randomization within obesity and nutrition research: a guide to their avoidance and Toward Fulfilling the Aspirational Goal of Science as Self-Correcting: A Call for Editorial Courage and Diligence for Error Correction

Video

Speaker: Tim Errington, Center for Open Science

Paper: Reproducibility in Cancer Biology: Challenges for assessing replicability in preclinical cancer biology, Investigating the replicability of preclinical cancer biology

Video

Speaker: Delwen Franzen, QUEST Center for Responsible Research, Berlin Institute of Health at Charité

Video

Speaker: Tatsuya Amano, The University of Queensland

Paper: Tapping into non-English-language science for the conservation of global biodiversity

Video

Speaker: Jonathan Kimmelman, Hannah Moyer, McGill University

Paper: Bypassing phase 2 in cancer drug development erodes the risk/benefit balance in phase 3 trials

Video

Speaker: Erin McKiernan, Open Research Funders Group, Universidad Nacional Autónoma de México, Mexico

Paper: Use of the Journal Impact Factor in academic review, promotion and tenure

(This talk was originally planned for November 6th, 2023)

Video

Speaker: Jess Rohmann, Institute for Public Health, Charité - Universitätsmedizin Berlin

Video

Speakers: Tracey Weissgerber and Friederike Kohrs, QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin

Papers: Dr. Weissgerber and Dr. Kohrs will share lessons learned from leading or being on the organizing team for many author (not research) papers, including:

• Recommendations for empowering early career researchers to improve research culture and practice
• Eleven strategies for making reproducible research and open science training the norm at research institutions
• Ten simple rules for implementing open and reproducible research practices after attending a training course
• Promoting reusable and open methods and protocols (PRO-MaP): Draft recommendations to improve methodological clarity in life sciences publications

Video

Speaker: Kyle Siler, Data, Equity and Policy Lab, University of Toronto 

Paper: Predatory publishers latest scam: bootlegged and rebranded papers

Video

Speaker: Dorothea Strecker, Berlin School of Library and Information Science, Humboldt-Universität zu Berlin 

Paper: Disappearing repositories: Taking an infrastructure perspective on the long-term availability of research data

Video

Speaker: Melissa Rethlefsen, Health Sciences Library and Informatics Center, University of New Mexico 

Paper: Health science librarians' engagement in open science: A scoping review

Video

Speaker: Manoj Lalu, University of Ottawa

Paper: Identifying barriers and enablers to rigorous conduct and reporting of preclinical laboratory studies

Video

Speaker: David Mellor, Center for Open Science 

Paper: TOP guidelines

Video

Speaker: Jennifer Byrne, The University of Sydney, NSW Health Pathology 

Paper: Misspellings or "miscellings"—Non-verifiable and unknown cell lines in cancer research publications