Embed Size (px)
Citation preview
Die ZBW ist Mitglied der Leibniz-Gemeinschaft.
On Quality in Open Science
Isabella Peters, ZBW – Leibniz Information Center for Economics Copenhagen, 25.9.2019
Quality and information asymmetry
2Picture by rawpixel.com by Pexels
Image removed due to copyright issues
On quality….
3https://en.wikipedia.org/wiki/Quality
shared understanding of properties of
quality
demonstration of quality
4
Quality and Expectations
https://en.wikipedia.org/wiki/Quality_(business) https://www.businessballs.com/amusement-stress-relief/tree-swing-cartoon-pictures-early-versions/
What makes a good journal? a) A good editorial board? b) Continuous publishing of good
publications? c) High rejection rate? d) Having published one good article once
in a while? e) A nice layout? f) A good price? g) …
Quality and Expectations
5Picture by Kaboompics .com by Pexels
Image removed due to copyright issues
What makes good science?
REF Impact Case Studies • 3,709 unique „Impact Pathways“
Quality and Expectations
6The nature, scale and beneficiaries of research impact. An initial analysis of Research Excellence Framework (REF) 2014 impact case studies. https://www.kcl.ac.uk/policy-institute/assets/ref-impact.pdf (Fig. 12, p. 39)
7
What makes good science? • Quality • Efficiency • Reproducibility • Credibility • Visibility • Openness
• “Open science is about improving the quality, accountability and social contribution of research…” (p. 96)
http://whyopenresearch.org/ MLE on Open Science: Final Report -Altmetrics and Rewards (2018). https://rio.jrc.ec.europa.eu/en/library/mle-open-science-final-report-altmetrics-and-rewards
Quality and Expectations
What do we value as a community?
What are our expectations?
! Expectations need to be aligned across members of the community
Shared Understanding of Properties of Quality
8Picture by rawpixel.com by Pexels
Image removed due to copyright issues
„We’re currently looking at the research arm of our new institutional strategy and
there’s a desire to have KPIs for research, specifically a metric (and they are keen on just one) against which to
evaluate the performance of our research and report back to the Board of
Governors on.“
From a mailing list…(not 1980 but 2019!)
9
Image removed due to copyright issues
Quality and Signals
10
11
Demonstration of Quality
community expectations/ functions signals information
symmetry
12
Demonstration of Quality
community expectations/ functions signals information
symmetry
Demonstration of Quality in Open Science
13Picture by rawpixel.com by Pexels Von Andreas E. Neuhold - Eigenes Werk, CC BY 3.0, https://commons.wikimedia.org/w/index.php?curid=33542838
Image removed due to copyright issues
Openness instead of Signals
• open = digital
• stop emulating
• embrace digitality
14https://commons.wikimedia.org/wiki/File:In_der_Schreibstube_(nach_Urban_Wyss,_Libellus_Valde_Doctus).jpg https://de.wikipedia.org/wiki/Journal_des_scavans futureocean.org/poster
• Quality is about the alignment of expectations, functions and community – mostly represented by signals
• Alignment levels out information asymmetry
Conclusion
15
• Openness is a way to demonstrate quality • Discourse needed to decide on the appropriate alignment !transparency about alignment supports communication • Digitality is key to enable openness !room for publishers
Imming, M. & Tennant, J.(2018, June 8). Sticker open science: just science done right. Zenodo. http://doi.org/10.5281/zenodo.1285575
Die ZBW ist Mitglied der Leibniz-Gemeinschaft.
On Quality in Open Science
Isabella Peters, [email protected]
Questions?
Image removed due to copyright issues
