Enabling research rigor and transparency, fostering researcher intellectual humility | Templeton World Charity Foundation, Inc.

“The Center for Open Science (COS) has a mission to promote openness, integrity, and reproducibility in researchers’ everyday behavior. Their focus is to stimulate behavior change in the adoption of preregistration and sharing of research data, materials, and code. The purpose of this mission is to improve the credibility of research, foster intellectual humility among researchers, and, ultimately, accelerate the discovery of knowledge, solutions, and cures.

The COS theory of change presumes that researchers need infrastructure to make behaviors possible; user-centered product design to make behaviors easy; grassroots organizing and visibility to make behaviors normative; and journals, funders, and institutions to shift incentives and policies to make behaviors desirable and required. All five elements are necessary for broad, effective culture change.

Through this grant, the COS, led by project director Brian Nosek, will improve the Open Science Framework (OSF), the open-source infrastructure they maintain, to more fully embody their mission, making it easier for researchers to report outcomes of pre-registered research to reduce publication bias and selective reporting. They will achieve this outcome in three key ways:

incorporating just-in-time training and support tools in workflows to increase the quality of researchers’ open behaviors;
enhancing the collection of research project metadata to improve discoverability and to enable funders and institutions to increase adherence to policies promoting rigor and transparency; and
advancing the sustainability of the infrastructure by increasing earned revenue and mitigating OSF maintenance costs….”

About Metascience 2021

“The Metascience 2021 Conference is a global virtual gathering to connect the study of science across disciplines, methodologies, and regions. It follows the inaugural Metascience 2019 Symposium held at Stanford University. Metascience 2021 is an initiative of the Center for Open Science (COS), the Association for Interdisciplinary Meta-Research and Open Science (AIMOS), and the Research on Research Institute (RoRI) and is generously supported by the Templeton World Charity Foundation and the RoRI consortium.”

UMD partners on Open Science Framework – News | UMD Libraries

“The University of Maryland Libraries and the Division of Research are pleased to announce that UMD is now an institutional partner of the Open Science Framework (OSF), an online research management and collaboration platform from the Center for Open Science. The OSF system makes it easier for UMD researchers to manage projects throughout their life cycles and to collaborate with others across institutions, with an overarching goal of making more research outputs and data transparent, discoverable, and reusable. UMD researchers can log into the new OSF portal at https://osf.umd.edu/, using their university credentials….”

Symposium: A critical analysis of the scientific reform movement

“As the science reform movement has gathered momentum to change research culture and behavior relating to openness, rigor, and reproducibility, so has the critical analysis of the reform efforts. This symposium includes five perspectives examining distinct aspects of the reform movement to illuminate and challenge underlying assumptions about the value and impact of changing practices, to identify potential unintended or counterproductive consequences, and to provide a meta perspective of metascience and open science. It’s meta, all the way up.

Each presenter will provide a 15-minute perspective followed by a concluding discussion among the panelists and a time to address audience questions. Visit cos.io/meta-meta to view session abstracts and speaker info.”

Increasing transparency through open science badges

“Authors who adopt transparent practices for an article in Conservation Biology are now able to select from 3 open science badges: open data, open materials, and preregistration. Badges appear on published articles as visible recognition and highlight these efforts to the research community. There is an emerging body of literature regarding the influences of badges, for example, an increased number of articles with open data (Kidwell et al 2016) and increased rate of data sharing (Rowhani?Farid et al. 2018). However, in another study, Rowhani?Farid et al. (2020) found that badges did not “noticeably motivate” researchers to share data. Badges, as far as we know, are the only data?sharing incentive that has been tested empirically (Rowhani?Farid et al. 2017).

Rates of data and code sharing are typically low (Herold 2015; Roche et al 2015; Archmiller et al 2020; Culina et al 2020). Since 2016, we have asked authors of contributed papers, reviews, method papers, practice and policy papers, and research notes to tell us whether they “provided complete machine and human?readable data and computer code in Supporting Information or on a public archive.” Authors of 31% of these articles published in Conservation Biology said they shared their data or code, and all authors provide human?survey instruments in Supporting Information or via a citation or online link (i.e., shared materials)….”

Workshop: Building an Open Scholarship Base Together

“The goal of the Open Scholarship Knowledge Base (OSKB) is to broadly collate and disseminate the excellent content developed by the open scholarship community, helping colleagues adopt and keep up to date with open practices. Hosted by the Center for Open Science, the OSKB is an openly accessible, community-driven resource that sustained by contributions from fellow scholars. We continuously add new material and ideas, and work with the larger open research community to keep track with best practices as they evolve. By building a living resource, the OSKB aims to reduce knowledge gaps and increase the speed with which transparent research practices are adopted in the field.

We work together as a community to gather and share knowledge about the what, why, and how of open scholarship. We collect, review, consolidate, and organize content to support the education and application of open scholarship practices for all aspects of the research lifecycle. All content is available through our OER Commons portal via https://www.oercommons.org/hubs/oskb. In the spirit of openness, we welcome a diversity of ideas, tools, and methods, as well as researchers from a multitude of fields and backgrounds….”

Preprints: Statement on Why LawArXiv is No Longer Accepting Submissions | LJ infoDOCKET

“In the past couple of weeks LawArXiv announced they were, “no longer able to accept new submissions.“ …

Today, we received the following statement from the LawArXiv Steering Committee with some additional details about what happened and plans for the future. 

The Steering Committee made the decision to end our partnership with the Center for Open Science this fall after an intense period of evaluation. The demands of the legal research community did not align fully with what we were able to provide with COS, and therefore we saw limited use of the site. Coupled with the need for COS to start charging a fee for the service, we made the difficult decision to suspend LawArXiv as of the beginning of 2021. We are currently working with an Exploratory Committee to determine the need for LawArXiv and to carefully consider the features that would be necessary should we relaunch. …”

 

Leveraging Open Ecosystems to Enhance Reproducible Workflows

“Open source infrastructure has paved the way for mission-aligned research stakeholders to create a united vision of interoperable tools and services that accelerate scholarly communication, fill technology gaps, converge solutions, and enable universal access and discoverability.

Hear from a panel of research groups that have taken advantage of interoperable infrastructure to leverage more robust workflows to support rigorous, reproducible research. We will also discuss the steps stakeholders and institutions can take to integrate OSF’s open API with existing services to establish streamlined researcher workflows.”

The Open Research Lifecycle | Center for Open Science – YouTube

“Open science reduces waste and accelerates the discovery of knowledge, solutions, and cures for the world’s most pressing needs. Shifting research culture toward greater openness, transparency, and reproducibility is challenging, but there are incremental steps at every stage of the research lifecycle that can improve rigor and reduce waste. Visit cos.io to learn more.”

OSF | Center for Open Science – NSF 21-511 AccelNet-Implementation-Community of Open Science Grassroots Networks (COSGN).pdf

“Overview. The Community of Open Scholarship Grassroots Networks (COSGN), includes 107 grassroots networks representing virtually every region of the world and every research discipline These networks communicate and coordinate on topics of common interest. We propose, using an NSF 21-515 Implomentation grant, to formalize governance and coordination of the networks to maximize impact and establish standard practices for sustainability. In the project poriod, we will increase the capacity of COSGN to advance the research and community goals of the participating networks individually and collectively, and establish governance, succession planning, shared resources and communication pathways to ensure an active community sustained network of networks By the end of the project poriod, we will have established a self-sustaining notwork of networks that leverages disciplinary and regional diversity actively collaborates across networks for grassroots organizing, and shares resources for manum impact on culture change for open scholarship.”