Seeking Evidence on Open Scholarship: ICOR’s research-on-research initiative | ICOR

“Incentivizing Collaborative and Open Research (ICOR) is a community initiative conducting research on collaboration and open scholarship, partnering with real world projects and implementations as they operate. ICOR has also begun to build a library of projects, evidence, and best practices (described here) that challenge the status quo of closed research by offering practical, real-life solutions. We seek to bring together individuals who share these goals to make connections, help implement, share results, and present to funders and research organizations a unified approach to problem solving.

The focus of our inaugural public meeting on May 17th was to introduce the need for evidence that open scholarship, and its enabling tools and processes, can lead to faster, more reproducible and innovative outcomes. Invited speakers and a diverse audience of 90 funders, practitioners, academic leaders, librarians and policy makers engaged in a lively discussion about strategies, projects, and resources that will contribute evidence and best practices….”

Incentivizing Collaborative and Open Research (ICOR) Public Meeting

“Incentivizing Collaborative and Open Research (ICOR) is building a collaborative research culture by strategizing, connecting and implementing projects that seek to change the status quo of competition throughout the research cycle. We have identified and begun to implement practical, real-life solutions involving tools and processes, aiming to gather evidence that sharing early research results will result in faster, more reproducible outcomes. ICOR is building a body of evidence and library of best practices and case studies on the impact of projects that facilitate collaborative open research. We have begun to register projects with similar aims as described here with the goal of presenting to funders and research groups a unified approach to problem solving.

At our inaugural webinar, we will present some of the representative projects and resources that have been curated to promote standardized best practices. More info: https://bit.ly/3MfnLm8 Agenda: https://bit.ly/3VXXkED ”

ICOR’s Inaugural Public Meeting: Evidence-based implementation of open collaborative research | 17 May 2023 | Incentivizing Collaborative Open Research

“We are pleased to announce that ICOR’s inaugural public webinar is scheduled for May 17, 10:30am – 12pm ET;  please join us by registering here.  Incentivizing Collaborative Open Research (ICOR) was founded in early 2020 with a small gathering of open science advocates, funders, practitioners and institutional leaders interested in taking constructive and immediate action to increase research transparency and accelerate scientific breakthroughs. The ‘Strategic Circle’ agreed that use of publications and associated metrics was incentivizing the wrong behaviors, leading competition over collaboration. To shift incentives, the strategists mapped out changes needed throughout the research lifecycle, as illustrated on our home page from early proposal of a research project to assessment of its outcomes….”

ICOR’s Broadened Mission: Connecting efforts to build open collaborative research | ICOR

“There could not be a better time to announce the re-launch of ICOR’s website — extending its mission described in this blog post over a year ago — featuring real-world efforts by the open science community to build an evidence base and best practices. The site now features community organizations that are planning, implementing, and refining tools and practices with a common goal and with an eye toward standardization and collective action to build open collaborative science.

This coincides with the remarkable memo from the White House naming 2023 the Year of Open Science, and similar announcements from US federal agencies.

In a recent SPARC article, ICOR co-founder Sarah Greene said, “with a system to track and score open science practices…the potential impact on the pace of discovery is tremendous…it will change science, unimaginably.” ICOR is committed to building a strong foundation for open research, working with community-based projects such as persistent identifier and repository organizations, funders and publishers testing new models and policies, team science advocates, and open source tool builders creating ways to measure openness….”

Incentivizing Collaborative Open Research (ICOR) Envisions a Culture That Rewards Open Science – SPARC

“The sweeping movement towards open research has set in motion changes across funding bodies, institutions, and scholars. For open research to take off, sharing at all stages of the research cycle needs to be easy and the benefits explicitly recognized.

A new project is cataloguing best practices and promoting real incentives to work in the open, with the aim of improving reproducibility and accelerating outcomes to advance science.

Incentivizing Collaborative Open Research (ICOR) began in 2020 with discussions among a circle of 20 strategists led by Kristen Ratan, founder of Strategies for Open Science (Stratos) and Sarah Greene, founder of Rapid Science. The team set out to identify policies, tools, and practices that can be tested to provide evidence regarding the power of operating in the open. A goal of ICOR is to highlight pockets of innovation and to connect researchers with concrete practices that ease and improve their work in open science….”

The experiment begins: Arcadia publishing 1.0 · Reimagining scientific publishing

“In thinking about how to share Arcadia’s research, we wanted to keep features of traditional publishing that have been honed over centuries, but improve upon what hasn’t quite adapted to the nature of modern science and technology. We have a unique opportunity to use our own research to develop mechanisms of sharing and quality control that can be more agile and adaptable. Our initial attempt is outlined here and we will continue to iterate upon it, always keeping the advancement of knowledge as our guiding principle when making decisions on what to try next….

We are reimagining scientific publishing — sharing our work early and often, maximizing utility and reusability, and improving our science on the basis of public feedback.

This is our first draft. We have ambitious goals and we’re committed to replicable long-term solutions, but we also know that “perfection is the enemy of good.” We’re using this platform to release findings now rather than hiding them until we’ve gotten everything exactly how we want it. Readers can think of the pubs on this platform as drafts that will evolve over time, shaped by public feedback. The same goes for the platform itself! We’re treating our publishing project like an experiment — we’re not sure where we will land, but we can only learn if we try. In this pub, we’re sharing our strategy and the reasoning behind some of our key decisions, highlighting features we’re excited about and areas for improvement. …

Open by Design: Arcadia Science, pushing the boundaries of open research | ICOR

“Arcadia Science, a research and development institute, uses biology as our most advanced technology, experiments with the broadest range of research organisms, and is inclusive of all scientific sectors. Our scientists share their insights and discoveries for collective benefit, accelerating scientific progress and commercial utility. We are building a new model for research, one that is financially self-sustaining, to empower scientists to focus on their work and capture their own value, free from traditional constraints.

Our specific ICOR-related goals are to:

Publicly post research data and products early and often to improve reach and utility for the scientific community
Broaden the nature of what is communicated beyond the content and organization of a typical journal article (e.g. full data sets, protocols, informative failures, future directions, challenges that may be collaborative tackled)
Encourage use of our research products by the scientific community and encourage public discussion to improve it by soliciting open feedback
Document our lessons learned to encourage others to adopt successful practices for broader sharing and evaluation of research…”

Arcadia and ICOR: Experiments in Open Science

“With ICOR we will be working on distributed experiments for collective gain. Some of the key areas of alignment between Arcadia and ICOR are in:

 

Developing Open Science Best Practices: As we develop our open science program, we will contribute to ICOR’s library of guidelines, sharing our approach, our documentation, and our learnings.

Creating an IP Toolbox: We believe that open science and commercialization do not have to be mutually exclusive. Establishing a strong and creative IP strategy is essential for proving that open science can support and speed our commercial pursuits. We have already learned from the resources provided by ICOR and are working on developing agreements and means of tracking our progress, which we will share back with the community.

Building Research Output Management Systems (ROMS) and Using Persistent Identifiers (PIDs): Scientists have traditionally relied on journals and journal articles to house and disseminate their data, but the journal system wasn’t built with today’s diverse and ever-expanding datasets in mind. New systems are needed to share and organize scientific research. Arcadia is committed to using PIDs to facilitate discoverability and to depositing data in repositories that meet FAIR (Findability, Accessibility, Interoperability, and Reuse) principles. Working towards shared data schemas for all research outputs will help facilitate discussion, review, and reuse.

Facilitated Collaboration: Collaboration is central to Arcadia’s success, and we aim to collaborate widely while maintaining our commitment to open science. We are in the process of developing our Collaborator Agreement, and will work with ICOR to share it, to track its success and any necessary revisions.

Modular Data and Review: It is current standard practice to release data and solicit peer review at the end of a project. We believe that releasing data more frequently and gathering and integrating community feedback more often and earlier in a project’s lifespan will accelerate science and produce better results.

Tracking Nano-Contributions: Author lists on journal articles do not accurately reflect a scientist’s contribution to a project and can promote territorialism and competition, rather than collaboration. Arcadia will be developing new methods for mapping contributions. These methods will provide a richer, more substantive picture of a person’s contribution, and ICOR will aid in measuring and tracking the success of these methods.

Metrics of Utilization: Knowing if and how people are using the data you produce is key to providing a valuable resource for the community. As we develop our ROMS, we will incorporate meaningful metrics to track utilization and will learn how to improve our data products to increase accessibility and reuse. …”

Arcadia Science and ICOR: Testing radical open in the real world | ICOR

“As ICOR begins its work to accelerate collaboration and open scholarship by connecting and facilitating projects throughout the research life cycle, we are excited to be able to collaborate with Arcadia to test new strategies in an ambitious and radically open environment. These efforts will also move us toward our goal of building a body of evidence on the growing impact of collaboration and open scholarship practices, tools, metrics, and incentives….”

Introducing ICOR: Incentivizing Collaborative and Open Research | ICOR

“Early in 2020, several of us started ICOR, calling it a Strategic Circle, a gathering of open science advocates, funders, practitioners, and institutional leaders interested in taking constructive action to move the needle in increasing research transparency and accelerating breakthroughs. This group believes that open science practices are a crucial first step towards collaboration, which in turn leads to earlier and better research outcomes. These ideas were borne out through the pandemic and stages of vaccine research when researchers from around the globe shared data and worked together in real time. 

The Strategic Circle agreed that the use of publications and associated metrics was incentivizing the wrong behavior, leading to competition over collaboration and a slowing of research sharing in pursuit of acceptance by high impact journals. To shift incentives, the group mapped out changes needed throughout the research lifecycle, from early proposal, setup, and orientation to a project through to assessment of its findings and outcomes. 

Now, 18 months later, ICOR is taking shape as a series of projects that address different stages of research and propose concrete steps to improve speed, transparency, collaboration, and reuse of research. 

These projects are at different stages in their development and there are many opportunities to contribute, support, or follow along. We invite you to contact us to learn more and get involved! ”

Red to Green: From recommendations to action and evidence | ICOR

“Incentivizing Collaborative and Open Science (ICOR) is a group of open-research stakeholders who are building a new initiative designed to move from ideas into implementation. The newly launched website will serve as a communication hub for the growing number of projects planned and underway to improve transparency and collaboration throughout the research lifecycle. ICOR seeks to build a body of evidence, collecting data from individual pilots and projects, to help policy-makers and advocates build the case for open and collaborative research.

Over the past 18 months, ICOR has been gathering the collective knowledge of funders, researchers, organizations and academic administrators with similar goals about infusing openness and collaboration into all aspects of research. This group has strategized how to actively transform the status quo, closed research cycle to one that is inclusive, open, and collaborative. With the many emerging sets of recommendations and plans coming from governments, NGOs, and funding organizations, this is the time to take action and focus on implementation.

The opening page of IncentivizingOpen.org illustrates dynamically how we imagine moving from a mostly closed research cycle (Red) to a mostly open cycle (Green). We have identified opportunities that address impediments at each stage, as identified in recommendations by study groups and think tanks over the past two decades.

Ten unified projects – involving progressive and interdisciplinary research teams – are proposed to implement practical, real-life solutions involving tools and processes to build evidence for a culture of sharing and collaboration. We’ve checked off many of these urgencies as summarized in the latest UNESCO report on open science practices:…”

ICOR | Incentivizing Collaborative and Open Research

“Incentivizing Collaborative and Open Research (ICOR) envisions a culture that facilitates and rewards open science, which in turn enables collaboration and innovative, reproducible outcomes….

ICOR’s goals are to:

1. Build a body of evidence: have outcomes that can contribute to data on the practices of open and team science

2. Pilot for broader adoption: produce and gather projects that can be piloted within the institutions and funding organizations represented by this group and a network of ready supporters

3. Scale up and out: produce toolkits and action plans that can feasibly be implemented by the larger scientific establishment so that recognition schemes are meaningful on researchers’ career paths….”