
Contents
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Overview Overview
-
Preliminaries and Context Preliminaries and Context
-
Randomized Controlled Trials Improve Evidence for Policy Decisions Randomized Controlled Trials Improve Evidence for Policy Decisions
-
The Challenges of Interpreting the Results of Uncoordinated RCTs The Challenges of Interpreting the Results of Uncoordinated RCTs
-
-
Coordinated Evaluations Promise to Improve Policy Decisions Coordinated Evaluations Promise to Improve Policy Decisions
-
The Metaketa Model for Coordinated Experiments The Metaketa Model for Coordinated Experiments
-
A Practical Adaptation: The Rolling Metaketa Model A Practical Adaptation: The Rolling Metaketa Model
-
-
Tensions Inherent in Designing and Implementing Coordinated Studies Tensions Inherent in Designing and Implementing Coordinated Studies
-
Tension between Starting a New Coordinated Effort vs. Continuing to Invest in an Existing Effort Tension between Starting a New Coordinated Effort vs. Continuing to Invest in an Existing Effort
-
Tactics to help decision-makers evaluate this trade-off. Tactics to help decision-makers evaluate this trade-off.
-
-
Tension between Sticking with a Treatment Used Before (to Maximize Comparability) vs. Changing the Treatment to Allow Learning or to Be More Relevant to a Context Tension between Sticking with a Treatment Used Before (to Maximize Comparability) vs. Changing the Treatment to Allow Learning or to Be More Relevant to a Context
-
Tactics to help with the trade-off. Tactics to help with the trade-off.
-
-
Tension between Learning from Other Contexts vs. a Focus on One Place and Time Tension between Learning from Other Contexts vs. a Focus on One Place and Time
-
Tactics to help with the trade-off. Tactics to help with the trade-off.
-
-
Tension between Learning More about a Given Site vs. Learning More about How Sites Differ Tension between Learning More about a Given Site vs. Learning More about How Sites Differ
-
Tactics to help with the trade-off. Tactics to help with the trade-off.
-
-
-
Practical Challenges to Implementing Coordinated Research Strategies Practical Challenges to Implementing Coordinated Research Strategies
-
Tension between Long-Term Investment in Research and Immediate Investment in Programming Tension between Long-Term Investment in Research and Immediate Investment in Programming
-
Tactics to help with the trade-off. Tactics to help with the trade-off.
-
-
Tension (or Challenge) of Establishing High Fidelity When Replicating Models Tension (or Challenge) of Establishing High Fidelity When Replicating Models
-
Tactics to help with the trade-off. Tactics to help with the trade-off.
-
-
Tension (or Challenge) between the Incentives of Academics and the Incentives of Policy Decision-Makers Tension (or Challenge) between the Incentives of Academics and the Incentives of Policy Decision-Makers
-
Tactics to help with the trade-off. Tactics to help with the trade-off.
-
-
-
Devices to Make Design Reflect Policy Goals Devices to Make Design Reflect Policy Goals
-
Experimental Design Can Be Flexible and Reflect Policy Goals Experimental Design Can Be Flexible and Reflect Policy Goals
-
Communication and Record Keeping Are Key Communication and Record Keeping Are Key
-
-
Next Steps in Policy-Relevant Coordinated Experimentation? Next Steps in Policy-Relevant Coordinated Experimentation?
-
Acknowledgments Acknowledgments
-
References References
-
Notes Notes
-
Tensions in Knowledge Accumulation Using Coordinated Intervention Experiments to Improve Public Policy
Get accessDepartment of Political Science, University of Illinois at Urbana-Champaign
U.S. Department of State (Nothing in this paper should be taken to be the opinion of the U.S. government)
USAID (Nothing in this paper should be taken to be the opinion of the U.S. government)
Department of Political Science, University of California, Los Angeles
-
Published:20 June 2024
Cite
Abstract
This chapter has two main goals. It introduces and explains the value of coordinated randomized experiments for informing public policymaking with a special focus on international development, and then articulates tensions inherent in these coordinated experiments. It explains why coordination can help build the evidence base for policy innovation by helping funders and policymakers test existing theories of change in ways that facilitate the cumulation of knowledge across studies. It then articulates tensions or trade-offs that reasonable decision-makers might face given choices between coordinated and uncoordinated experiments, and provides some rough guides to help decision-makers navigate those tensions. We write from the perspective of encouraging coordinated experiments and offer practical alternatives that might be easier to implement than extant models for policy-oriented decision-makers.
Sign in
Personal account
- Sign in with email/username & password
- Get email alerts
- Save searches
- Purchase content
- Activate your purchase/trial code
- Add your ORCID iD
Purchase
Our books are available by subscription or purchase to libraries and institutions.
Purchasing informationMonth: | Total Views: |
---|---|
October 2024 | 17 |
November 2024 | 1 |
December 2024 | 4 |
January 2025 | 1 |
February 2025 | 1 |
March 2025 | 3 |
April 2025 | 2 |
Get help with access
Institutional access
Access to content on Oxford Academic is often provided through institutional subscriptions and purchases. If you are a member of an institution with an active account, you may be able to access content in one of the following ways:
IP based access
Typically, access is provided across an institutional network to a range of IP addresses. This authentication occurs automatically, and it is not possible to sign out of an IP authenticated account.
Sign in through your institution
Choose this option to get remote access when outside your institution. Shibboleth/Open Athens technology is used to provide single sign-on between your institution’s website and Oxford Academic.
If your institution is not listed or you cannot sign in to your institution’s website, please contact your librarian or administrator.
Sign in with a library card
Enter your library card number to sign in. If you cannot sign in, please contact your librarian.
Society Members
Society member access to a journal is achieved in one of the following ways:
Sign in through society site
Many societies offer single sign-on between the society website and Oxford Academic. If you see ‘Sign in through society site’ in the sign in pane within a journal:
If you do not have a society account or have forgotten your username or password, please contact your society.
Sign in using a personal account
Some societies use Oxford Academic personal accounts to provide access to their members. See below.
Personal account
A personal account can be used to get email alerts, save searches, purchase content, and activate subscriptions.
Some societies use Oxford Academic personal accounts to provide access to their members.
Viewing your signed in accounts
Click the account icon in the top right to:
Signed in but can't access content
Oxford Academic is home to a wide variety of products. The institutional subscription may not cover the content that you are trying to access. If you believe you should have access to that content, please contact your librarian.
Institutional account management
For librarians and administrators, your personal account also provides access to institutional account management. Here you will find options to view and activate subscriptions, manage institutional settings and access options, access usage statistics, and more.