Abstract

The increasing volume and richness of healthcare data collected during routine clinical practice have not yet translated into significant numbers of actionable insights that have systematically improved patient outcomes. An evidence-practice gap continues to exist in healthcare. We contest that this gap can be reduced by assessing the use of nudge theory as part of clinical decision support systems (CDSS). Deploying nudges to modify clinician behaviour and improve adherence to guideline-directed therapy represents an underused tool in bridging the evidence-practice gap. In conjunction with electronic health records (EHRs) and newer devices including artificial intelligence algorithms that are increasingly integrated within learning health systems, nudges such as CDSS alerts should be iteratively tested for all stakeholders involved in health decision-making: clinicians, researchers, and patients alike. Not only could they improve the implementation of known evidence, but the true value of nudging could lie in areas where traditional randomized controlled trials are lacking, and where clinical equipoise and variation dominate. The opportunity to test CDSS nudge alerts and their ability to standardize behaviour in the face of uncertainty may generate novel insights and improve patient outcomes in areas of clinical practice currently without a robust evidence base.

Schematic of a future learning health system with nudge, clinical decision support systems (CDSS), and artificial intelligence-powered analyses forming core parts of the learning cycle. Nudges within the CDSS can be used to either promote better adherence of guideline-directed therapy or test new hypotheses whenever there is clinical equipoise, identified through variation in clinical practice owing to the lack of robust evidence in that context. Although a simple A vs. B randomized controlled trial choice has been presented (fluid restriction vs. standard of care), multiple arms and an adaptive design could be built. Clinical outcomes could include patient-reported outcome measures. The presentation of nudges can be adjusted as new clinical insights are generated either within the local system or externally through data linkage. ACEi, angiotensin-converting enzyme inhibitor; GDT, guideline-directed therapy.
Graphical Abstract

Schematic of a future learning health system with nudge, clinical decision support systems (CDSS), and artificial intelligence-powered analyses forming core parts of the learning cycle. Nudges within the CDSS can be used to either promote better adherence of guideline-directed therapy or test new hypotheses whenever there is clinical equipoise, identified through variation in clinical practice owing to the lack of robust evidence in that context. Although a simple A vs. B randomized controlled trial choice has been presented (fluid restriction vs. standard of care), multiple arms and an adaptive design could be built. Clinical outcomes could include patient-reported outcome measures. The presentation of nudges can be adjusted as new clinical insights are generated either within the local system or externally through data linkage. ACEi, angiotensin-converting enzyme inhibitor; GDT, guideline-directed therapy.

Introduction

Decision-making in healthcare is under increasing scrutiny. As we enter an age of ubiquitous electronic health records (EHRs), clinical decision support systems (CDSS), and large, linked data sets with the potential to accommodate artificial intelligence (AI) algorithms, the need to better understand individual and collective decision-making has reached a critical point. In cardiovascular medicine, we anchor our decision-making to clinical guidelines. However, only a minority of recommendations within guidelines is based on Level A evidence and there remains variation in clinical practice.1 The increasing digitalization of healthcare provides the opportunity to systematically test and evaluate this variation across healthcare professionals within a learning healthcare framework.

In this review, we highlight the role of nudge theory and how better testing and evaluation of nudges as part of a learning health system (LHS)2 can improve decision-making and patient outcomes. Thaler and Sunstein3 defined nudge in 2008 as ‘choice architecture that alters people’s behaviour in a predictable way without forbidding any options or significantly changing their economic incentives’. While prominent examples include a traffic light system for the front of pack nutritional labelling (with healthier food choices in green and unhealthier food choices in red) or the addition of a ‘fly-shaped sticker’ in male urinals at Schiphol airport to reduce cleaning costs,3 nudges in healthcare are less notable—an example is given in Figure 1.

Nudge example in cardiovascular medicine. One recent example is taken from the AF-ALERT trial,4 which used a pop-up clinical decision support systems alert to nudge clinician behaviour whenever trigger conditions were met.
Figure 1

Nudge example in cardiovascular medicine. One recent example is taken from the AF-ALERT trial,4 which used a pop-up clinical decision support systems alert to nudge clinician behaviour whenever trigger conditions were met.

Despite its popularization over a decade ago, the testing and implementation of nudges within cardiovascular research and practice have been scarce compared with traditional topics such as basic sciences, translational medicine, and multicentre trials. Most of the literature has developed alongside the mass digitalization of healthcare.5 We, therefore, focus primarily on nudges as CDSS alerts and associated digital tools such as EHRs as a natural platform for their delivery. A sketch of the relationships between nudge, CDSS, and alerts is given in Figure 2.

Clinical decision support systems have a broad definition which could include a cumbersome number of entities—for instance, a poster on a wall could represent a form of clinical decision support. Most published literature of clinical decision support system in medical journals refers to either explicitly or implicitly a computerized version embedded within electronic health records, ranging in complexity from a simple reminder alert or highlight of a laboratory result, to default medication listing and dosing.6 CDSS, clinical decision support system; CPOE, computerized provider order entry; EHR, electronic health record.
Figure 2

Clinical decision support systems have a broad definition which could include a cumbersome number of entities—for instance, a poster on a wall could represent a form of clinical decision support. Most published literature of clinical decision support system in medical journals refers to either explicitly or implicitly a computerized version embedded within electronic health records, ranging in complexity from a simple reminder alert or highlight of a laboratory result, to default medication listing and dosing.6 CDSS, clinical decision support system; CPOE, computerized provider order entry; EHR, electronic health record.

We draw distinction between the use of CDSS alone and applying nudges as part of their design. For example, while CDSS alerts are a form of nudging, simple default states within EHRs, e.g. an alphabetized list of medications as part of an electronic prescription order, are not explicitly ‘nudge interventions’ unless the design of a default state is deliberate. However, even incidental designs can have consequences—in this case, with effects on prescribing patterns.7 A broad classification of nudge types are included as part of the Supplemental material online, though any aspect of an EHR-based platform can impact on decision-making. The careful and explicit study of their design, including nudges, and their influence on clinical behaviour and outcomes has been largely missing.

Nudging in areas with the known and unknown evidence base

Our central argument is that the routine use of nudges in healthcare can improve decision-making and outcomes through two distinct routes: (i) by reducing the evidence-practice gap through improved adherence to guideline-directed therapy (GDT) and (ii) by generating novel insights.

  • While ‘bench to bedside’8 has improved patient outcomes through the translation of basic science discovery to clinical trials, this paradigm alone is not enough. By extending the concept ‘from bench to bedside, to patient and population’,9 an additional evidence-practice gap emerges, defined as the suboptimal choices we make, as providers, policymakers, and also as patients. This can affect large groups of individuals depending on the context. For example, in a recent multinational analysis of heart failure prescriptions, fewer than one in five patients achieved target doses of evidence-based medications.10 Nudges theory can play a central role in bridging this gap.11

  • Nudges can also lead to the generation of new clinical knowledge insights, when deployed in settings of clinical equipoise. Here, the ability of nudges to shape behaviour towards a more uniform course of action may uncover meaningful effects on patient outcomes in areas that lack a robust evidence base and have large variations in current practice. In particular, the testing of clinician-facing CDSS nudge alerts as interventions as part of randomized controlled trials will allow the true potential of nudge impact to be realized.

A summary of key considerations in these two scenarios is presented in Table 1, alongside a schematic representation in the Graphical Abstract.

Table 1

Characteristics of nudges for guideline adherence and for knowledge generation

Target audienceExampleAim of nudgePre-requisitesAdherence
Nudges where evidence is knownClinicians, patients
  • AF-ALERT trial

  • EPIC-HF trial

Deterministic—to reach the recognized standard/best practice, with recognized action to takeNeed prior knowledge and data quality to applyDesirable to be adherent as it moves behaviour (either clinician or patient) towards beneficial outcomes for patients
Nudges where evidence is not knownClinicians, researchers
  • REVeAL-HF trial

  • Trial of a nudge for fluid restriction in acute heart failure

Stochastic—to generate evidence through a randomized controlled trial, either with recognized action or with open-ended actionsNeed prior equipoise to applyNon-compliance is an essential component—supports safety of intervention as clinicians can exercise their own judgements, whether to adhere to the randomized allocation, and what actions are required to be taken [either a nudge with closed suggestion (fluid restrict) or with open-ended suggestion (REVeAL-HF)]
Target audienceExampleAim of nudgePre-requisitesAdherence
Nudges where evidence is knownClinicians, patients
  • AF-ALERT trial

  • EPIC-HF trial

Deterministic—to reach the recognized standard/best practice, with recognized action to takeNeed prior knowledge and data quality to applyDesirable to be adherent as it moves behaviour (either clinician or patient) towards beneficial outcomes for patients
Nudges where evidence is not knownClinicians, researchers
  • REVeAL-HF trial

  • Trial of a nudge for fluid restriction in acute heart failure

Stochastic—to generate evidence through a randomized controlled trial, either with recognized action or with open-ended actionsNeed prior equipoise to applyNon-compliance is an essential component—supports safety of intervention as clinicians can exercise their own judgements, whether to adhere to the randomized allocation, and what actions are required to be taken [either a nudge with closed suggestion (fluid restrict) or with open-ended suggestion (REVeAL-HF)]

Deploying nudges where evidence is known includes in circumstances when they aid guideline-directed therapy. This can be viewed as quality improvement and may form part of multi-faceted interventions including education of staff, audit, and feedback. Deploying nudges where evidence is not known will generate knowledge and requires clinical equipoise and randomization in order to generate novel insights which may be generalizable to multiple contexts.

Table 1

Characteristics of nudges for guideline adherence and for knowledge generation

Target audienceExampleAim of nudgePre-requisitesAdherence
Nudges where evidence is knownClinicians, patients
  • AF-ALERT trial

  • EPIC-HF trial

Deterministic—to reach the recognized standard/best practice, with recognized action to takeNeed prior knowledge and data quality to applyDesirable to be adherent as it moves behaviour (either clinician or patient) towards beneficial outcomes for patients
Nudges where evidence is not knownClinicians, researchers
  • REVeAL-HF trial

  • Trial of a nudge for fluid restriction in acute heart failure

Stochastic—to generate evidence through a randomized controlled trial, either with recognized action or with open-ended actionsNeed prior equipoise to applyNon-compliance is an essential component—supports safety of intervention as clinicians can exercise their own judgements, whether to adhere to the randomized allocation, and what actions are required to be taken [either a nudge with closed suggestion (fluid restrict) or with open-ended suggestion (REVeAL-HF)]
Target audienceExampleAim of nudgePre-requisitesAdherence
Nudges where evidence is knownClinicians, patients
  • AF-ALERT trial

  • EPIC-HF trial

Deterministic—to reach the recognized standard/best practice, with recognized action to takeNeed prior knowledge and data quality to applyDesirable to be adherent as it moves behaviour (either clinician or patient) towards beneficial outcomes for patients
Nudges where evidence is not knownClinicians, researchers
  • REVeAL-HF trial

  • Trial of a nudge for fluid restriction in acute heart failure

Stochastic—to generate evidence through a randomized controlled trial, either with recognized action or with open-ended actionsNeed prior equipoise to applyNon-compliance is an essential component—supports safety of intervention as clinicians can exercise their own judgements, whether to adhere to the randomized allocation, and what actions are required to be taken [either a nudge with closed suggestion (fluid restrict) or with open-ended suggestion (REVeAL-HF)]

Deploying nudges where evidence is known includes in circumstances when they aid guideline-directed therapy. This can be viewed as quality improvement and may form part of multi-faceted interventions including education of staff, audit, and feedback. Deploying nudges where evidence is not known will generate knowledge and requires clinical equipoise and randomization in order to generate novel insights which may be generalizable to multiple contexts.

The existing evidence for CDSS impact was the subject of a recent meta-analysis—of more than 100 heterogeneous studies analysed, there was a significant 6% improvement in the proportion of patients receiving desired care.12 However, this work only examined CDSS use for improving guideline and process adherence. There was a lack of focus given to descriptions of the human–computer interface, including elements such as degree of clinician involvement and acceptability among different user groups. A future LHS will be one which can routinely deploy nudges within CDSS and better understand why adherence to their recommendations may vary according to clinician and context. Co-design with frontline clinicians as well as clinical leaders will be crucial in order to ensure credibility in their testing and use. In doing so, synchronous progression of our understanding of the ‘user stream of knowledge’ and learning from responses to CDSS nudges,6 can occur alongside increases in knowledge of disease and use of treatments through EHR-based phenotyping and variations in clinical practice.13

As clinicians increasingly spend their working lives directly interacting with EHRs and CDSS as part of patient care,14 studies that examine how to best deploy CDSS alerts and which nudges may modify clinicians’ behaviour in the most effective manner, will be of increasing value.

As of November 2021, there are 41 systematic reviews registered on PROSPERO which include ‘nudge’,15 and only 21 papers returned from a search of ‘nudge’ and ‘cardiology’ on PubMed.16 Of the above results, only one review was directly related to Cardiology and few primary research studies used ‘nudge’ as a term. Current research practice perhaps reflects ‘nudge hesitancy’ within the cardiovascular disease field as well as inconsistency in its definition and reported use. For example, work may not explicitly be labelled by the term nudge and the term alert is often used interchangeably.

This contrasts with their potential efficacy on an aggregate level—in a study of Cochrane systematic reviews, 42 trials of nudge strategies for clinician implementation of guidelines determined an effect in 86% of studies in the hypothesized direction, with more than half of those being statistically significant.17 However, a narrower 2021 scoping review which focused on interventions explicitly identified as nudges found 22 studies of mixed benefit18 with more detailed descriptions of the factors underpinning study designs that had a significant effect on their overall result, including prominence of choices; predisposition to social norms; and clinician workflow impacts. Thus within the limited evidence base, nudge designs have been evaluated using familiar tools such as randomized controlled trials (RCTs), though it is the nudge use for guideline adherence that predominates. Important contextual factors are inconsistently considered during their implementation.

Nudges as blockbuster intervention

Evidence-based medicine through international multicentre randomized clinical trials have guided the practice of cardiovascular medicine and generated blockbuster results, ultimately embodied and communicated in the form of practice-changing guidelines.19–21 However, the lack of attention paid to evaluating the decision-making of clinicians and patients represents a significant asymmetry. As a result, there is an untapped opportunity for our community to make step change improvements in cardiovascular care, through greater testing of nudge interventions and their effect on clinical decision-making. The magnitude of the potential benefits can be profound, as seen when comparing head-to-head the top-end effect size of a successful nudge, with the most prominent recent blockbusters in medicine (Table 2).4,22–24

Table 2

Effect sizes of blockbuster drugs and a recent nudge

AuthorInterventionEffect size compared with standard of care at time
McMurray et al.22Sacubitril/valsartan novel drug in patients with heart failure20% relative improvement
Keeley et al.23Primary angioplasty in acute MI22% relative improvement
RECOVERY Collaborative Group24Dexamethasone in severe COVID-19 pneumonia18–36% relative improvement depending on illness severity
Piazza et al.4CDSS alert to increase anticoagulation in high-risk hospitalized AF patients55% relative improvementa
AuthorInterventionEffect size compared with standard of care at time
McMurray et al.22Sacubitril/valsartan novel drug in patients with heart failure20% relative improvement
Keeley et al.23Primary angioplasty in acute MI22% relative improvement
RECOVERY Collaborative Group24Dexamethasone in severe COVID-19 pneumonia18–36% relative improvement depending on illness severity
Piazza et al.4CDSS alert to increase anticoagulation in high-risk hospitalized AF patients55% relative improvementa

AF, atrial fibrillation; CDSS, clinical decision support system; COVID-9, coronavirus disease 2019; MI, myocardial infarction.

a

Event rates and outcomes measured are omitted. These papers have been discussed at length in the literature and the focus of this comparison is to highlight the possibilities of nudges being equal in relative effect to any blockbuster, depending on the research context.

Table 2

Effect sizes of blockbuster drugs and a recent nudge

AuthorInterventionEffect size compared with standard of care at time
McMurray et al.22Sacubitril/valsartan novel drug in patients with heart failure20% relative improvement
Keeley et al.23Primary angioplasty in acute MI22% relative improvement
RECOVERY Collaborative Group24Dexamethasone in severe COVID-19 pneumonia18–36% relative improvement depending on illness severity
Piazza et al.4CDSS alert to increase anticoagulation in high-risk hospitalized AF patients55% relative improvementa
AuthorInterventionEffect size compared with standard of care at time
McMurray et al.22Sacubitril/valsartan novel drug in patients with heart failure20% relative improvement
Keeley et al.23Primary angioplasty in acute MI22% relative improvement
RECOVERY Collaborative Group24Dexamethasone in severe COVID-19 pneumonia18–36% relative improvement depending on illness severity
Piazza et al.4CDSS alert to increase anticoagulation in high-risk hospitalized AF patients55% relative improvementa

AF, atrial fibrillation; CDSS, clinical decision support system; COVID-9, coronavirus disease 2019; MI, myocardial infarction.

a

Event rates and outcomes measured are omitted. These papers have been discussed at length in the literature and the focus of this comparison is to highlight the possibilities of nudges being equal in relative effect to any blockbuster, depending on the research context.

A key caveat to the above comparison is that most nudge studies report process measures instead of hard clinical outcomes, although the reference for the AF-ALERT study4 included in Table 2 is deliberate. While currently an outlier, it represents a precedent for future nudge studies to aim for impact on clinical outcomes. A missing element from the table is that of financial costs and cost-effectiveness—an area where nudges deployed within EHRs will out-compete traditional RCTs many times over.2

Wielding the right tools to evaluate nudge

In terms of widespread testing, previous economic and technical barriers to studying and deploying nudge on a large scale are now surmountable. Over 90% of US hospitals had computerized health records by the mid-2010s25 and globally, lower and middle-income countries are continuing their progress towards digitalization.26 The increasing availability and sophistry of EHRs mean that it is now possible for many more healthcare systems to not only accurately codify clinical details, but also elements of human factors that have traditionally been unattended to, such as quantifying the confidence of decision-making in real time, and how this may be linked to the selection of a particular diagnosis or treatment.27 The implications of subsequently using nudges to steer clinicians towards certain decisions in the face of uncertainty and to modify them in real time as evidence accumulates of clinician preferences and clinical outcomes represent novelties that should form the crux of the future LHS.

Thus, while human factors research in medicine has primarily focused on safety in the form of checklists28 or shift patterns,29 the ability to test other hypotheses as part of CDSS nudges embedded within the EHR can now be realized. The challenge will be one of prioritization, and in which clinical settings CDSS nudges should be tested first. Just as with the checklist literature, accepting that effects of local context can predominate over replicability of action would enable us to move beyond the moot ‘nudges do/don’t work’ commentaries seen within the checklist literature.30

Examples of nudge in the cardiovascular field

There are several nudge trials within cardiovascular medicine, though they remain rare. A scoping search for relevant RCTs was conducted (see Supplementary material online, Appendix S2). We focus on three selected examples to illustrate key principles relevant for all current and future studies and list additional relevant studies in Table 3. The REVeAL-HF trial31 represents the latest addition to the field. Having recruited over 3000 patients within 1 year at a single healthcare system, the REVeAL-HF team demonstrated that such pragmatic trials are feasible. The nudge intervention consisted of changing the choice architecture of the EHR to display a 1-year mortality risk for patients admitted with heart failure (modelled from data generated within the EHR). The hypothesis tested was whether the display of this novel information affected downstream clinical decision-making such as the use of heart failure pharmacotherapies, onwards referrals to palliative care, and clinical outcomes including rehospitalizations and 1-year mortality. Although the trial demonstrated no overall effect for the CDSS nudge,41 several aspects of the study are worth noting for future endeavours: the description of CDSS testing to preserve computing speeds of the EHR platform via ‘run in’ periods; the detail of the alert design, including features such as font colour and data visualization; and engagement with clinical teams including pre-trial education at departmental meetings and opportunities for feedback to optimize the alert design. The ambition to generate novel insights rather than targeting the more traditional goal of improved guideline adherence represents a novel contribution in spite of the neutral result. The study authors have speculated that a nudge intervention more closely coupled to clinical actions could have made a difference to outcomes, rather than the supply of additional prognostic information alone. One missed opportunity was the discussion of whether clinicians accepted the accuracy of the prognostic algorithm within the CDSS alert. Would clinicians have been more likely to change their behaviour if they demonstrably trusted the accuracy of the model? Could trust be improved through a more explainable algorithm?42 And how can issues of algorithm aversion be planned for in future studies and practice, where professional ‘gut instinct’ may dominate an algorithm’s (superior) recommendation.43

Table 3

List of selected studies and registered randomized controlled trials relating to nudge in cardiovascular medicine

TrialStudy contextNudgeResult
REVeAL-HF
NCT03845660
Knowledge generating
RCT conducted in hospitalized heart failure patients to determine the effect of alert on downstream clinical decision-making (N = 3124)CDSS nudge alert presented to clinicians of an estimated 1-year mortality for admitted patientsNo difference in primary clinical endpoint (composite of all-cause mortality or rehospitalization)
AF-ALERT
NCT02339493
Guideline directed
RCT conducted in patients with AF who were hospitalized but not prescribed anticoagulant therapy at the time of recruitment (N = 458)CDSS nudge alert presented to clinicians which calculated the ChadsVasc score and recommended prescription of anticoagulantPatients in alert group had 16.3% absolute increase in anticoagulation prescription during hospitalization and reduced the 90-day composite endpoint of death, MI, CVA, and systemic embolic event by 10.6%
Active Choice in the EHR to Promote Statin Therapy
NCT03271931
Guideline directed
Cluster RCT of alerts within the EHR for guideline-directed statin prescriptions in high-risk CVD patients using a three-arm design. (N = 11 693)CDSS nudge alert presented to clinicians whenever a patient met eligibility criteria, according to ASCVD risk score or structured clinical diagnosis. An appropriate dose of atorvastatin was pre-selectedNeither active nor passive alerts increased optimum dose statin prescription rates compared with a baseline of 40.3%
Electronic Warning System for Atrial Fibrillation
NCT02455102
Guideline directed
RCT of alerts within the EHR to improve anticoagulation prescription among hospitalized patients with AF (N = 889)CDSS nudge alert presented to clinicians which identified AF in structured and free-text entries, advised clinician to confirm the presence of AF, calculate the CHA2DS2-VASc, and to prescribe anticoagulation in indicatedRelative increase in adequate prescription rates by 38% compared with the control group
PRESCRIBE
NCT03021759
Guideline directed
Cluster RCT of a clinician-facing automated patient dashboard intervention on guideline-directed prescription of statin therapy (N = 4774)Email nudge to primary care physicians with a link to a dashboard that listed patients eligible for stain prescription. Included reminders with peer review performance in the second intervention armSignificant increase in statin prescription in the intervention arm, by between 4 and 6% depending on nudge alone vs. nudge with peer comparison
ACTIVE-REWARD
NCT02531022
Guideline directed
RCT in patients with ischaemic heart disease. Four-month intervention aimed at increasing physical activity (N = 105)Wearable tracker, with daily nudge and feedback and small financial incentives if targets metCompared with the standard of care, patients in the intervention arm had significant increase in daily steps taken during trial and follow-up (more than 1000 steps vs. control)
ENCOURAGE
NCT02490423
Guideline directed
RCT in patients seen within Cardiology clinics with an indication for statin therapy. Over a 12-month period (N = 182)Multiple nudges sent across email, text, and telephone calls using AI to adapt their messaging and integration to individual home circumstancesCompared with the standard of care, adherence to statins increased by significant amount, more than 10% absolute increase in days covered
EPIC-HF
NCT03334188
Guideline directed
RCT of patients with HFREF seen at a scheduled cardiology clinic who were not on optimal doses of guideline-directed therapy (N = 306)Patient-facing nudge which was an activation tool that included video content and a one-page checklistCompared with the standard of care, 20% absolute increase in number of patients experiencing initiation or intensification of GDMT
Effectiveness of Financial Incentives and Text Messages to Improve Health Care in Population With Moderate and High Cardiovascular Risk
NCT03300154
Guideline directed
Cluster RCT conducted in primary care clinics in Argentina, three-arm trial comparing usual care with financial incentives or framing text messages to increase clinic attendance of patients at high risk of cardiovascular disease (>10% in 10 years). N = 917Patient-facing $10 food voucher to attend first clinic and enrolment into a lottery for subsequent clinic visit; OR nudges via text messages with standard message highlighting the benefit of healthcare sent weeklyFinancial incentives group 25% absolute increase in attendance for first follow-up and 18% increase for second. Framing text messages, no significant difference
PROMPT-HF
NCT04514458
Guideline directed
Cluster RCT of tailored alerts within the EHR to improve guideline-directed medical therapy for HFREF patientsNudge CDSS alert aimed at clinicians, to prescribe or intensify doses of beta-blockers, ACEi/ARB/ARNI, MRA, and SGLT2iIn recruitment
NUDGE NCT03973931
Guideline directed
RCT of a patient-facing nudge, to encourage medication adherence across multitude of cardiovascular conditionsText message-based generic or tailored nudgesRecruiting
NCT03834155
Guideline directed
RCT of a clinician and patient-facing nudge, to encourage enrolment into cardiac rehabilitationNudge via one-page decision aid tool, text messages, and appRecruiting
TrialStudy contextNudgeResult
REVeAL-HF
NCT03845660
Knowledge generating
RCT conducted in hospitalized heart failure patients to determine the effect of alert on downstream clinical decision-making (N = 3124)CDSS nudge alert presented to clinicians of an estimated 1-year mortality for admitted patientsNo difference in primary clinical endpoint (composite of all-cause mortality or rehospitalization)
AF-ALERT
NCT02339493
Guideline directed
RCT conducted in patients with AF who were hospitalized but not prescribed anticoagulant therapy at the time of recruitment (N = 458)CDSS nudge alert presented to clinicians which calculated the ChadsVasc score and recommended prescription of anticoagulantPatients in alert group had 16.3% absolute increase in anticoagulation prescription during hospitalization and reduced the 90-day composite endpoint of death, MI, CVA, and systemic embolic event by 10.6%
Active Choice in the EHR to Promote Statin Therapy
NCT03271931
Guideline directed
Cluster RCT of alerts within the EHR for guideline-directed statin prescriptions in high-risk CVD patients using a three-arm design. (N = 11 693)CDSS nudge alert presented to clinicians whenever a patient met eligibility criteria, according to ASCVD risk score or structured clinical diagnosis. An appropriate dose of atorvastatin was pre-selectedNeither active nor passive alerts increased optimum dose statin prescription rates compared with a baseline of 40.3%
Electronic Warning System for Atrial Fibrillation
NCT02455102
Guideline directed
RCT of alerts within the EHR to improve anticoagulation prescription among hospitalized patients with AF (N = 889)CDSS nudge alert presented to clinicians which identified AF in structured and free-text entries, advised clinician to confirm the presence of AF, calculate the CHA2DS2-VASc, and to prescribe anticoagulation in indicatedRelative increase in adequate prescription rates by 38% compared with the control group
PRESCRIBE
NCT03021759
Guideline directed
Cluster RCT of a clinician-facing automated patient dashboard intervention on guideline-directed prescription of statin therapy (N = 4774)Email nudge to primary care physicians with a link to a dashboard that listed patients eligible for stain prescription. Included reminders with peer review performance in the second intervention armSignificant increase in statin prescription in the intervention arm, by between 4 and 6% depending on nudge alone vs. nudge with peer comparison
ACTIVE-REWARD
NCT02531022
Guideline directed
RCT in patients with ischaemic heart disease. Four-month intervention aimed at increasing physical activity (N = 105)Wearable tracker, with daily nudge and feedback and small financial incentives if targets metCompared with the standard of care, patients in the intervention arm had significant increase in daily steps taken during trial and follow-up (more than 1000 steps vs. control)
ENCOURAGE
NCT02490423
Guideline directed
RCT in patients seen within Cardiology clinics with an indication for statin therapy. Over a 12-month period (N = 182)Multiple nudges sent across email, text, and telephone calls using AI to adapt their messaging and integration to individual home circumstancesCompared with the standard of care, adherence to statins increased by significant amount, more than 10% absolute increase in days covered
EPIC-HF
NCT03334188
Guideline directed
RCT of patients with HFREF seen at a scheduled cardiology clinic who were not on optimal doses of guideline-directed therapy (N = 306)Patient-facing nudge which was an activation tool that included video content and a one-page checklistCompared with the standard of care, 20% absolute increase in number of patients experiencing initiation or intensification of GDMT
Effectiveness of Financial Incentives and Text Messages to Improve Health Care in Population With Moderate and High Cardiovascular Risk
NCT03300154
Guideline directed
Cluster RCT conducted in primary care clinics in Argentina, three-arm trial comparing usual care with financial incentives or framing text messages to increase clinic attendance of patients at high risk of cardiovascular disease (>10% in 10 years). N = 917Patient-facing $10 food voucher to attend first clinic and enrolment into a lottery for subsequent clinic visit; OR nudges via text messages with standard message highlighting the benefit of healthcare sent weeklyFinancial incentives group 25% absolute increase in attendance for first follow-up and 18% increase for second. Framing text messages, no significant difference
PROMPT-HF
NCT04514458
Guideline directed
Cluster RCT of tailored alerts within the EHR to improve guideline-directed medical therapy for HFREF patientsNudge CDSS alert aimed at clinicians, to prescribe or intensify doses of beta-blockers, ACEi/ARB/ARNI, MRA, and SGLT2iIn recruitment
NUDGE NCT03973931
Guideline directed
RCT of a patient-facing nudge, to encourage medication adherence across multitude of cardiovascular conditionsText message-based generic or tailored nudgesRecruiting
NCT03834155
Guideline directed
RCT of a clinician and patient-facing nudge, to encourage enrolment into cardiac rehabilitationNudge via one-page decision aid tool, text messages, and appRecruiting

Note the split between clinician and patient-facing nudges and the use of digital platforms beyond the EHR for the latter group, including the use of mobile phones and video media.4,31–40

Table 3

List of selected studies and registered randomized controlled trials relating to nudge in cardiovascular medicine

TrialStudy contextNudgeResult
REVeAL-HF
NCT03845660
Knowledge generating
RCT conducted in hospitalized heart failure patients to determine the effect of alert on downstream clinical decision-making (N = 3124)CDSS nudge alert presented to clinicians of an estimated 1-year mortality for admitted patientsNo difference in primary clinical endpoint (composite of all-cause mortality or rehospitalization)
AF-ALERT
NCT02339493
Guideline directed
RCT conducted in patients with AF who were hospitalized but not prescribed anticoagulant therapy at the time of recruitment (N = 458)CDSS nudge alert presented to clinicians which calculated the ChadsVasc score and recommended prescription of anticoagulantPatients in alert group had 16.3% absolute increase in anticoagulation prescription during hospitalization and reduced the 90-day composite endpoint of death, MI, CVA, and systemic embolic event by 10.6%
Active Choice in the EHR to Promote Statin Therapy
NCT03271931
Guideline directed
Cluster RCT of alerts within the EHR for guideline-directed statin prescriptions in high-risk CVD patients using a three-arm design. (N = 11 693)CDSS nudge alert presented to clinicians whenever a patient met eligibility criteria, according to ASCVD risk score or structured clinical diagnosis. An appropriate dose of atorvastatin was pre-selectedNeither active nor passive alerts increased optimum dose statin prescription rates compared with a baseline of 40.3%
Electronic Warning System for Atrial Fibrillation
NCT02455102
Guideline directed
RCT of alerts within the EHR to improve anticoagulation prescription among hospitalized patients with AF (N = 889)CDSS nudge alert presented to clinicians which identified AF in structured and free-text entries, advised clinician to confirm the presence of AF, calculate the CHA2DS2-VASc, and to prescribe anticoagulation in indicatedRelative increase in adequate prescription rates by 38% compared with the control group
PRESCRIBE
NCT03021759
Guideline directed
Cluster RCT of a clinician-facing automated patient dashboard intervention on guideline-directed prescription of statin therapy (N = 4774)Email nudge to primary care physicians with a link to a dashboard that listed patients eligible for stain prescription. Included reminders with peer review performance in the second intervention armSignificant increase in statin prescription in the intervention arm, by between 4 and 6% depending on nudge alone vs. nudge with peer comparison
ACTIVE-REWARD
NCT02531022
Guideline directed
RCT in patients with ischaemic heart disease. Four-month intervention aimed at increasing physical activity (N = 105)Wearable tracker, with daily nudge and feedback and small financial incentives if targets metCompared with the standard of care, patients in the intervention arm had significant increase in daily steps taken during trial and follow-up (more than 1000 steps vs. control)
ENCOURAGE
NCT02490423
Guideline directed
RCT in patients seen within Cardiology clinics with an indication for statin therapy. Over a 12-month period (N = 182)Multiple nudges sent across email, text, and telephone calls using AI to adapt their messaging and integration to individual home circumstancesCompared with the standard of care, adherence to statins increased by significant amount, more than 10% absolute increase in days covered
EPIC-HF
NCT03334188
Guideline directed
RCT of patients with HFREF seen at a scheduled cardiology clinic who were not on optimal doses of guideline-directed therapy (N = 306)Patient-facing nudge which was an activation tool that included video content and a one-page checklistCompared with the standard of care, 20% absolute increase in number of patients experiencing initiation or intensification of GDMT
Effectiveness of Financial Incentives and Text Messages to Improve Health Care in Population With Moderate and High Cardiovascular Risk
NCT03300154
Guideline directed
Cluster RCT conducted in primary care clinics in Argentina, three-arm trial comparing usual care with financial incentives or framing text messages to increase clinic attendance of patients at high risk of cardiovascular disease (>10% in 10 years). N = 917Patient-facing $10 food voucher to attend first clinic and enrolment into a lottery for subsequent clinic visit; OR nudges via text messages with standard message highlighting the benefit of healthcare sent weeklyFinancial incentives group 25% absolute increase in attendance for first follow-up and 18% increase for second. Framing text messages, no significant difference
PROMPT-HF
NCT04514458
Guideline directed
Cluster RCT of tailored alerts within the EHR to improve guideline-directed medical therapy for HFREF patientsNudge CDSS alert aimed at clinicians, to prescribe or intensify doses of beta-blockers, ACEi/ARB/ARNI, MRA, and SGLT2iIn recruitment
NUDGE NCT03973931
Guideline directed
RCT of a patient-facing nudge, to encourage medication adherence across multitude of cardiovascular conditionsText message-based generic or tailored nudgesRecruiting
NCT03834155
Guideline directed
RCT of a clinician and patient-facing nudge, to encourage enrolment into cardiac rehabilitationNudge via one-page decision aid tool, text messages, and appRecruiting
TrialStudy contextNudgeResult
REVeAL-HF
NCT03845660
Knowledge generating
RCT conducted in hospitalized heart failure patients to determine the effect of alert on downstream clinical decision-making (N = 3124)CDSS nudge alert presented to clinicians of an estimated 1-year mortality for admitted patientsNo difference in primary clinical endpoint (composite of all-cause mortality or rehospitalization)
AF-ALERT
NCT02339493
Guideline directed
RCT conducted in patients with AF who were hospitalized but not prescribed anticoagulant therapy at the time of recruitment (N = 458)CDSS nudge alert presented to clinicians which calculated the ChadsVasc score and recommended prescription of anticoagulantPatients in alert group had 16.3% absolute increase in anticoagulation prescription during hospitalization and reduced the 90-day composite endpoint of death, MI, CVA, and systemic embolic event by 10.6%
Active Choice in the EHR to Promote Statin Therapy
NCT03271931
Guideline directed
Cluster RCT of alerts within the EHR for guideline-directed statin prescriptions in high-risk CVD patients using a three-arm design. (N = 11 693)CDSS nudge alert presented to clinicians whenever a patient met eligibility criteria, according to ASCVD risk score or structured clinical diagnosis. An appropriate dose of atorvastatin was pre-selectedNeither active nor passive alerts increased optimum dose statin prescription rates compared with a baseline of 40.3%
Electronic Warning System for Atrial Fibrillation
NCT02455102
Guideline directed
RCT of alerts within the EHR to improve anticoagulation prescription among hospitalized patients with AF (N = 889)CDSS nudge alert presented to clinicians which identified AF in structured and free-text entries, advised clinician to confirm the presence of AF, calculate the CHA2DS2-VASc, and to prescribe anticoagulation in indicatedRelative increase in adequate prescription rates by 38% compared with the control group
PRESCRIBE
NCT03021759
Guideline directed
Cluster RCT of a clinician-facing automated patient dashboard intervention on guideline-directed prescription of statin therapy (N = 4774)Email nudge to primary care physicians with a link to a dashboard that listed patients eligible for stain prescription. Included reminders with peer review performance in the second intervention armSignificant increase in statin prescription in the intervention arm, by between 4 and 6% depending on nudge alone vs. nudge with peer comparison
ACTIVE-REWARD
NCT02531022
Guideline directed
RCT in patients with ischaemic heart disease. Four-month intervention aimed at increasing physical activity (N = 105)Wearable tracker, with daily nudge and feedback and small financial incentives if targets metCompared with the standard of care, patients in the intervention arm had significant increase in daily steps taken during trial and follow-up (more than 1000 steps vs. control)
ENCOURAGE
NCT02490423
Guideline directed
RCT in patients seen within Cardiology clinics with an indication for statin therapy. Over a 12-month period (N = 182)Multiple nudges sent across email, text, and telephone calls using AI to adapt their messaging and integration to individual home circumstancesCompared with the standard of care, adherence to statins increased by significant amount, more than 10% absolute increase in days covered
EPIC-HF
NCT03334188
Guideline directed
RCT of patients with HFREF seen at a scheduled cardiology clinic who were not on optimal doses of guideline-directed therapy (N = 306)Patient-facing nudge which was an activation tool that included video content and a one-page checklistCompared with the standard of care, 20% absolute increase in number of patients experiencing initiation or intensification of GDMT
Effectiveness of Financial Incentives and Text Messages to Improve Health Care in Population With Moderate and High Cardiovascular Risk
NCT03300154
Guideline directed
Cluster RCT conducted in primary care clinics in Argentina, three-arm trial comparing usual care with financial incentives or framing text messages to increase clinic attendance of patients at high risk of cardiovascular disease (>10% in 10 years). N = 917Patient-facing $10 food voucher to attend first clinic and enrolment into a lottery for subsequent clinic visit; OR nudges via text messages with standard message highlighting the benefit of healthcare sent weeklyFinancial incentives group 25% absolute increase in attendance for first follow-up and 18% increase for second. Framing text messages, no significant difference
PROMPT-HF
NCT04514458
Guideline directed
Cluster RCT of tailored alerts within the EHR to improve guideline-directed medical therapy for HFREF patientsNudge CDSS alert aimed at clinicians, to prescribe or intensify doses of beta-blockers, ACEi/ARB/ARNI, MRA, and SGLT2iIn recruitment
NUDGE NCT03973931
Guideline directed
RCT of a patient-facing nudge, to encourage medication adherence across multitude of cardiovascular conditionsText message-based generic or tailored nudgesRecruiting
NCT03834155
Guideline directed
RCT of a clinician and patient-facing nudge, to encourage enrolment into cardiac rehabilitationNudge via one-page decision aid tool, text messages, and appRecruiting

Note the split between clinician and patient-facing nudges and the use of digital platforms beyond the EHR for the latter group, including the use of mobile phones and video media.4,31–40

The issue of trust and understanding of CDSS recommendations were additionally highlighted by a recent study of nudge alerts on cardiologists’ prescription rates of statins.44 Eighty-two attending cardiologists were recruited as part of a cluster RCT design. Regardless of either passive alert (which required manual access) or an active interruptive alert to accept or decline guideline-directed statin therapy, there were no significant changes in statin prescriptions during the 1-year study. The authors commented that clinicians in the study were unsure regarding the clinical justification behind the CDSS recommendation, emphasizing the influence of clinical teams’ cognitive heuristics and baseline models of working on nudge deployment. Contrastingly AF-ALERT,4 which also evaluated a CDSS nudge for adherence to GDT demonstrated a significant difference in anticoagulation prescribing behaviour, and crucially, clinical outcomes, as highlighted in Table 2. Once more, clinical context is a key to understand the different trial results—perhaps the patient benefit of anticoagulation and stroke risk reduction were more salient to clinicians than the benefits of a statin prescription. Of note, all three highlighted trials were conducted in the USA and received ethical approval for waiver of consent.

The feasibility of trial conduct within routine workflows and end-user acceptability are of particular salience given the trend of decision-making by clinicians that are increasingly abdicated to diagnostic and therapeutic pathways and protocols. Research questions such as ‘what is the rate of clinician adherence to CDSS and which factors influence these’ will become key hypotheses to test and answer. And while the eye-catching AF-ALERT trial4 demonstrated a 55% reduction in composite clinical outcomes, no details on clinician demographics or local clinical context were reported, tempering the generalizability of such a result.

Overall, nudge remains unfamiliar to the cardiovascular community despite its widespread use in other scientific disciplines and popular science parlance since 2008. Of all ESC professional guidelines, nudge is mentioned only in passing in the previous 2016 ESC prevention guideline:32 ‘Strategies such as “nudging” (to push mildly) and “default” have been proposed as tools. By changing the context to make healthy decisions the default, the individual is nudged in the healthy direction’.

Evidence from other contexts

Nudges have influenced clinician behaviour in a variety of other contexts and several studies stand out45–47 in terms of their generalizability to a cardiology audience (Table 4).

Table 4

Additional randomized controlled trials of clinician-facing nudges

AuthorStudy contextResultLessons
Montoy et al.45Randomization of clinicians to different prepopulated quantities of discharge prescriptions for opioids in emergency departmentsA lower default quantity was associated with fewer prescriptionsTo minimize possible bias, the study intervention was made without announcement, and prescribers were not informed of the study itself
Manz et al.46A stepped-wedge cluster RCT, with behavioural nudges directed at oncologists, combined with machine learning mortality predictions positively influenced clinician behaviour through initiating more care planning conversationsAbsolute increase of 4% among all patients and 11% in those with high predicted mortalityIntegrating behavioural economic principles into the machine learning-based nudge, as a series of co-interventions including peer comparison, feedback, and opt-out reminders
Sacarny et al.47RCT comparing peer comparison letter vs. placebo letter, across 5055 highest Medicare prescribers of the antipsychotic quetiapineOver 9 months, the treatment arm supplied 11.1% fewer quetiapine days per prescriber vs. the control armEffects were larger than those observed in existing large-scale behavioural interventions, potentially because of the content of the peer comparison letter
AuthorStudy contextResultLessons
Montoy et al.45Randomization of clinicians to different prepopulated quantities of discharge prescriptions for opioids in emergency departmentsA lower default quantity was associated with fewer prescriptionsTo minimize possible bias, the study intervention was made without announcement, and prescribers were not informed of the study itself
Manz et al.46A stepped-wedge cluster RCT, with behavioural nudges directed at oncologists, combined with machine learning mortality predictions positively influenced clinician behaviour through initiating more care planning conversationsAbsolute increase of 4% among all patients and 11% in those with high predicted mortalityIntegrating behavioural economic principles into the machine learning-based nudge, as a series of co-interventions including peer comparison, feedback, and opt-out reminders
Sacarny et al.47RCT comparing peer comparison letter vs. placebo letter, across 5055 highest Medicare prescribers of the antipsychotic quetiapineOver 9 months, the treatment arm supplied 11.1% fewer quetiapine days per prescriber vs. the control armEffects were larger than those observed in existing large-scale behavioural interventions, potentially because of the content of the peer comparison letter

Studies stretch across medical contexts and also include non-digital platforms but with a generalizable lesson to all EHR-based nudges.

Table 4

Additional randomized controlled trials of clinician-facing nudges

AuthorStudy contextResultLessons
Montoy et al.45Randomization of clinicians to different prepopulated quantities of discharge prescriptions for opioids in emergency departmentsA lower default quantity was associated with fewer prescriptionsTo minimize possible bias, the study intervention was made without announcement, and prescribers were not informed of the study itself
Manz et al.46A stepped-wedge cluster RCT, with behavioural nudges directed at oncologists, combined with machine learning mortality predictions positively influenced clinician behaviour through initiating more care planning conversationsAbsolute increase of 4% among all patients and 11% in those with high predicted mortalityIntegrating behavioural economic principles into the machine learning-based nudge, as a series of co-interventions including peer comparison, feedback, and opt-out reminders
Sacarny et al.47RCT comparing peer comparison letter vs. placebo letter, across 5055 highest Medicare prescribers of the antipsychotic quetiapineOver 9 months, the treatment arm supplied 11.1% fewer quetiapine days per prescriber vs. the control armEffects were larger than those observed in existing large-scale behavioural interventions, potentially because of the content of the peer comparison letter
AuthorStudy contextResultLessons
Montoy et al.45Randomization of clinicians to different prepopulated quantities of discharge prescriptions for opioids in emergency departmentsA lower default quantity was associated with fewer prescriptionsTo minimize possible bias, the study intervention was made without announcement, and prescribers were not informed of the study itself
Manz et al.46A stepped-wedge cluster RCT, with behavioural nudges directed at oncologists, combined with machine learning mortality predictions positively influenced clinician behaviour through initiating more care planning conversationsAbsolute increase of 4% among all patients and 11% in those with high predicted mortalityIntegrating behavioural economic principles into the machine learning-based nudge, as a series of co-interventions including peer comparison, feedback, and opt-out reminders
Sacarny et al.47RCT comparing peer comparison letter vs. placebo letter, across 5055 highest Medicare prescribers of the antipsychotic quetiapineOver 9 months, the treatment arm supplied 11.1% fewer quetiapine days per prescriber vs. the control armEffects were larger than those observed in existing large-scale behavioural interventions, potentially because of the content of the peer comparison letter

Studies stretch across medical contexts and also include non-digital platforms but with a generalizable lesson to all EHR-based nudges.

The recurring theme for successful nudges appears to be a greater focus on understanding the nuances of how physicians make decisions and how factors such as the Hawthorne effect48 need to be navigated and depending on the context, leveraged, in order to drive improvements. For cardiologists, comparison with peers49 may be one strategy to frame nudges to help drive behaviour change. Presently, the additional factors that can have an impact on the likelihood of nudge success, such as time constraints and the organizational structure of teams tasked to deliver nudge interventions, have only a paucity of data to describe their effects in specific clinical contexts.50

Nudges for patients

Nudges for patients have mainly focused on the intent–behaviour gap51 and whether communication of healthcare information results in healthier choices. A 2016 meta-analysis examined the effect of presenting individual risk to patients52 and found no significant effects on smoking cessation, diet or physical activity, or even motivation to change behaviour. More optimistically, a 2021 pilot study of nudges in the form of text message reminders for medication refills demonstrated early signals of possible benefit,53 further highlighting the importance of choosing the right context. Follow-up work as part of a larger study which includes measuring clinical outcomes is now underway.54

Prospective research of patient-facing CDSS nudges will need to match the growth of health technology companies who offer services to patients, often in a primary prevention cohort.55 Therefore, while current evidence for broad nudge interventions at a population level is mixed,56 this may soon change over time. For patients with existing conditions, examples of commitment contracts have shown success—e.g. in adherence to optimal secondary prevention in the context of heart failure,57 though a systematic review of nudges for patients with chronic disease emphasized the heterogeneity of study designs, results, and types of nudges.58 While the platforms that deliver patient-facing nudges can vary considerably, one recent example of a multi-faceted intervention stems from the EPIC-HF trial40—there was patient choice in receiving a video and checklist nudge by email, text, or both. The framing of the intervention encouraged patients to ‘promote a conversation about changing at least one thing to optimize medication management’ and 49% in the intervention group received initiation or intensification compared with 30% in the control group.

Therefore, while there are many opportunities, the risk of leaving patient-facing nudge interventions understudied and without formal regulation will manifest in the unintended consequences they may have on healthcare systems, with either downstream under or over-medicalization of problems.13

Limitations of nudge

Greater adoption and testing of nudges will require groups to deal with the following considerations.

Misuse

A key criticism of nudge is misinterpreting the breadth of its use in addressing areas reserved for wider policy and governmental action. For example, nudge was erroneously framed in the UK as a panacea for all the challenges set forth in the Marmot review59 of health inequalities in 2011. The over-reliance on simply changing an individuals’ choice architecture ahead of using other policy tools drew firm criticism from Sundar:60 ‘…effective sewage systems, clean running water, workplace safety laws, and smoking bans … public health needs to go back to basics and deal with inequity at a structural level rather than relying on nudge theory to change individual behaviour’.

A similar critique applies to CDSS-based nudges aimed at clinicians—we must not forgo the fundamentals of clinician education, audit and feedback, and other helpful tools that improve clinical knowledge and patient care. There are also other prominent examples of nudge misuse. In January 2020, an EHR vendor admitted colluding with an opioid manufacturer to create a pain alert CDSS which encouraged physicians to prescribe more extended-release opioid, thus selling more of the manufacturer’s product.61 The true prevalence of political and commercial influences on nudge design is beyond the scope of this review but these are important to consider in any context.

Lack of reproducibility of effect size and direction

Changes in behaviour are not entirely predictable—the ‘dose’ or ‘route’ of a nudge represent areas of considerable variation whenever they are evaluated and local context in modifying effects can be key. For instance, there are examples of nudge use that have resulted in heterogeneous effects. In the setting of alerts for acute kidney injury, a multicentre RCT which was negative contained signals of harm in some of the study sites that could not be attributed to a specific process.62 Many have suggested that nudges should be thought of as inductive rules of thumb which require careful testing and evaluation, rather than medicinal products with a predictable mechanism of action and side effect profile.63 Therefore, similar to when ‘health policy reversals’ occur, the rapid testing of nudges as part of RCTs and other experimental designs, tailored to the local context, will be the only way to effectively prescribe and ‘deprescribe’ CDSS nudge alerts.64

Lack of standardized nudging and dataset quality

Clinical decision support systems nudges may be required to work across multiple different EHR platforms—their recommendations and delivery will only be as effective as the datasets in which they are embedded within. Encouragingly, there is progress in moving towards increased data quality and interoperability, for both data and CDSS use. For example, Substitutable Medical Apps, Reusable Technology, Fast Healthcare Interoperability Resources, the Observational Medical Outcomes Partnership common data model, and Guideline Definition Language v2.65–67 Rather than a uniform, homogeneous nudge across different EHR platforms, the process and function of nudges could be standardized, rather than their precise form.68 Thus for computerized nudges, instead of designing a single set of CDSS code, adaptations to different EHR platforms to retain a standardized set of functions may be required. This review has deliberately focused on the technological frontier. However, a pre-requisite for deploying effective CDSS nudges is the digital maturity of the healthcare system, including its EHR platform as well as broader connectivity—digital maturity frameworks have been proposed before and can help policymakers identify gaps to work on.69,70 Co-funding of EHR adoption in combined research and clinical budgets may accelerate system maturity.

Nudge fatigue and automation bias

Alert or nudge fatigue has been described as a multi-faceted concept that can cause high override rates of CDSS recommendations, through either clinician de-sensitization or cognitive overload (where too much information is presented).71 In spite of these risks, in the comprehensive meta-analysis of CDSS by Kwan et al.,12 only 14% of the trials considered alert fatigue. While the effect of alert fatigue was non-significant in these studies, the point remains regarding its unknown effect in the majority of CDSS trials. A better understanding of how and when alert fatigue becomes relevant, and in whom, e.g. senior clinicians vs. trainees, represent gaps in knowledge which require further research.

A starting place will be more studies such which can quantify the phenomenon through relevant surrogate measures—for example, a recent pseudorandomized trial of a CDSS alert to improve prescription of GDT medications in heart failure patients reported the number of alerts needed to change the quality of care—an estimate comparable to the number needed to treat in clinical trial.72 Their results were consistent with a high alert burden—alerts were triggered an average of over 25 times per hospitalization with a response rate of <2%. In the trial, 405 interruptive alerts were needed to be triggered for one additional patient to be discharged on an angiotensin-converting enzyme inhibitor or angiotensin receptor blocker. Echoing the lessons from previous trials about context, the study group introduced a nudge when prescribing performance was already high (∼80% prescription rates) and in all hospitalizations, not just those related to decompensation of heart failure.

The mitigation of alert fatigue through tailoring the frequency and design of nudge alerts may eventually become a growing use case for AI in healthcare. This contrasts with AI and CDSS alert deployment more generally, where a common vulnerability for clinicians harnessing their power is automation bias. Here, reflexive adherence to recommendations may also lead to errors and patient harm. As clinicians, preserving the virtues of independent problem-solving and vigilance in continually asking whether a recommendation from a CDSS should be overridden will become an essential skill.

Testing nudges

The above limitations could be better accounted for collectively through the formation of ‘nudge units’, with a range of roles previously highlighted (Table 5).73

Table 5

The role of dedicated units to help deploy nudges within healthcare. Adapted from Patel et al.73

Deploying nudges in healthcareRoles of a nudge unit
Identify opportunitiesIdentify suboptimal care and map decision-making processes. Target a specific change that could most effectively shift behaviour. Evaluate feasibility of a nudge-based intervention in the local context, e.g. ICT infrastructure and staff buy-in
Type of research question answered
  • Reducing the evidence-practice gap through better adherence to guideline-directed therapy

  • Generation of novel insights through deploying nudges towards specific treatments in contexts with clinical equipoise

Measure outcomesIncluding process measures (e.g. prescribing patterns, referral rates) and patient outcomes (e.g. length of stay, readmissions, mortality)
Pragmatically implementAssess the effects on clinician workflow. Consider unintended consequences, their mitigations, and scalability
Align stakeholdersObtain buy-in from system and clinical leadership as well as support and feedback from frontline clinicians
Compare effectiveness and iterate designDesign interventions in a testable manner and evaluate changes from the intervention (fidelity) including findings to further optimize nudge design
Deploying nudges in healthcareRoles of a nudge unit
Identify opportunitiesIdentify suboptimal care and map decision-making processes. Target a specific change that could most effectively shift behaviour. Evaluate feasibility of a nudge-based intervention in the local context, e.g. ICT infrastructure and staff buy-in
Type of research question answered
  • Reducing the evidence-practice gap through better adherence to guideline-directed therapy

  • Generation of novel insights through deploying nudges towards specific treatments in contexts with clinical equipoise

Measure outcomesIncluding process measures (e.g. prescribing patterns, referral rates) and patient outcomes (e.g. length of stay, readmissions, mortality)
Pragmatically implementAssess the effects on clinician workflow. Consider unintended consequences, their mitigations, and scalability
Align stakeholdersObtain buy-in from system and clinical leadership as well as support and feedback from frontline clinicians
Compare effectiveness and iterate designDesign interventions in a testable manner and evaluate changes from the intervention (fidelity) including findings to further optimize nudge design
Table 5

The role of dedicated units to help deploy nudges within healthcare. Adapted from Patel et al.73

Deploying nudges in healthcareRoles of a nudge unit
Identify opportunitiesIdentify suboptimal care and map decision-making processes. Target a specific change that could most effectively shift behaviour. Evaluate feasibility of a nudge-based intervention in the local context, e.g. ICT infrastructure and staff buy-in
Type of research question answered
  • Reducing the evidence-practice gap through better adherence to guideline-directed therapy

  • Generation of novel insights through deploying nudges towards specific treatments in contexts with clinical equipoise

Measure outcomesIncluding process measures (e.g. prescribing patterns, referral rates) and patient outcomes (e.g. length of stay, readmissions, mortality)
Pragmatically implementAssess the effects on clinician workflow. Consider unintended consequences, their mitigations, and scalability
Align stakeholdersObtain buy-in from system and clinical leadership as well as support and feedback from frontline clinicians
Compare effectiveness and iterate designDesign interventions in a testable manner and evaluate changes from the intervention (fidelity) including findings to further optimize nudge design
Deploying nudges in healthcareRoles of a nudge unit
Identify opportunitiesIdentify suboptimal care and map decision-making processes. Target a specific change that could most effectively shift behaviour. Evaluate feasibility of a nudge-based intervention in the local context, e.g. ICT infrastructure and staff buy-in
Type of research question answered
  • Reducing the evidence-practice gap through better adherence to guideline-directed therapy

  • Generation of novel insights through deploying nudges towards specific treatments in contexts with clinical equipoise

Measure outcomesIncluding process measures (e.g. prescribing patterns, referral rates) and patient outcomes (e.g. length of stay, readmissions, mortality)
Pragmatically implementAssess the effects on clinician workflow. Consider unintended consequences, their mitigations, and scalability
Align stakeholdersObtain buy-in from system and clinical leadership as well as support and feedback from frontline clinicians
Compare effectiveness and iterate designDesign interventions in a testable manner and evaluate changes from the intervention (fidelity) including findings to further optimize nudge design

An overarching review of work from nudge units, comparing published meta-analyses as well as trials run by two of the largest nudge units in the USA, demonstrated that in 126 studies covering more than 20 million patients, the average nudge effect size was between 8 and 34% depending on the context.74 Importantly, the ability to use different types of nudge designs within a CDSS—such as harnessing saliency features or modifying default choices18—as well as using nudges alongside co-interventions ranging from education to audit and feedback, represent opportunities that require the experience and expertise of multidisciplinary teams, grouped as nudge units, to fully exploit.

Greater collaboration between practising clinicians, academics, and nudge units could rationalize the application of nudge strategies, stratified according to acute and chronic settings within cardiovascular medicine. Here the experience of clinicians may offer fundamental principles for good nudge design and appropriate choice contexts. For example, in an urgent clinical scenario, a CDSS alert may be ignored and multiple choices of action may be distracting.

Meanwhile, in a chronic setting, greater nuance and weighting towards patient preference may predominate and clinician bandwidth could stretch to considering multiple alerts if appropriate to their workflow. Further use cases of nudge could emerge to bridge notable gaps in traditional cardiovascular research—for instance, helping to promote better documentation of patient-reported outcome measures, an area that EHR vendors are already facilitating.75

The evolving science of measuring EHR use, and exploiting automated data log capture at scale, means that additional and parallel research questions may be answered. This could include assessing how tailored nudges could be used to reduce unwarranted variation in EHR use among clinicians. For example, in one study, female ambulatory physicians across specialty disciplines spent 33 more minutes in the EHR per day than male physicians (102.2 vs. 68.8 min).76

Nudges in areas of practice with clinical equipoise

Perhaps the most impactful areas for the testing of future nudges rests with identifying scenarios where there is significant variation in practice among clinicians. Such variation may either be warranted or unwarranted. The latter is the target for quality improvement efforts and where most nudges currently operate, while the former represents the signature of equipoise being present. A lack of robust evidence base to inform best practice may represent the ideal opportunity context needed for pragmatic trials of nudge interventions. The use of CDSS nudges to systematically test one set of actions, as part of an RCT compared with the heterogeneous standard of care, may generate novel insights. One example could be the threshold at which potassium or magnesium is supplemented in the context of acute arrhythmia and low-normal values.77 For cardiologists, the scale of the opportunity may be significant, given that only a minority of recommendations in the current AHA or ESC guidelines is informed by Level A evidence.1,78 Further, if and when insights are generated, there could be the virtuous cycle of nudge use in studying the adoption of such knowledge generation and by wider extension, implementation of professional guidelines. In a recent meta-analysis of studies which embedded appropriate use criteria specified by the American College of Cardiology into routine clinical workflows, none used nudges.79

As an extension, nudge testing in the context of clinical equipoise should not necessarily default to traditional two-arm RCT designs—an adaptive trial design should be explored by every learning hospital and health system of the future.80 One example is NUDGE-EHR, which initially includes 16 treatment arms and seeks to determine which form of nudge is superior at reducing the prescription of high-risk medications (benzodiazepines, Z drugs, and anticholinergics) among older adults.81

Ensuring an open dialogue with patients will be key to studies of the future—increasing awareness of the degree of variation of clinician decision-making alongside the benefits and risks of being involved in pragmatic research, and randomization at the point of routine care, will help to safeguard against situations where there are unclear explanations of how decisions have been made. The broader issues of consent, shared decision-making, and how the black box of expert clinicians ‘arrive’ at decisions fall outside the scope of this review but represent areas for future work, particularly at the human–computer interface with future AI (AI-CDSS).82

Personalized nudging and risk tolerance

As partnerships between cardiovascular science and computer science grow, ambitious visions of digital twins83 and AI-powered informatics consults84 may one day be realized. There will be fundamental changes to working in medicine as well as how medicine will work. Although the application of AI to healthcare is still in its infancy,85 the increased testing of AI algorithms as part of AI-CDSS and the role of nudge to maximize their intended ‘dose’ will represent forthcoming research priorities.

Extensions to personalized nudging for both clinicians and patients alike may occur, with individualized communication of risk an area that could change the current consent landscape as applied to medical procedures.86

Alongside these research questions and the formation of nudge units, the requirement for interdisciplinary training programmes for clinical researchers and more ambitious funding programmes from policy makers, such as the ARPA programme in the UK, will be key.87 Fostering collaborations throughout the careers of practicing cardiologists and domain experts responsible for nudge design and human–computer interfaces will avoid artificial gaps being created between nudge theory and nudge practice.7,88

While our review is not intended to make a forecast about how successful nudges could change the practice of cardiology in the years to come, by adopting rapid cycle testing,89 their ‘blockbuster’ potential may not look like the traditional ‘one size fits all’ tablet or procedure that we are used to. Instead, nudges applied universally would be shaped by local practice patterns and idiosyncrasies so that a ‘thousand flowers bloom’ model,90,91 with precise nudge effects varying by local context materializes. As more data become curated, linked, and ingested into (AI)-CDSS models,82 nudges will become increasingly sophisticated through their (automated) deployment by ‘electronic health engines’ rather than EHRs—integrating factors including social and economic drivers of health, behavioural risks, genomic, and citizen-generated data.92

Conclusion

In the age of LHSs and progressive advancements in data science, the testing of nudge-based interventions for clinicians and patients alike represents a rich opportunity to systematically reduce evidence-practice gaps as well as generate new evidence that could improve care in many areas of cardiovascular medicine and beyond. Increasing collaborations and opportunities for doctors and researchers to work across professional boundaries will help facilitate collective, bespoke nudge trials that could deliver blockbuster results, an outcome that is increasingly hard to observe in traditional RCT designs.

Supplementary material

Supplementary material is available at European Heart Journal online.

Acknowledgements

The authors thank F. Perry Wilson, MD MSCE, who helped to review an earlier version of this manuscript.

Funding

No specific funding is relevant to this work.

Conflict of interest: none declared.

References

1

van Dijk
 
WB
,
Grobbee
 
DE
,
de Vries
 
MC
,
Groenwold
 
RHH
,
van der Graaf
 
R
,
Schuit
 
E
.
A systematic breakdown of the levels of evidence supporting the European Society of Cardiology guidelines
.
Eur J Prev Cardiol
 
2019
;
26
:
1944
1952
.

2

Hemingway
 
H
,
Asselbergs
 
FW
,
Danesh
 
J
,
Dobson
 
R
,
Maniadakis
 
N
,
Maggioni
 
A
, et al.  
Big data from electronic health records for early and late translational cardiovascular research: challenges and potential
.
Eur Heart J
 
2018
;
39
:
1481
1495
.

3

Thaler
 
R
,
Sunstein
 
CR
.
Nudge: Improving Decisions about Health, Wealth, and Happiness
.
New Haven
,
CT
:
Yale University Press
;
2008
.

4

Piazza
 
G
,
Hurwitz
 
S
,
Galvin
 
CE
,
Harrigan
 
L
,
Baklla
 
S
,
Hohlfelder
 
B
, et al.  
Alert-based computerized decision support for high-risk hospitalized patients with atrial fibrillation not prescribed anticoagulation: a randomized, controlled trial (AF-ALERT)
.
Eur Heart J
 
2020
;
41
:
1086
1096
.

5

Nachev
 
P
,
Herron
 
D
,
McNally
 
N
,
Rees
 
G
,
Williams
 
B
.
Redefining the research hospital
.
NPJ Digit Med
 
2019
;
2
:
119
.

6

Greenes
 
RA
,
Bates
 
DW
,
Kawamoto
 
K
,
Middleton
 
B
,
Osheroff
 
J
,
Shahar
 
Y
.
Clinical decision support models and frameworks: seeking to address research issues underlying implementation successes and failures
.
J Biomed Inform
 
2018
;
78
:
134
143
.

7

Rudin
 
RS
,
Friedberg
 
MW
,
Shekelle
 
P
,
Shah
 
N
,
Bates
 
DW
.
Getting value from electronic health records: research needed to improve practice
.
Ann Intern Med
 
2020
;
172
:
S130
S136
.

8

Drolet
 
BC
,
Lorenzi
 
NM
.
Translational research: understanding the continuum from bench to bedside
.
Transl Res
 
2011
;
157
:
1
5
.

9

Dzau
 
VJ
,
Balatbat
 
CA
,
Ellaissi
 
WF
.
Revisiting academic health sciences systems a decade later: discovery to health to population to society
.
Lancet
 
2021
;
398
:
2300
2304
.

10

Savarese
 
G
,
Bodegard
 
J
,
Norhammar
 
A
,
Sartipy
 
P
,
Thuresson
 
M
,
Cowie
 
MR
, et al.  
Heart failure drug titration, discontinuation, mortality and heart failure hospitalization risk: a multinational observational study (US, UK and Sweden)
.
Eur J Heart Fail
 
2021
;
23
:
1499
1511
.

11

Tversky
 
A
,
Kahneman
 
D
.
The framing of decisions and the psychology of choice
.
Science
 
1981
;
211
:
453
458
.

12

Kwan
 
JL
,
Lo
 
L
,
Ferguson
 
J
,
Goldberg
 
H
,
Diaz-Martinez
 
JP
,
Tomlinson
 
G
, et al.  
Computerised clinical decision support systems and absolute improvements in care: meta-analysis of controlled clinical trials
.
BMJ
 
2020
;
370
:
m3216
.

13

Saini
 
V
,
Brownlee
 
S
,
Elshaug
 
AG
,
Glasziou
 
P
,
Heath
 
I
.
Addressing overuse and underuse around the world
.
Lancet
 
2017
;
390
:
105
107
.

14

Holmgren
 
AJ
,
Downing
 
NL
,
Bates
 
DW
,
Shanafelt
 
TD
,
Milstein
 
A
,
Sharp
 
CD
, et al.  
Assessment of electronic health record use between US and non-US health systems
.
JAMA Intern Med
 
2021
;
181
:
251
259
.

15

PROSPERO International prospective register of systematic reviews
. https://www.crd.york.ac.uk/prospero/. (14 September 2021, date last accessed).

16

National Library of Medicine
. https://pubmed.ncbi.nlm.nih.gov/?term=nudge+and+cardiology. (16 November 2021, date last accessed).

17

Yoong
 
SL
,
Hall
 
A
,
Stacey
 
F
,
Grady
 
A
,
Sutherland
 
R
,
Wyse
 
R
, et al.  
Nudge strategies to improve healthcare providers’ implementation of evidence-based guidelines, policies and practices: a systematic review of trials included within Cochrane systematic reviews
.
Implement Sci
 
2020
;
15
:
50
.

18

Lamprell
 
K
,
Tran
 
Y
,
Arnolda
 
G
,
Braithwaite
 
J
.
Nudging clinicians: a systematic scoping review of the literature
.
J Eval Clin Pract
 
2021
;
27
:
175
192
.

19

McDonagh
 
TA
,
Metra
 
M
,
Adamo
 
M
,
Gardner
 
RS
,
Baumbach
 
A
,
Böhm
 
M
, et al.  
2021 ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure
.
Eur Heart J
 
2021
;
42
:
3599
3726
.

20

Visseren
 
FLJ
,
Mach
 
F
,
Smulders
 
YM
,
Carballo
 
D
,
Koskinas
 
KC
,
Bäck
 
M
, et al.  
2021 ESC Guidelines on cardiovascular disease prevention in clinical practice
.
Eur Heart J
 
2021
;
42
:
3227
3337
.

21

Levine
 
GN
,
O’Gara
 
PT
,
Beckman
 
JA
,
Al-Khatib
 
SM
,
Birtcher
 
KK
,
Cigarroa
 
JE
, et al.  
Recent innovations, modifications, and evolution of ACC/AHA clinical practice guidelines: an update for our constituencies: a report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines
.
Circulation
 
2019
;
139
:
e879
e886
.

22

McMurray
 
JJ
,
Packer
 
M
,
Desai
 
AS
,
Gong
 
J
,
Lefkowitz
 
MP
,
Rizkala
 
AR
, et al.  
Angiotensin–neprilysin inhibition versus enalapril in heart failure
.
N Engl J Med
 
2014
;
371
:
993
1004
.

23

Keeley
 
EC
,
Boura
 
JA
,
Grines
 
CL
.
Primary angioplasty versus intravenous thrombolytic therapy for acute myocardial infarction: a quantitative review of 23 randomised trials
.
Lancet
 
2003
;
361
:
13
20
.

24

RECOVERY Collaborative Group
,
Horby
 
P
,
Lim
 
WS
,
Emberson
 
JR
,
Mafham
 
M
,
Bell
 
JL
, et al.  
Dexamethasone in hospitalized patients with Covid-19
.
N Engl J Med
 
2021
;
384
:
693
704
.

25

Henry
 
J
,
Pylypchuk
 
Y
,
Searcy
 
T
,
Patel
 
V
.
Adoption of electronic health record systems among U.S. non-federal acute care hospitals: 2008–2015
. https://www.healthit.gov/data/data-briefs/adoption-electronic-health-record-systems-among-us-non-federal-acute-care-1 (14 September 2021, date last accessed).

26

Khubone
 
T
,
Tlou
 
B
,
Mashamba-Thompson
 
TP
.
Electronic health information systems to improve disease diagnosis and management at point-of-care in low and middle income countries: a narrative review
.
Diagnostics (Basel)
 
2020
;
10
:
327
.

27

Chen
 
Y
,
Nagendran
 
M
,
Kilic
 
Y
,
Cavlan
 
D
,
Feather
 
A
,
Westwood
 
M
, et al.  
The diagnostic certainty levels of junior clinicians: a retrospective cohort study
.
Health Inf Manag
 
2021
:
18333583211019134
.

28

Haynes
 
AB
,
Weiser
 
TG
,
Berry
 
WR
,
Lipsitz
 
SR
,
Breizat
 
AH
,
Dellinger
 
EP
, et al.  
A surgical safety checklist to reduce morbidity and mortality in a global population
.
N Engl J Med
 
2009
;
360
:
491
499
.

29

Landrigan
 
CP
,
Rahman
 
SA
,
Sullivan
 
JP
,
Vittinghoff
 
E
,
Barger
 
LK
,
Sanderson
 
AL
, et al.  
Effect on patient safety of a resident physician schedule without 24-hour shifts
.
N Engl J Med
 
2020
;
382
:
2514
2523
.

30

Catchpole
 
K
,
Russ
 
S
.
The problem with checklists
.
BMJ Qual Saf
 
2015
;
24
:
545
549
.

31

Ahmad
 
T
,
Yamamoto
 
Y
,
Biswas
 
A
,
Ghazi
 
L
,
Martin
 
M
,
Simonov
 
M
, et al.  
REVeAL-HF: design and rationale of a pragmatic randomized controlled trial embedded within routine clinical practice
.
JACC Heart Fail
 
2021
;
9
:
409
419
.

32

Piepoli
 
MF
,
Hoes
 
AW
,
Agewall
 
S
,
Albus
 
C
,
Brotons
 
C
,
Catapano
 
AL
, et al.  
2016 European Guidelines on cardiovascular disease prevention in clinical practice: the Sixth Joint Task Force of the European Society of Cardiology and Other Societies on Cardiovascular Disease Prevention in Clinical Practice (constituted by representatives of 10 societies and by invited experts) developed with the special contribution of the European Association for Cardiovascular Prevention & Rehabilitation (EACPR)
.
Eur Heart J
 
2016
;
37
:
2315
2381
.

33

Patel
 
MS
,
Kurtzman
 
GW
,
Kannan
 
S
,
Small
 
DS
,
Morris
 
A
,
Honeywell
 
S
 Jr
, et al.  
Effect of an automated patient dashboard using active choice and peer comparison performance feedback to physicians on statin prescribing: the PRESCRIBE cluster randomized clinical trial
.
JAMA Netw Open
 
2018
;
1
:
e180818
.

34

Ghazi
 
L
,
Desai
 
NR
,
Simonov
 
M
,
Yamamoto
 
Y
,
O’Connor
 
KD
,
Riello
 
RJ
, et al.  
Rationale and design of a cluster-randomized pragmatic trial aimed at improving use of guideline directed medical therapy in outpatients with heart failure: PRagmatic Trial Of Messaging to Providers about Treatment of Heart Failure (PROMPT-HF)
.
Am Heart J
 
2022
;
244
:
107
115
.

35

Chokshi
 
NP
,
Adusumalli
 
S
,
Small
 
DS
,
Morris
 
A
,
Feingold
 
J
,
Ha
 
YP
, et al.  
Loss-framed financial incentives and personalized goal-setting to increase physical activity among ischemic heart disease patients using wearable devices: the ACTIVE REWARD randomized trial
.
J Am Heart Assoc
 
2018
;
7
:
e009173
.

36

Horne
 
BD
,
Muhlestein
 
JB
,
Lappé
 
DL
,
May
 
HT
,
Le
 
VT
,
Bair
 
TL
, et al.  
Behavioral nudges as patient decision support for medication adherence: the ENCOURAGE randomized controlled trial
.
Am Heart J
 
2022
;
244
:
125
134
.

37

Poggio
 
R
,
Prado
 
C
,
Santero
 
M
,
Nejamis
 
A
,
Gutierrez
 
L
,
Irazola
 
V
.
Effectiveness of financial incentives and message framing to improve clinic visits of people with moderate-high cardiovascular risk in a vulnerable population in Argentina: a cluster randomized trial
.
Prev Med
 
2021
;
153
:
106738
.

38

Silbernagel
 
G
,
Spirk
 
D
,
Hager
 
A
,
Baumgartner
 
I
,
Kucher
 
N
.
Electronic alert system for improving stroke prevention among hospitalized oral-anticoagulation-naïve patients with atrial fibrillation: a randomized trial
.
J Am Heart Assoc
 
2016
;
5
:
e003776
.

39

National Library of Medicine (U.S.)
.
Clinicaltrials.gov
.
2005
. https://clinicaltrials.gov/ct2/home. (29 November 2021, date last accessed).

40

Allen
 
LA
,
Venechuk
 
G
,
McIlvennan
 
CK
,
Page
 
RL
,
Knoepke
 
CE
,
Helmkamp
 
LJ
, et al.  
An electronically delivered patient-activation tool for intensification of medications for chronic heart failure with reduced ejection fraction: rationale and design of the EPIC-HF trial
.
Circulation
 
2021
;
143
:
427
437
.

41

Ahmad
 
T
,
Yamamoto
 
Y
,
Biswas
 
A
, et al.  
Risk evaluation and its impact on clinical decision making and outcomes in heart failure: the REVEAL-HF trial
.
In: Presented at: AHA 2021
.

42

Rudin
 
C
.
Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead
.
Nat Mach Intell
 
2019
;
1
:
206
215
.

43

Dietvorst
 
BJ
,
Simmons
 
JP
,
Massey
 
C
.
Algorithm aversion: people erroneously avoid algorithms after seeing them err
.
J Exp Psychol Gen
 
2015
;
144
:
114
126
.

44

Adusumalli
 
S
,
Westover
 
JE
,
Jacoby
 
DS
,
Small
 
DS
,
VanZandbergen
 
C
,
Chen
 
J
, et al.  
Effect of passive choice and active choice interventions in the electronic health record to cardiologists on statin prescribing: a cluster randomized clinical trial
.
JAMA Cardiol
 
2021
;
6
:
40
48
.

45

Montoy
 
JCC
,
Coralic
 
Z
,
Herring
 
AA
,
Clattenburg
 
EJ
,
Raven
 
MC
.
Association of default electronic medical record settings with health care professional patterns of opioid prescribing in emergency departments: a randomized quality improvement study
.
JAMA Intern Med
 
2020
;
180
:
487
493
.

46

Manz
 
CR
,
Parikh
 
RB
,
Small
 
DS
,
Evans
 
CN
,
Chivers
 
C
,
Regli
 
SH
, et al.  
Effect of integrating machine learning mortality estimates with behavioral nudges to clinicians on serious illness conversations among patients with cancer: a stepped-wedge cluster randomized clinical trial
.
JAMA Oncol
 
2020
;
6
:
e204759
.

47

Sacarny
 
A
,
Barnett
 
ML
,
Le
 
J
,
Tetkoski
 
F
,
Yokum
 
D
,
Agrawal
 
S
.
Effect of peer comparison letters for high-volume primary care prescribers of quetiapine in older and disabled adults: a randomized clinical trial
.
JAMA Psychiatry
 
2018
;
75
:
1003
1011
.

48

Sedgwick
 
P
,
Greenwood
 
N
.
Understanding the Hawthorne effect
.
BMJ
 
2015
;
351
:
h4672
.

49

Diamond
 
JA
,
Schussheim
 
AE
,
Phillips
 
RA
.
Another nudge to overcome the treatment-risk paradox in blood pressure management
.
J Am Coll Cardiol
 
2021
;
77
:
1991
1993
.

50

Kilsdonk
 
E
,
Peute
 
LW
,
Jaspers
 
MW
.
Factors influencing implementation success of guideline-based clinical decision support systems: a systematic review and gaps analysis
.
Int J Med Inform
 
2017
;
98
:
56
64
.

51

Shaw
 
D
,
McMaster
 
R
,
Newholm
 
T
.
Care and commitment in ethical consumption: an exploration of the ‘attitude–behaviour gap’
.
J Bus Ethics
 
2016
;
136
:
251
265
.

52

Hollands
 
GJ
,
French
 
DP
,
Griffin
 
SJ
,
Prevost
 
AT
,
Sutton
 
S
,
King
 
S
, et al.  
The impact of communicating genetic risks of disease on risk-reducing health behaviour: systematic review with meta-analysis
.
BMJ
 
2016
;
352
:
i1102
.

53

Luong
 
P
,
Glorioso
 
TJ
,
Grunwald
 
GK
,
Peterson
 
P
,
Allen
 
LA
,
Khanna
 
A
, et al.  
Text message medication adherence reminders automated and delivered at scale across two institutions: testing the nudge system: pilot study
.
Circ Cardiovasc Qual Outcomes
 
2021
;
14
:
e007015
.

54

Glasgow
 
RE
,
Knoepke
 
CE
,
Magid
 
D
,
Grunwald
 
GK
,
Glorioso
 
TJ
,
Waughtal
 
J
, et al.  
The NUDGE trial pragmatic trial to enhance cardiovascular medication adherence: study protocol for a randomized controlled trial
.
Trials
 
2021
;
22
:
528
.

55

Patel
 
MS
,
Asch
 
DA
,
Rosin
 
R
,
Small
 
DS
,
Bellamy
 
SL
,
Heuer
 
J
, et al.  
Framing financial incentives to increase physical activity among overweight and obese adults: a randomized, controlled trial
.
Ann Intern Med
 
2016
;
164
:
385
394
.

56

Tørris
 
C
,
Mobekk
 
H
.
Improving cardiovascular health through nudging healthier food choices: a systematic review
.
Nutrients
 
2019
;
11
:
2520
.

57

Chang
 
LL
,
DeVore
 
AD
,
Granger
 
BB
,
Eapen
 
ZJ
,
Ariely
 
D
,
Hernandez
 
AF
.
Leveraging behavioral economics to improve heart failure care and outcomes
.
Circulation
 
2017
;
136
:
765
777
.

58

Möllenkamp
 
M
,
Zeppernick
 
M
,
Schreyögg
 
J
.
The effectiveness of nudges in improving the self-management of patients with chronic diseases: a systematic literature review
.
Health Policy
 
2019
;
123
:
1199
1209
.

59

Bonell
 
C
,
McKee
 
M
,
Fletcher
 
A
,
Haines
 
A
,
Wilkinson
 
P
.
Nudge smudge: UK Government misrepresents “nudge”
.
Lancet
 
2011
;
377
:
2158
2159
.

60

Sundar
 
S
.
Public health needs to go back to basics, not rely on nudge theory
.
BMJ
 
2021
;
373
:
n1153
.

61

Taitsman
 
JK
,
VanLandingham
 
A
,
Grimm
 
CA
.
Commercial influences on electronic health records and adverse effects on clinical decision-making
.
JAMA Intern Med
 
2020
;
180
:
925
926
.

62

Oakes
 
AH
,
Patel
 
MS
.
A nudge towards increased experimentation to more rapidly improve healthcare
.
BMJ Qual Saf
 
2020
;
29
:
179
181
.

63

Wilson
 
FP
,
Martin
 
M
,
Yamamoto
 
Y
,
Partridge
 
C
,
Moreira
 
E
,
Arora
 
T
, et al.  
Electronic health record alerts for acute kidney injury: multicenter, randomized clinical trial
.
BMJ
 
2021
;
372
:
m4786
.

64

Fox
 
CR
,
Doctor
 
JN
,
Goldstein
 
NJ
,
Meeker
 
D
,
Persell
 
SD
,
Linder
 
JA
.
Details matter: predicting when nudging clinicians will succeed or fail
.
BMJ
 
2020
;
370
:
m3256
.

65

Wright
 
A
,
McCoy
 
AB
,
Choudhry
 
NK
.
Recommendations for the conduct and reporting of research involving flexible electronic health record-based interventions
.
Ann Intern Med
 
2020
;
172
:
S110
S115
.

66

Unberath
 
P
,
Prokosch
 
HU
,
Gründner
 
J
,
Erpenbeck
 
M
,
Maier
 
C
,
Christoph
 
J
.
EHR-independent predictive decision support architecture based on OMOP
.
Appl Clin Inform
 
2020
;
11
:
399
404
.

67

Open EHR
.
Guideline definition language v2
.
2021
. https://specifications.openehr.org/releases/CDS/latest/GDL2.html. (14 September, date last accessed).

68

Craig
 
P
,
Dieppe
 
P
,
Macintyre
 
S
,
Michie
 
S
,
Nazareth
 
I
,
Petticrew
 
M
.
Developing and evaluating complex interventions: the new Medical Research Council guidance
.
BMJ
 
2008
;
337
:
a1655
.

69

de Carvalho
 
JV
,
Rocha
 
Á
,
Vasconcelos
 
J
.
Towards an encompassing maturity model for the management of hospital information systems
.
J Med Syst
 
2015
;
39
:
99
.

70

HIMSS.
 
Electronic Medical Record Adoption Model
.
2021.
 https://www.himssanalytics.org/europe/electronic-medical-record-adoption-model. (22 November, date last accessed).

71

Ancker
 
JS
,
Edwards
 
A
,
Nosal
 
S
,
Hauser
 
D
,
Mauer
 
E
 
Kaushal
 
R
.
Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system
.
BMC Med Inform Decis Mak
 
2017
;
17
:
36
.

72

Blecker
 
S
,
Austrian
 
JS
,
Horwitz
 
LI
,
Kuperman
 
G
,
Shelley
 
D
,
Ferrauiola
 
M
, et al.  
Interrupting providers with clinical decision support to improve care for heart failure
.
Int J Med Inform
 
2019
;
131
:
103956
.

73

Patel
 
MS
,
Volpp
 
KG
,
Asch
 
DA
.
Nudge units to improve the delivery of health care
.
N Engl J Med
 
2018
;
378
:
214
216
.

74

DellaVigna
 
S
,
Linos
 
E
. RCTs to scale: comprehensive evidence from two nudge units. Econometrica 2022;90:81–116. https://doi.org/10.3982/ECTA18709.

75

Kao
 
DP
,
Trinkley
 
KE
,
Lin
 
CT
.
Heart failure management innovation enabled by electronic health records
.
JACC Heart Fail
 
2020
;
8
:
223
233
.

76

Tait
 
SD
,
Oshima
 
SM
,
Ren
 
Y
,
Fenn
 
AE
,
Boazak
 
M
,
Hinz
 
EM
, et al.  
Electronic health record use by sex among physicians in an academic health care system
.
JAMA Intern Med
 
2021
;
181
:
288
290
.

77

Lancaster
 
TS
,
Schill
 
MR
,
Greenberg
 
JW
,
Moon
 
MR
,
Schuessler
 
RB
,
Damiano
 
RJ
, et al.  
Potassium and magnesium supplementation do not protect against atrial fibrillation after cardiac operation: a time-matched analysis
.
Ann Thorac Surg
 
2016
;
102
:
1181
1188
.

78

Fanaroff
 
AC
,
Califf
 
RM
,
Windecker
 
S
,
Smith
 
SC
,
Lopes
 
RD
.
Levels of evidence supporting American College of Cardiology/American Heart Association and European society of cardiology guidelines, 2008–2018
.
JAMA
 
2019
;
321
:
1069
1080
.

79

Winchester
 
DE
,
Merritt
 
J
,
Waheed
 
N
,
Norton
 
H
,
Manja
 
V
,
Shah
 
NR
, et al.  
Implementation of appropriate use criteria for cardiology tests and procedures: a systematic review and meta-analysis
.
Eur Heart J Qual Care Clin Outcomes
 
2021
;
7
:
34
41
.

80

Angus
 
DC
.
Fusing randomized trials with big data: the key to self-learning health care systems?
.
JAMA
 
2015
;
314
:
767
768
.

81

Lauffenburger
 
JC
,
Isaac
 
T
,
Trippa
 
L
,
Keller
 
P
,
Robertson
 
T
,
Glynn
 
RJ
, et al.  
Rationale and design of the Novel Uses of adaptive Designs to Guide provider Engagement in Electronic Health Records (NUDGE-EHR) pragmatic adaptive randomized trial: a trial protocol
.
Implement Sci
 
2021
;
16
:
9
.

82

The DECIDE-AI Steering Group
.
DECIDE-AI: new reporting guidelines to bridge the development-to-implementation gap in clinical artificial intelligence
.
Nat Med
 
2021
;
27
:
186
187
.

83

Corral-Acero
 
J
,
Margara
 
F
,
Marciniak
 
M
,
Rodero
 
C
,
Loncaric
 
F
,
Feng
 
Y
, et al.  
The ‘Digital Twin’ to enable the vision of precision cardiology
.
Eur Heart J
 
2020
;
41
:
4556
4564
.

84

Lai
 
AG
,
Chang
 
WH
,
Parisinos
 
CA
,
Katsoulis
 
M
,
Blackburn
 
RM
,
Shah
 
AD
, et al.  
An informatics consult approach for generating clinical evidence for treatment decisions
.
BMC Med Inform Decis Mak
 
2021
;
21
:
281
.

85

Nagendran
 
M
,
Chen
 
Y
,
Lovejoy
 
CA
,
Gordon
 
AC
,
Komorowski
 
M
,
Harvey
 
H
, et al.  
Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies
.
BMJ
 
2020
;
368
:
m689
.

86

General Medical Council
.
Decision making and consent 2020
. https://www.gmc-uk.org/ethical-guidance/ethical-guidance-for-doctors/decision-making-and-consent. (23 August 2021, date last accessed).

87

Science
.
New UK funding agency would tackle innovative research
. https://www.science.org/content/article/new-uk-funding-agency-would-tackle-innovative-research. (16 November 2021, date last accessed).

88

Stawarz
 
K
,
Cox
 
AL
,
Blandford
 
A
.
Don’t forget your pill! Designing effective medication reminder apps that support users’ daily routines
. In: Proceedings of the
SIGCHI Conference on Human Factors in Computing Systems
 
2014
.
2269
2278
.

89

Horwitz
 
LI
,
Kuznetsova
 
M
,
Jones
 
SA
.
Creating a learning health system through rapid-cycle, randomized testing
.
N Engl J Med
 
2019
;
381
:
1175
1179
.

90

Futoma
 
J
,
Simons
 
M
,
Panch
 
T
,
Doshi-Velez
 
F
,
Celi
 
LA
.
The myth of generalisability in clinical research and machine learning in health care
.
Lancet Digit Health
 
2020
;
2
:
e489
e492
.

91

Boudreau
 
K
.
Let a thousand flowers bloom? An early look at large numbers of software ‘apps’ developers and patterns of innovation
.
30 April 2011. SSRN
: https://ssrn.com/abstract=1826702 or http://dx.doi.org/10.2139/ssrn.1826702

92

Davies
 
SC
. Annual report of the chief medical officer, 2018, health 2040 better health within reach. London: Department of Health and Social Care;
2018
.

This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial License (https://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact [email protected]

Supplementary data