Abstract

Accreditation standards are at the forefront of evolving healthcare systems, setting metrics for high-quality care. Healthcare outcomes (health, experience, cost, provider satisfaction/burn out) are becoming mutual goals of the patient, provider, payer, and healthcare system. Achieving high-quality outcomes in cancer care necessitates collaboration among interdisciplinary teams of clinical providers, administrators, patient advocates, caregivers, and researchers. Dissemination and implementation science provides necessary frameworks to organize the efforts of these implementation teams, inclusive of identifying facilitators and barriers to implementation of accreditation standards. Since 2015, cancer distress screening has been mandated for continued cancer center accreditation by the American College of Surgeon’s Commission on Cancer. Cancer centers have thus become real world implementation laboratories. We present the current context of distress screening, highlighting prior research and key areas of future research. We consider multiple levels of cancer care delivery and the use of interdisciplinary teams to help cancer center teams adopt, implement, and maintain efficient distress screening programs. Finally, we present a case study to identify methods for successful implementation of distress screening at one cancer center and then describe efficiencies that can be introduced using elements from human factors engineering, e- and m-health screening platforms, and community partnerships.

Implications

Practice: Providers of mental healthcare should lead teams of allied health professionals and other interested stakeholders in designing, implementing, and evaluating distress screening programs in oncology care using evidence-based approaches with attention to workflow and human factors approaches.

Policy: Enforcement of the Commission on Cancer distress screening mandate needs to include measures of effectiveness in terms of referral rates, distress reduction, patient and caregiver satisfaction, provider burden, and healthcare utilization, which may serve to deepen stakeholder alliances and further improvements in healthcare delivery.

Research: Multidisciplinary, implementation research is needed to evaluate the downstream effects of cancer distress screening in terms of measure selection and relevance to all stakeholders, including the “quadruple aim” of health outcomes, patient experience, provider burden, and costs/healthcare utilization.

INTRODUCTION

Since 2015, cancer distress screening has been mandated for continued cancer center accreditation by the American College of Surgeons Commission on Cancer (CoC) [1,2]. Standard 3.2 on psychosocial distress screening in the CoC “Cancer Program Standards 2012: Ensuring Patient-Centered Care” states: “The cancer committee develops and implements a process to integrate and monitor on-site psychosocial distress screening and referral for the provision of psychosocial care.” [1].

The purpose of the present paper is to describe the policies and procedures related to implementation of distress screening in oncology. We present evidence using the framework of the Triple Aim, which focuses on improving patient experiences, population health outcomes, and cost efficiency [3,4]. We then provide a case example and identify research gaps and policy implications to improve distress screening implementation.

Distress screening in cancer care

Screening rationale and distress prevalence

For over 30 years, the field of psycho-oncology has recognized the impact of distress in cancer patients through advocacy of distress screening during all phases of the cancer trajectory [5,6]. Consistent evidence suggests prevalent distress among cancer patients and their families, and associated unmet psychosocial health needs [7–10]. Research also demonstrates the effectiveness of interventions to reduce distress, and the positive downstream impact on patients, families, cancer outcomes, and the medical system when distress is addressed [11,12].

The term “distress” defines unpleasant psychological, social, and/or spiritual experiences that interfere with the ability to effectively cope with a cancer diagnosis, its symptoms, and subsequent treatment side-effects [13]. Distress was selected as the screening terminology because it was a multidimensional construct believed to be more acceptable to oncology patients, better understood by the lay person, and less stigmatizing than psychiatric diagnostic categories such as depression or anxiety [14]. Differences in terminology and approaches to screening exist however, as the American Society of Clinical Oncology guideline utilizes measures of depression and anxiety symptoms in its description of distress screening implementation [15].

Regardless of terminology, distress has serious implications for cancer patients, as 25–50% of cancer patients indicate significant levels of distress [16–20] and distress is a potential risk factor for nonadherence to treatment and poorer quality of life [21–23]. Depressive symptoms have received the most study and have been linked to lower adherence to medical treatment recommendations [24,25] and cancer mortality in a meta-analysis [26]. Intervention studies suggest that these effects are reversible (see below Efficacy of Psychosocial Interventions to Reduce Distress).

Distress screening implementation

Implementation of distress screening can be viewed as a multilevel intervention, involving behavior and system change across various levels (e.g., organizational change to work flow, provider change to administer and respond to results, patient willingness to complete more “paperwork”). Thus multiple types of screening and referral approaches may be effective within a comprehensive healthcare system to identify and treat distress. Within the last decade, researchers have developed and validated a number of distress screening tools (e.g., Distress Thermometer [DT]; Hospital Anxiety and Depression Scale; Patient Health Questionnaire-9; see refs. [15,16,27] for further examples of distress screeners). Many of these brief instruments are effective at detecting clinically significant elevations of distress among diverse oncology populations [16,28,29]. Furthermore, distress screening appears feasible, even among large patient populations, and clinical staff report generally positive perceptions of the screening process [8,18,30,31].

Research evidence

Distress screeners

Use of widely-available and no cost single-item distress measures could facilitate adoption, implementation, and maintenance of screening within healthcare systems, such as addressing patient and provider time burdens and increasing instrument acceptability [19,32], while also minimizing financial cost to the healthcare system. The DT is a common single-item distress screener available in the public domain. It can be utilized with or without a 38-item problem list [13]. The DT has demonstrated strong associations with established measures of depressive and anxious symptoms [16,27,33], and is found to be acceptable and feasible in busy clinical settings [18,30,31] (see section on Measures below). However, multi-item screening measures, such as the Hospital Anxiety and Depression Scale, offer greater psychometric rigor and diagnostic accuracy in detecting mental health conditions [15,27]. The downstream effects of these longer measures are understudied in terms of patient, provider, and healthcare system benefits and burdens pertinent to dissemination and implementation.

Efficacy of referral processes

After implementation of screening, the next step is to identify and implement an appropriate referral process for patients who receive a positive screen. Randomized controlled trials (RCTs) that specifically evaluated the impact of distress screening interventions (vs. psychosocial treatment interventions described below) have demonstrated benefits of screening among lung and breast cancer patients with elevated levels of distress, depression, and anxiety [7,30]. Other work has demonstrated lack of long-term benefits following distress screening [34] (see Gaps section below). The work by Carlson and colleagues has identified implementation factors that contribute to improved outcomes following distress screening, specifically how the screening information is used (e.g., uptake of referral vs. distress screening alone) [35]. Routine screening among lung cancer patients plus individualized referral yielded the most benefit for reducing physical and psychosocial problems [35]. As the field of distress screening interventions has grown, current efforts involve systematic reviews of RCTs specific to the impact of distress screening on improved patient-reported and health outcomes [36]. Initial reviews identified no consistent impact of distress screening alone on improved outcomes, leading some to oppose widespread distress screening implementation [37,38]. However, recent evaluations have demonstrated reductions in healthcare utilization when institutions adhere to distress screening protocols [9].

Efficacy of psychosocial interventions to reduce distress

Numerous RCTs of specific psychosocial interventions with cancer survivors have demonstrated efficacy in reducing cancer distress, most commonly measured as reductions in multi-item depressive or post-traumatic stress symptom measures [39–41]. Results from some RCTs also suggest potential improvements in nondistress endpoints such as telomere length [42] or increased survival associated with comprehensive cognitive behavioral interventions [15,40,41] and supportive–expressive interventions [43–45]. Meaning-centered psychotherapy has been associated with reduced distress specifically in advanced cancer populations [46]. While the above RCTs were led by doctoral-level interventionists, dissemination studies of psychosocial interventions show promise in distress reduction when facilitated by mid-level providers [47,48], patient navigators [49], community workers [50], and e- and m-health platforms (see Section below).

A recent meta-analysis identified survival benefits following psychosocial interventions but only among patients with early stage disease [51]. Other systematic reviews in specific cancer populations, such as prostate cancer, identified small and transient impacts of psychosocial interventions on outcomes such as cancer-related quality of life and physical components of general health-related quality of life [52].

Gaps in knowledge related to distress screening

While both research and policy have emphasized the importance of distress screening for identifying unmet needs of cancer patients, arguments against widespread distress screening focus on issues related to lack of operationalization, referral protocols, and evidence of screening impact [38,53,54]. First, although the term “distress” was selected because of its multidimensionality, distress remains a construct that is inconsistently operationalized. Since distress includes multiple domains (psychological, social, spiritual), it is difficult to measure with a single-item as recommended by some groups (e.g., DT recommended by NCCN). When screening for distress, it is unclear whether distress is the target condition or a presymptomatic state for another condition, such as depression or anxiety [54]. In 2014, the American Society for Clinical Oncology (ASCO) introduced a more specific guideline calling for screening of both depression and anxiety [15]. As noted in the CoC mandate, cancer centers can elect to screen for distress using the measures and procedures they prefer; such real-world implementation will result in various procedures and assessment tools. With the goal of ultimately reducing distress, research efforts focused on the referral and treatment procedures after a positive distress screen are still needed, no matter which measure is used.

Critical evaluation and need for research

Given the above concerns and gaps in existing knowledge, the mandate of distress screening in cancer populations is ripe with dissemination and implementation research questions that fall under the general question of “How do we best implement screening practices to benefit patient outcomes?” Within this general implementation question, specific research questions stem from uncertainty regarding optimal screening measure selection and complexity, criterion measure selection to demonstrate screening effectiveness, method and timing of screening administration, degree of individualization in referral mechanism, and patient interest, engagement, and benefit from referral. These questions should be considered from the perspective of all stakeholders (patient, family/caregiver, provider, organization/healthcare system) to include barriers and facilitators that may be conceptualized as secondary outcome measures (e.g., time and cost burdens). Processes to engage stakeholders from top down and bottom up perspectives are vital to optimize program reach and organizational adoption, implementation, maintenance and sustainability [55]. Integration of expertise from diverse fields, such as health information technology and human factors engineering, can help improve efficiency and effectiveness of distress screening [56]. Across dissemination and implementation efforts, reduction of patient distress should remain the primary outcome. Below we identify and describe the specific questions that will help translate the clinical mandates into evidence-based, efficient and sustainable distress screening programs. We conclude with a case example and recommendations for next steps.

Constructs important to optimizing distress screening

Key aspects of dissemination and implementation theory include understanding the context of outer setting (e.g., healthcare policy, accreditation standards such as the CoC distress screening mandate) and inner setting (e.g., local/regional healthcare system and organizational culture) (see Fig. 1). In terms of healthcare policy, the Department of Health and Human Service’s National Quality Strategy established by the Affordable Care Act [57] coincides with the Institute for Health Care Improvement Triple Aim of healthcare (improving the experience of care, improving health of populations, and reducing healthcare costs) [3,4]. These policies, along with adaptations such as consideration of a Quadruple Aim that includes attention to provider well-being [58], provide a common language that can be used to support interdisciplinary research that includes not only perspectives of the patient and provider, but the realities of healthcare as a business. Increasingly, improving patient health outcomes (e.g., survival, recurrence, behavioral and social determinants of health), patient experience (e.g., quality, satisfaction, reliability, accessibility, safety), and lowering healthcare costs are incentivized via reimbursement structures (e.g., incentivizing reduced 30-day hospital readmissions) and quality recognition (e.g., accreditation). Notably, the most all-cause 30-day readmissions for Medicaid patients are mood disorders (i.e., depression and bipolar disorders), and for private insured patients are maintenance chemotherapy/radiotherapy and then mood disorders [59].

Multiple levels involved in cancer care delivery mandates at cancer centers
Fig 1

Multiple levels involved in cancer care delivery mandates at cancer centers

These healthcare outcomes (health, experience, cost, see Table 1.) thus become mutual goals of the patient, family/caregivers, provider, payer, and healthcare system, which will help bring together teams of clinicians, administrators, patient advocates/caregivers, and researchers to achieve excellence in cancer care. As healthcare activities increasingly rely on untrained family/caregivers (e.g., caring for surgical sites, monitoring for fever, administering medications), it is important to include family/caregiver stakeholders. Caregivers may be more aware of patient distress and also experience distress themselves [47]. Indeed, awareness of multiple stakeholder needs, with a particular emphasis on caregiver and family-level approaches, is important across the continuum of cancer care from diagnosis to treatment to survivorship. Identification, treatment and monitoring of distress throughout this continuum can complement efforts to improve quality of care and thus reduce the cancer burden on patients, families, and healthcare systems.

Table 1

Distress and secondary outcomes to advance the dissemination and implementation science of distress screening

Triple Aim of Healthcare
CostsPatient ExperienceHealthcare outcomes
Distress
Hospitalization daysPatient satisfaction with comprehensive/overall cancer careSurvival
ER visitsSocial QOLRecurrence
ICU daysEmotional QOLBiomarkers
Readmission to hospital within 30 daysFunctional QOLPain
Number of patient phone calls documentedPhysical QOLFatigue
Billing dataFeasibility of navigating or managing care by patient or familyDepression
Staff time to administer screenPatient perceives partnership in careAnxiety
Provider time to interpret screen to determine referral needAdherence to cancer monitoring visits
False positive rate/unnecessary referralAdherence to preventive screening guidelines
False negative rate/ mental health needs fall to oncology providersTobacco cessation
Number referred/Number screenedPhysical activity
Order for mental health visit placedNutrition quality
Mental health visit documented
Number of mental health visits documented
Missed planned chemotherapy, radiation, or other cancer therapy session
Adverse healthcare-associated infection or other condition
Invasive procedures
Infections
Triple Aim of Healthcare
CostsPatient ExperienceHealthcare outcomes
Distress
Hospitalization daysPatient satisfaction with comprehensive/overall cancer careSurvival
ER visitsSocial QOLRecurrence
ICU daysEmotional QOLBiomarkers
Readmission to hospital within 30 daysFunctional QOLPain
Number of patient phone calls documentedPhysical QOLFatigue
Billing dataFeasibility of navigating or managing care by patient or familyDepression
Staff time to administer screenPatient perceives partnership in careAnxiety
Provider time to interpret screen to determine referral needAdherence to cancer monitoring visits
False positive rate/unnecessary referralAdherence to preventive screening guidelines
False negative rate/ mental health needs fall to oncology providersTobacco cessation
Number referred/Number screenedPhysical activity
Order for mental health visit placedNutrition quality
Mental health visit documented
Number of mental health visits documented
Missed planned chemotherapy, radiation, or other cancer therapy session
Adverse healthcare-associated infection or other condition
Invasive procedures
Infections

Sources: [3,45,82].

ER Emergency room; ICU Intensive care unit; QOL Quality of life.

Table 1

Distress and secondary outcomes to advance the dissemination and implementation science of distress screening

Triple Aim of Healthcare
CostsPatient ExperienceHealthcare outcomes
Distress
Hospitalization daysPatient satisfaction with comprehensive/overall cancer careSurvival
ER visitsSocial QOLRecurrence
ICU daysEmotional QOLBiomarkers
Readmission to hospital within 30 daysFunctional QOLPain
Number of patient phone calls documentedPhysical QOLFatigue
Billing dataFeasibility of navigating or managing care by patient or familyDepression
Staff time to administer screenPatient perceives partnership in careAnxiety
Provider time to interpret screen to determine referral needAdherence to cancer monitoring visits
False positive rate/unnecessary referralAdherence to preventive screening guidelines
False negative rate/ mental health needs fall to oncology providersTobacco cessation
Number referred/Number screenedPhysical activity
Order for mental health visit placedNutrition quality
Mental health visit documented
Number of mental health visits documented
Missed planned chemotherapy, radiation, or other cancer therapy session
Adverse healthcare-associated infection or other condition
Invasive procedures
Infections
Triple Aim of Healthcare
CostsPatient ExperienceHealthcare outcomes
Distress
Hospitalization daysPatient satisfaction with comprehensive/overall cancer careSurvival
ER visitsSocial QOLRecurrence
ICU daysEmotional QOLBiomarkers
Readmission to hospital within 30 daysFunctional QOLPain
Number of patient phone calls documentedPhysical QOLFatigue
Billing dataFeasibility of navigating or managing care by patient or familyDepression
Staff time to administer screenPatient perceives partnership in careAnxiety
Provider time to interpret screen to determine referral needAdherence to cancer monitoring visits
False positive rate/unnecessary referralAdherence to preventive screening guidelines
False negative rate/ mental health needs fall to oncology providersTobacco cessation
Number referred/Number screenedPhysical activity
Order for mental health visit placedNutrition quality
Mental health visit documented
Number of mental health visits documented
Missed planned chemotherapy, radiation, or other cancer therapy session
Adverse healthcare-associated infection or other condition
Invasive procedures
Infections

Sources: [3,45,82].

ER Emergency room; ICU Intensive care unit; QOL Quality of life.

Measurement

Considerable variability exists in the tools used to measure distress. Research is needed to assist teams in the selection of measures most appropriate for their specific settings, patients and anticipated process of distress screening [60]. As the distress screening mandate includes a mechanism for referral to mental healthcare providers, it seems imperative that the cut-off score or triage system is effective in detecting treatable mental health conditions. Clear efforts are needed related to evaluation of effectiveness (criterion and diagnostic validity; screening complexity and predictive validity). Below we highlight key measurement issues and identify areas for future research.

Effectiveness: validity and generalizability

The most commonly studied cancer distress screening measure is the single-item DT [13]. In studies of the DT, criterion validity is often evaluated using the Hospital Anxiety and Depression Scale (HADS) or other depressive symptom measures [27]. In terms of effectiveness, a systematic review of cancer distress screening measures found that the sensitivity and specificity of the DT was lower than 80% compared to gold-standard criterion measures, most of which focused on depression [15,27]. Another systematic review identified other brief measures (e.g., HADS; “1-item structured interview”) [61] as having better positive predictive value compared to the DT [16]. Studies employing blinded, psychometrically rigorous diagnostic interviews are needed to test the criterion of mental health diagnoses such as adjustment, anxiety, and depressive disorders [15,38].

Finally, the predictive value of screening measures remains an emerging area of study in terms of reductions in distress [27] and utilization of care [9]. Carlson et al. demonstrated that multiple-item screening that used a printed summary and included the availability of personalized triage improved distress through referrals [30]. One study of the DT and an associated problem list laudably examined three outcomes relevant to the Triple Aim, yet did not result in improved mood, increased referrals to psychological services, or cost savings [34]. A recent evaluation across 55 CoC-accredited healthcare settings demonstrated that among institutions adherent to their full distress screening protocol, emergency room visits and patient hospitalizations decreased by 18–19% [9]. The following questions need to be addressed as organizations review which screening measures to use for distress screening in which patient populations—all while weighing screening efficiency with accuracy:

  • • How do shorter distress measures relate concurrently to mental health diagnoses, which the longer criterion measures were created to detect?

  • • What is the downstream effectiveness—impact on experience of care, healthcare outcomes, and cost—of distress screening measures that vary in psychometric strength?

  • • Do positive screens result in patients receiving evidence-based interventions?

  • • Do positive screens lead to reduced distress? By what mechanisms?

  • • How do psychometrics of screening measures vary by cancer population?

  • • How many false positive screens occur and what is the impact on experience of care, healthcare outcomes, and cost of distress screening?

Adoption: acceptability, feasibility, healthcare costs, and time burden

The debate surrounding distress measure selection is salient within the literature and numerous editorial commentaries. A common reason for adoption of short measures is to minimize patient and healthcare system burden; brief measures appear to be more acceptable to busy staff [17]. However with 30–50% of cancer patients screening positive on short measures and high false positive rates that approach 50%, the downstream burden of short measures may be greater (e.g., need for further screening and triage efforts in a large subsample) [16,35]. Thus, measurement selection may differentially impact provider behavior and the setting of criteria for when further assessment, evaluation, and treatment of distress is needed.

Longer measures, while often possessing stronger psychometric properties [27], are more likely to incur upstream health system costs (scoring time, documentation time, purchase costs for some) and upstream patient burden of time [27], although this issue can be mitigated through the use of tablets for data-assessment and the automatic computation of values indicating risk of distress which would trigger action by providers [62,63]. Likewise, recommendations have been made to include assessment of patients’ interest in referral at the time of distress screening [27,64]. Research questions related to adoption of distress screening include:

  • • Do the downstream effects of higher test sensitivity and specificity of longer screening measures translate into more efficient, targeted screening in terms of reduced healthcare costs and patient and provider burden (e.g., less number of patients screening positive, less need for further assessment and triage, less unnecessary referrals)?

  • • Can computerized adaptive testing (e.g., PROMIS), which tailors questions to each individual patient, be successfully implemented in the clinical setting to reduce the number of items that patients answer while maintaining rigorous psychometric properties?

  • • Does screening effectiveness improve with an additional item to query the patient’s interest in a mental health referral?

  • • In terms of emotional distress, is it more efficient to use a two- or three-tiered screening system (e.g., distress screen --> depression and anxiety screen --> mental health referral, vs. depression and anxiety screen --> mental health referral)?

Implementation

Implementation barriers

Previous research in primary care and oncology clinical settings has identified multiple barriers to the successful implementation of cancer distress screening [19,32]. At the patient level, individuals may encounter barriers in receiving screening or adequate referral and follow-up due to lack of insurance, being unaware of available resources, lacking in self-advocacy, being hesitant to discuss emotional issues with their providers for cultural reasons or due to stigma, and other demographic factors (e.g., age, language). At the provider-level, barriers include time availability, provider knowledge and skill in performing the screening, and trust between patients and providers. Provider-level barriers may further depend on the disciplinary background of the providers involved, buy-in from organizational leadership and depth of the allied healthcare team in terms of capacity to provide referrals, treatment, and follow-up. At the setting level, availability of provider training and adequate access to available referral resources are important factors. Psychologists and other behavioral and mental health providers are well-suited to lead teams of allied health professionals to deliver care or ensure appropriate referral of distressed patients. With the dearth of behavioral health specialists in medical settings, increased attention to training opportunities for other members of the cancer care team will be important with the growing number of cancer survivors. Examples include focused training in psychosocial oncology through National Cancer Institute-supported R25 training grants or preconference workshops led by professional organizations with depth and expertise in behavioral health (e.g., Society of Behavioral Medicine).

Implementation: facilitators and patient engagement

Postscreen activities of triage and patient engagement in care are critical to reducing distress [65]. Ultimately, an estimated 11–12% of the eligible screening population engages in referral care [7,63,66]. Carlson demonstrated that regardless of one-time triage type (personalized phone call, computerized triage), patients who engaged in care over the subsequent 1-year experienced greater decreases in distress, anxiety, and depression (assessed by single-item Likert scales). A study of computerized screening among over 800 mixed-type cancer patients found that patient interest in counseling/therapy was associated with history of mental health diagnosis, medications, or therapy, as well as physical symptom burden, and possibly ethnic minority status [67]. Identified gaps include the following questions:

  • • What are individual characteristics of patients interested in services? Is mental health history important?

  • • What methods engage patients who will use and benefit from intervention?

  • • Does screening with depression and anxiety symptom measures result in more efficient triage (e.g., less false positive and less downstream staff burden)? More efficient use of referrals?

  • • How do we ensure fidelity to screening, triage, and intervention processes across providers?

Implementation: partnering with health systems and case example

Cancer care is delivered through cancer centers located in the community, centers with National Cancer Institute designation, community-based and advocacy organizations, and ambulatory centers [68,69]. Only a small number of cancer patients (approximately 15%) receive care at comprehensive cancer centers, with more patients seen at community-based cancer centers [70]. Recent data suggest that community centers are having greater success in implementing the distress screening mandate [10]. Use of electronic health records (EHRs) can facilitate implementation and communication across partner disciplines [71]. For example, evaluation of an electronic patient-reported outcomes system (ePRO) to meet distress screening mandates was effective in identifying and providing the infrastructure for patient referral and treatment of distress [48]. Learning from settings with successful implementation and partnering with the local healthcare system and cancer care organizations is vital to implementation.

Case example at a comprehensive cancer center

At a comprehensive cancer center located in the mid-Atlantic region of the USA, we adapted the NCCN Distress Thermometer Screen and associated problem list to be administered via tablets. All new patients presenting for their first clinic visit complete a New Patient Assessment at check-in, which includes the DT, the PROMIS six-item Depression and Anxiety short forms [72,73] and several other questions. Patient scores on the DT automatically populate the notes section of the EHR. When patients are taken into an exam room, the medical assistant also enters the Distress score into the vital signs section with the other vital signs.

Between April 1, 2017 and April 30, 2018, approximately 1,750 patients completed a DT. Of these patients, 34.9% reported mild distress (1–3); 38.9% reported moderate distress (4–7); 7.4% indicated high to severe distress (7–10); and 18.7% reported no distress (0). The most commonly reported problems from the DT problem checklist included: fatigue (16%); coping with illness (14%); feeling anxious or fearful (11%); pain management (9%); and sleep disturbance (7%).

Presently, an e-mail alert is sent to all social workers when a patient indicates a distress score of 7 or above and/or if a patient indicates that he/she needs or wants additional information based on the problem list. Scores of 7 (moderate distress) trigger a follow-up call within 1 week, 8 or 9 (high distress) prompt a call within 5 business days, and a score of 10 (extreme distress) triggers an alert to the social worker who will see or talk with the patient within 24 hr. These cut-off scores were determined based on practical constraints. If the social worker deems the patient could benefit from additional services, the patient is referred to the clinical psychologist and/or psychiatrist in the cancer center. The experiences within this cancer center highlight the importance of having the distress screening efforts championed by someone with mental and behavioral health expertise, the challenges of implementation and integration into the EHR and the need for multidisciplinary input across mental health, digital health records and information technology, such as E- and m-health platforms.

Implementation and reach: E-health and m-health platforms

Generally, e-health and m-health (i.e., electronic and mobile health) technologies are of high interest in addressing the myriad challenges in the modern healthcare system. As part of the legislation known as HITECH (Health Information Technology for Economic and Clinical Health Act of 2009) [74], healthcare stakeholders have been encouraged to consider opportunities for “meaningful use” of EHRs, including optimizing access and use of health information in improving health outcomes. This priority was also reiterated by the National Institutes of Health in 2011, in conjunction with the National Science Foundation, calling for a concerted effort to build a “cyberinfrastructure,” which would support health data storage, management and integration, and facilitate the translation of scientific evidence into clinical practice [75].

Cancer survivors are consistently found to be receptive to electronic health information exchange with providers, especially for the purposes of receiving information about recommended tests, symptom management (including distress) and lifestyle advice [76,77]. A recent trial of a tablet/internet-based program for symptom monitoring decreased distress in oncology patients, when combined with opportunities for clinical consultation [78]. Ultimately, these tools need to be meaningfully integrated with EHRs, to address compliance with “meaningful use” objectives, facilitate practical use among medical teams, and reduce the potential for disparities in access or use of distress management tools (e.g., across education level, income, and age) [78,79]. Identified gaps and questions pertinent to e- and m-health platforms include:

  • • How can we optimally design the provider interface to best support distress screening and triage? Distress management?

  • • How can e-/m- health technology be seamlessly integrated with the EHR and other workflow processes to reduce the burden on clinicians and patients?

  • • How can providers be compensated for non-face-to-face consultation time?

  • • What level of provider interaction do patients prefer in distress management? Can e-health approaches work effectively across different patient populations?

  • • How can we best tailor patient-facing e-health or EHR tools to varying levels of patient health literacy?

Human factors engineering is a scientific discipline that can help address many of these questions within team science approaches. Human factors focus on understanding human capabilities and applying this knowledge to improve technology, workflow processes, and other aspects of the healthcare system to support both providers and patients [80]. It can be applied to specific aspects of the healthcare system, such as improving the interface of tablets to collect patient-reported outcome data more effectively by promoting design, development, and implementation that prioritizes end-users needs. Human factors engineering also provides a framework for considering multiple aspects of the complex healthcare system, through a socio-technical systems (STS) approach [81]. STS models provide a method to understand the interactions between multiple healthcare system levels inclusive of technologies, people, work processes, policies, and other factors so that these factors can be optimized for patient outcomes and provider experience and performance. Human factors engineering has been embraced by many high risk and complex industries such as aviation, nuclear energy, and defense; it is increasingly being applied to healthcare and has significant potential to improve quality of care and patient outcomes. Specific to distress screening, human factors approaches can help identify how to optimize the flow of information for improving efficiencies and quality of care along all of the CoC’s Standard 3.2 process requirements: timing of screening, method, tools, assessment, referral, and documentation [1]. Evaluation of distress screening approaches using a human factors approach can identify and correct system-level constraints that impede the process. For example, such an approach can be useful in terms of identifying ineffective alert systems: settings in which high distress scores have to be visually screened by a member of the team and then manually flagged and moved from a “notes” section in the EHR rather than relying on technology to have an automated process. In addition, a human factors approach can identify gaps in communication between healthcare providers: referrals for distressed patients may not be followed-up on by the patient or provider in a timely manner. These approaches can be helpful during implementation of a new distress screening program or as a way to improve efficiency and effectiveness of an existing distress screening program.

CONCLUSION

With the recent accreditation mandate for cancer distress screening, accredited cancer centers across the USA are implementing procedures to effectively screen for and treat distress. Although screening implementation procedures vary and a number of pivotal measurement issues need to be resolved, we have a growing body of literature to support and guide future efforts for effective distress screening interventions in terms of organizational and provider adoption and implementation. As providers and researchers continue to evaluate various distress screening tools, we anticipate that a few select screening measures will emerge as both efficient and effective. Careful attention to effectiveness and efficiency across different populations and various assessment platforms is needed. Efficient single-item screening approaches such as the DT may be of value, but the predictive validity and downstream costs of these brief tools need to be established. In addition to interventions that screen for distress, research is needed to optimize referral procedures, ensure effectiveness of treatment approaches, and understand the composition of the teams best suited to participate in screening, assessment and treatment. Behavioral interventions can be used not only to treat acute distress but also maintain reduced distress that remains evident among subgroups of cancer survivors [21]. Distress screening can include facilitation by mid-level providers with supervision from a licensed, perhaps doctoral-level trained, behavioral health specialist. One policy level recommendation is that evaluation of the standards for Distress Screening could include assessment of the appropriateness of the multidisciplinary expertise of the teams responsible for the implementation and follow-through of the CoC Distress Screening mandate. By utilizing multidisciplinary expertise within the complexities of the U.S. healthcare system, and relying on evidence-based approaches to dissemination and implementation of both distress screening and treatment, we can keep patient-centered care at the forefront. Improving outcomes for the millions of cancer survivors is the ultimate goal. We look forward to robust clinical and research efforts to inform distress screening policy.

Compliance with Ethical Standards

Authors Contributions: S.L.E. and K.D.G. conceived of the paper idea; S.L.E., S.M.B., L.M.Q., J.K., M.A.D., K.D.G. contributed to the initial drafting of the manuscript. All authors contributed to the interpretation and discussion and provided critical feedback on the final paper.

Conflicts of Interest: All authors declare that they have no conflicts of interest.

Ethical Approval: This article does not contain any studies involving human participants.

Acknowledgments:

We would like to thank Ms. Susan Marx and Dr. Abigail Montero for their assistance with manuscript preparation. We would also like to acknowledge the Cancer Special Interest Group at the Society of Behavioral Medicine as this manuscript stemmed from a pre-conference seminar hosted by the Cancer Special Interest Group. This work was supported in part by the P30CA051008-24 and the Survivorship Research Initiative at Lombardi Comprehensive Cancer Center, Georgetown University.

References

1.

American College of Surgeons Commission on Cancer
.
Cancer Program Standards: Ensuring Patient-Centered Care Manual (2016 Edition). Standard 3.2 - Psychosocial Distress Screening
, pp.
56
57
. Available from: https://www.facs.org/quality-programs/cancer/coc/standards.
Accessibility verified June 1, 2018
.

2.

American College of Surgeons Commission on Cancer
.
Cancer Program Standards 2012: Ensuring Patient-Centered Care. V.1.2.1. Standard 3.2 - Psychosocial Distress Screening
, pp.
76
77
. Available from: https://www.facs.org/~/media/files/quality%20programs/cancer/coc/programstandards2012.ashx.
Accessibility verified June 1, 2018
.

3.

Berwick
DM
,
Nolan
TW
,
Whittington
J
.
The triple aim: care, health, and cost
.
Health Aff (Millwood)
.
2008
;
27
(
3
):
759
769
.

4.

Stiefel
M
,
Nolan
K.
A Guide to Measuring the Triple Aim: Population Health, Experience of Care, and Per Capita Cost
.
Cambridge, IHI Innovation Series white paper. Institute for Healthcare Improvement: MA
;
2012
.

5.

Adler
NE
,
Page
AE
, eds.
Cancer Care for the Whole Patient: Meeting Psychosocial Health Needs
.
Washington, DC
:
The National Academies Press
;
2008
.

6.

Pirl
WF
,
Fann
JR
,
Greer
JA
, et al.
Recommendations for the implementation of distress screening programs in cancer centers: report from the American Psychosocial Oncology Society (APOS), Association of Oncology Social Work (AOSW), and Oncology Nursing Society (ONS) joint task force
.
Cancer
.
2014
;
120
(
19
):
2946
2954
.

7.

Carlson
LE
,
Waller
A
,
Mitchell
AJ
.
Screening for distress and unmet needs in patients with cancer: review and recommendations
.
J Clin Oncol
.
2012
;
30
(
11
):
1160
1177
.

8.

Kendall
J
,
Glaze
K
,
Oakland
S
,
Hansen
J
,
Parry
C
.
What do 1281 distress screeners tell us about cancer patients in a community cancer center
?
Psychooncology
.
2011
;
20
(
6
):
594
600
.

9.

Zebrack
B
,
Kayser
K
,
Bybee
D
, et al.
A practice-based evaluation of distress screening protocol adherence and medical service utilization
.
J Natl Compr Canc Netw
.
2017
;
15
(
7
):
903
912
.

10.

Zebrack
B
,
Kayser
K
,
Padgett
L
,
Jobin
C
,
Sundstrom
L
.
Assessing institutional capacity to implement psychosocial support services: the National Cancer Institute Psychosocial Care Matrix
.
Psycho-Oncology
.
2015
;
24
(
Suppl 2
):
53
4
.

11.

Faller
H
,
Schuler
M
,
Richard
M
,
Heckl
U
,
Weis
J
,
Küffner
R
.
Effects of psycho-oncologic interventions on emotional distress and quality of life in adult patients with cancer: systematic review and meta-analysis
.
J Clin Oncol
.
2013
;
31
(
6
):
782
793
.

12.

Lutgendorf
SK
,
Andersen
BL
.
Biobehavioral approaches to cancer progression and survival: mechanisms and interventions
.
Am Psychol
.
2015
;
70
(
2
):
186
197
.

13.

National Comprehensive Cancer Network
.
NCCN Clinical Practice Guidelines in Oncology (NCCN Guidelines): Distress Management. Version 2.2018
. Available from: https://www.nccn.org/professionals/physician_gls/pdf/distress.pdf

14.

Zabora
JR
.
Distress screening guidelines for oncology social workers
. In:
Christ
G
,
Messner
C
,
Behar
L
, eds.
Handbook of Oncology Social Work: Psychosocial Care for People with Cancer
.
New York, NY
:
Oxford University Press
;
2015
:
115
119
.

15.

Andersen
BL
,
DeRubeis
RJ
,
Berman
BS
, et al. ;
American Society of Clinical Oncology
.
Screening, assessment, and care of anxiety and depressive symptoms in adults with cancer: an American Society of Clinical Oncology guideline adaptation
.
J Clin Oncol
.
2014
;
32
(
15
):
1605
1619
.

16.

Mitchell
AJ
.
Pooled results from 38 analyses of the accuracy of distress thermometer and other ultra-short methods of detecting cancer-related mood disorders
.
J Clin Oncol
.
2007
;
25
(
29
):
4670
4681
.

17.

Mitchell
AJ
,
Kaar
S
,
Coggan
C
,
Herdman
J
.
Acceptability of common screening methods used to detect distress and related mood disorders-preferences of cancer specialists and non-specialists
.
Psychooncology
.
2008
;
17
(
3
):
226
236
.

18.

Mitchell
AJ
,
Lord
K
,
Slattery
J
,
Grainger
L
,
Symonds
P
.
How feasible is implementation of distress screening by cancer clinicians in routine clinical care
?
Cancer
.
2012
;
118
(
24
):
6260
6269
.

19.

Mitchell
AJ
,
Vahabzadeh
A
,
Magruder
K
.
Screening for distress and depression in cancer settings: 10 lessons from 40 years of primary-care research
.
Psychooncology
.
2011
;
20
(
6
):
572
584
.

20.

Zabora
J
,
BrintzenhofeSzoc
K
,
Curbow
B
,
Hooker
C
,
Piantadosi
S
.
The prevalence of psychological distress by cancer site
.
Psychooncology
.
2001
;
10
(
1
):
19
28
.

21.

Brown
KW
,
Levy
AR
,
Rosberger
Z
,
Edgar
L
.
Psychological distress and cancer survival: a follow-up 10 years after diagnosis
.
Psychosom Med
.
2003
;
65
(
4
):
636
643
.

22.

DiMatteo
MR
,
Lepper
HS
,
Croghan
TW
.
Depression is a risk factor for noncompliance with medical treatment: meta-analysis of the effects of anxiety and depression on patient adherence
.
Arch Intern Med
.
2000
;
160
(
14
):
2101
2107
.

23.

Shim
EJ
,
Mehnert
A
,
Koyama
A
, et al.
Health-related quality of life in breast cancer: a cross-cultural survey of German, Japanese, and South Korean patients
.
Breast Cancer Res Treat
.
2006
;
99
(
3
):
341
350
.

24.

Arrieta
O
,
Angulo
LP
,
Núñez-Valencia
C
, et al.
Association of depression and anxiety on quality of life, treatment adherence, and prognosis in patients with advanced non-small cell lung cancer
.
Ann Surg Oncol
.
2013
;
20
(
6
):
1941
1948
.

25.

Barber
B
,
Dergousoff
J
,
Nesbitt
M
, et al.
Depression as a predictor of postoperative functional performance status (PFPS) and treatment adherence in head and neck cancer patients: a prospective study
.
J Otolaryngol Head Neck Surg
.
2015
;
44
:
38
.

26.

Satin
JR
,
Linden
W
,
Phillips
MJ
.
Depression as a predictor of disease progression and mortality in cancer patients: a meta-analysis
.
Cancer
.
2009
;
115
(
22
):
5349
5361
.

27.

Vodermaier
A
,
Linden
W
,
Siu
C
.
Screening for emotional distress in cancer patients: a systematic review of assessment instruments
.
J Natl Cancer Inst
.
2009
;
101
(
21
):
1464
1488
.

28.

Hoffman
BM
,
Zevon
MA
,
D’Arrigo
MC
,
Cecchini
TB
.
Screening for distress in cancer patients: the NCCN rapid-screening measure
.
Psychooncology
.
2004
;
13
(
11
):
792
799
.

29.

Jacobsen
PB
,
Donovan
KA
,
Trask
PC
, et al.
Screening for psychologic distress in ambulatory cancer patients
.
Cancer
.
2005
;
103
(
7
):
1494
1502
.

30.

Carlson
LE
,
Groff
SL
,
Maciejewski
O
,
Bultz
BD
.
Screening for distress in lung and breast cancer outpatients: a randomized controlled trial
.
J Clin Oncol
.
2010
;
28
(
33
):
4884
4891
.

31.

Morasso
G
,
Di Leo
S
,
Caruso
A
, et al.
Evaluation of a screening programme for psychological distress in cancer survivors
.
Support Care Cancer
.
2010
;
18
(
12
):
1545
1552
.

32.

Pincus
HA
,
Patel
SR
.
Barriers to the delivery of psychosocial care for cancer patients: bridging mind and body
.
J Clin Oncol
.
2009
;
27
(
5
):
661
662
.

33.

Ma
X
,
Zhang
J
,
Zhong
W
, et al.
The diagnostic role of a short screening tool–the distress thermometer: a meta-analysis
.
Support Care Cancer
.
2014
;
22
(
7
):
1741
1755
.

34.

Hollingworth
W
,
Metcalfe
C
,
Mancero
S
, et al.
Are needs assessments cost effective in reducing distress among patients with cancer? A randomized controlled trial using the Distress Thermometer and Problem List
.
J Clin Oncol
.
2013
;
31
(
29
):
3631
3638
.

35.

Carlson
LE
.
Screening alone is not enough: the importance of appropriate triage, referral, and evidence-based treatment of distress and common problems
.
J Clin Oncol
.
2013
;
31
(
29
):
3616
3617
.

36.

McCarter
K
,
Britton
B
,
Baker
AL
, et al.
Interventions to improve screening and appropriate referral of patients with cancer for psychosocial distress: systematic review
.
BMJ Open
.
2018
;
8
(
1
):
e017959
.

37.

Coyne
JC
.
Benefits of screening cancer patients for distress still not demonstrated
.
Br J Cancer
.
2013
;
108
(
3
):
736
737
.

38.

Meijer
A
,
Roseman
M
,
Delisle
VC
, et al.
Effects of screening for psychological distress on patient outcomes in cancer: a systematic review
.
J Psychosom Res
.
2013
;
75
(
1
):
1
17
.

39.

Brothers
BM
,
Yang
HC
,
Strunk
DR
,
Andersen
BL
.
Cancer patients with major depressive disorder: testing a biobehavioral/cognitive behavior intervention
.
J Consult Clin Psychol
.
2011
;
79
(
2
):
253
260
.

40.

Stagl
JM
,
Bouchard
LC
,
Lechner
SC
, et al.
Long-term psychological benefits of cognitive-behavioral stress management for women with breast cancer: 11-year follow-up of a randomized controlled trial
.
Cancer
.
2015
;
121
(
11
):
1873
1881
.

41.

Stagl
JM
,
Lechner
SC
,
Carver
CS
, et al.
A randomized controlled trial of cognitive-behavioral stress management in breast cancer: survival and recurrence at 11-year follow-up
.
Breast Cancer Res Treat
.
2015
;
154
(
2
):
319
328
.

42.

Carlson
LE
,
Beattie
TL
,
Giese-Davis
J
, et al.
Mindfulness-based cancer recovery and supportive-expressive therapy maintain telomere length relative to controls in distressed breast cancer survivors
.
Cancer
.
2015
;
121
(
3
):
476
484
.

43.

Fawzy
FI
,
Canada
AL
,
Fawzy
NW
.
Malignant melanoma: effects of a brief, structured psychiatric intervention on survival and recurrence at 10-year follow-up
.
Arch Gen Psychiatry
.
2003
;
60
(
1
):
100
103
.

44.

Giese-Davis
J
,
Collie
K
,
Rancourt
KM
,
Neri
E
,
Kraemer
HC
,
Spiegel
D
.
Decrease in depression symptoms is associated with longer survival in patients with metastatic breast cancer: a secondary analysis
.
J Clin Oncol
.
2011
;
29
(
4
):
413
420
.

45.

Spiegel
D
.
Mind matters in cancer survival
.
Psychooncology
.
2012
;
21
(
6
):
588
593
.

46.

Breitbart
W
,
Rosenfeld
B
,
Pessin
H
,
Applebaum
A
,
Kulikowski
J
,
Lichtenthal
WG
.
Meaning-centered group psychotherapy: an effective intervention for improving psychological well-being in patients with advanced cancer
.
J Clin Oncol
.
2015
;
33
(
7
):
749
754
.

47.

Chambers
SK
,
Girgis
A
,
Occhipinti
S
, et al.
A randomized trial comparing two low-intensity psychological interventions for distressed patients with cancer and their caregivers
.
Oncol Nurs Forum
.
2014
;
41
(
4
):
E256
E266
.

48.

Smith
SK
,
O’Donnell
JD
,
Abernethy
AP
,
MacDermott
K
,
Staley
T
,
Samsa
GP
.
Evaluation of Pillars4life: a virtual coping skills program for cancer survivors
.
Psychooncology
.
2015
;
24
(
11
):
1407
1415
.

49.

Mollica
MA
,
Nemeth
LS
,
Newman
SD
,
Mueller
M
,
Sterba
K
.
Peer navigation in African American breast cancer survivors
.
Patient Relat Outcome Meas
.
2014
;
5
:
131
144
.

50.

Ashing
K
,
Rosales
M
.
A telephonic-based trial to reduce depressive symptoms among Latina breast cancer survivors
.
Psychooncology
.
2014
;
23
(
5
):
507
515
.

51.

Oh
PJ
,
Shin
SR
,
Ahn
HS
,
Kim
HJ
.
Meta-analysis of psychosocial interventions on survival time in patients with cancer
.
Psychol Health
.
2016
;
31
(
4
):
396
419
.

52.

Parahoo
K
,
McDonough
S
,
McCaughan
E
, et al.
Psychosocial interventions for men with prostate cancer
.
Cochrane Database Syst Rev
.
2013
(
12
):
CD008529
.

53.

Padgett
LE
,
Parry
C
,
Taplin
S
.
Next steps for psychosocial screening in oncology
. In:
Christ
G
,
Messner
C
,
Behar
L
, eds.
Handbook of Oncology Social Work: Psychosocial Care for People with Cancer
.
New York, NY
:
Oxford University Press
;
2015
:
163
167
.

54.

Thombs
BD
,
Coyne
JC
.
Moving forward by moving back: re-assessing guidelines for cancer distress screening
.
J Psychosom Res
.
2013
;
75
(
1
):
20
22
.

55.

Stokols
D
,
Allen
J
,
Bellingham
RL
.
The social ecology of health promotion: implications for research and practice
.
Am J Health Promot
.
1996
;
10
(
4
):
247
251
.

56.

Boeschoten
RE
,
Uitdehaag
BM
,
van Oppen
P
, et al.
A computer-based screening method for distress in patients with multiple sclerosis: a feasibility study
.
JMIR Res Protoc
.
2014
;
3
(
2
):
e29
.

57.

Agency for Healthcare Research and Quality
.
Slide Set: National Quality Strategy Overview
.
2017
. Available from: https://www.ahrq.gov/workingforquality/nqs-tools/briefing-slides.html.
Accessibility verified June 1, 2018
.

58.

Bodenheimer
T
,
Sinsky
C
.
From triple to quadruple aim: care of the patient requires care of the provider
.
Ann Fam Med
.
2014
;
12
(
6
):
573
576
.

59.

Hines
AL
,
Barrett
ML
,
Jiang
HJ
,
Steiner
CA
.
Conditions With the Largest Number of Adult Hospital Readmissions by Payer, 2011: Statistical Brief #172
.
2006
. In:
Healthcare Cost and Utilization Project (HCUP) Statistical Briefs [Internet]
.
Rockville, MD
:
Agency for Healthcare Research and Quality
. Available from: https://www.ncbi.nlm.nih.gov/books/NBK206781/

60.

Damschroder
LJ
,
Hagedorn
HJ
.
A guiding framework and approach for implementation research in substance use disorders treatment
.
Psychol Addict Behav
.
2011
;
25
(
2
):
194
205
.

61.

Akizuki
N
,
Akechi
T
,
Nakanishi
T
, et al.
Development of a brief screening interview for adjustment disorders and major depression in patients with cancer
.
Cancer
.
2003
;
97
(
10
):
2605
2613
.

62.

Carlson
LE
,
Waller
A
,
Groff
SL
,
Bultz
BD
.
Screening for distress, the sixth vital sign, in lung cancer patients: effects on pain, fatigue, and common problems–secondary outcomes of a randomized controlled trial
.
Psychooncology
.
2013
;
22
(
8
):
1880
1888
.

63.

Carlson
LE
,
Waller
A
,
Groff
SL
,
Zhong
L
,
Bultz
BD
.
Online screening for distress, the 6th vital sign, in newly diagnosed oncology outpatients: randomised controlled trial of computerised vs personalised triage
.
Br J Cancer
.
2012
;
107
(
4
):
617
625
.

64.

Garssen
B
,
Van der Lee
M
.
Re: screening for emotional distress in cancer patients: a systematic review of assessment instruments
.
J Natl Cancer Inst
.
2010
;
102
(
7
):
506
508; author reply 508
.

65.

Donovan
KA
,
Grassi
L
,
McGinty
HL
,
Jacobsen
PB
.
Validation of the distress thermometer worldwide: state of the science
.
Psychooncology
.
2014
;
23
(
3
):
241
250
.

66.

Sellick
SM
,
Edwardson
AD
.
Screening new cancer patients for psychological distress using the hospital anxiety and depression scale
.
Psychooncology
.
2007
;
16
(
6
):
534
542
.

67.

O’Hea
EL
,
Monahan
BR
,
Cutillo
A
,
Person
SD
,
Grissom
G
,
Boudreaux
ED
.
Predictors of psychological distress and interest in mental health services in individuals with cancer
.
J Health Psychol
.
2016
;
21
(
6
):
1145
56
.

68.

Lazenby
M
,
Ercolano
E
,
Grant
M
,
Holland
JC
,
Jacobsen
PB
,
McCorkle
R
.
Supporting commission on cancer-mandated psychosocial distress screening with implementation strategies
.
J Oncol Pract
.
2015
;
11
(
3
):
e413
e420
.

69.

Lazenby
M
,
Tan
H
,
Pasacreta
N
,
Ercolano
E
,
McCorkle
R
.
The five steps of comprehensive psychosocial distress screening
.
Curr Oncol Rep
.
2015
;
17
(
5
):
447
.

70.

National Cancer Institute
.
Community Oncology Research Program
.
2018
. Available from: http://ncorp.cancer.gov/.
Accessibility verified June 1, 2018
.

71.

Bestek
M
,
Brodnik
A
.
Interoperability and mHealth -- Precondition for Successful eCare
. In:
Adibi
S
, ed.
Mobile Health: A Technology Road Map
.
5
.
Switzerland
:
Springer
;
2015
:
345
374
.

72.

HealthMeasures
.
PROMIS Short Form v.1.0 - Anxiety 6a
.
2018
. Available from: http://www.healthmeasures.net/explore-measurement-systems/promis/obtain-administer-measures.
Accessibility verified June 1, 2018
.

73.

HealthMeasures
.
PROMIS Short Form v.1.0 - Depression 6a
.
2018
. Available from: http://www.healthmeasures.net/explore-measurement-systems/promis/obtain-administer-measures.
Accessibility verified June 1, 2018
.

74.

Blumenthal
D
,
Tavenner
M
.
The “meaningful use” regulation for electronic health records
.
N Engl J Med
.
2010
;
363
(
6
):
501
504
.

75.

Hesse
BW
,
Croyle
RT
,
Buetow
KH
.
Cyberinfrastructure and the biomedical sciences
.
Am J Prev Med
.
2011
;
40
(
5 Suppl 2
):
S97
102
.

76.

Beckjord
EB
,
Rechis
R
,
Nutt
S
,
Shulman
L
,
Hesse
BW
.
What do people affected by cancer think about electronic health information exchange? Results from the 2010 LIVESTRONG Electronic Health Information Exchange Survey and the 2008 Health Information National Trends Survey
.
J Oncol Pract
.
2011
;
7
(
4
):
237
241
.

77.

Bluethmann
SM
,
Coa
KI
,
Alfano
CM
,
Hesse
BW
.
Electronic health information exchange opportunities for self-management of care: responses from older adults with and without cancer history in the United States
.
Curr Oncol Rep
.
2018
;
20
(
4
):
30
.

78.

Berry
DL
,
Blonquist
TM
,
Patel
RA
,
Halpenny
B
,
McReynolds
J
.
Exposure to a patient-centered, Web-based intervention for managing cancer symptom and quality of life issues: impact on symptom distress
.
J Med Internet Res
.
2015
;
17
(
6
):
e136
.

79.

Choi
NG
,
Dinitto
DM
.
The digital divide among low-income homebound older adults: internet use patterns, eHealth literacy, and attitudes toward computer/Internet use
.
J Med Internet Res
.
2013
;
15
(
5
):
e93
.

80.

Karsh
BT
,
Holden
RJ
,
Alper
SJ
,
Or
CK
.
A human factors engineering paradigm for patient safety: designing to support the performance of the healthcare professional
.
Qual Saf Health Care
.
2006
;
15
(
Suppl 1
):
i59
i65
.

81.

Carayon
P
.
Human factors of complex sociotechnical systems
.
Appl Ergon
.
2006
;
37
(
4
):
525
535
.

This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://dbpia.nl.go.kr/journals/pages/open_access/funder_policies/chorus/standard_publication_model)