Abstract

Patient-reported outcomes (PROs) provide important insights into patients’ own perspectives about their health and medical condition, and there is evidence that their use can lead to improvements in the quality of care and to better-informed clinical decisions. Their application in cardiovascular populations has grown over the past decades. This statement describes what PROs are, and it provides an inventory of disease-specific and domain-specific PROs that have been developed for cardiovascular populations. International standards and quality indices have been published, which can guide the selection of PROs for clinical practice and in clinical trials and research; patients as well as experts in psychometrics should be involved in choosing which are most appropriate. Collaborations are needed to define criteria for using PROs to guide regulatory decisions, and the utility of PROs for comparing and monitoring the quality of care and for allocating resources should be evaluated. New sources for recording PROs include wearable digital health devices, medical registries, and electronic health record. Advice is given for the optimal use of PROs in shared clinical decision-making in cardiovascular medicine, and concerning future directions for their wider application.

The importance of patient-reported outcomes (PROs), their components, and their potential contributions in cardiology.
Graphical Abstract

The importance of patient-reported outcomes (PROs), their components, and their potential contributions in cardiology.

Introduction

Patient-reported outcomes (PROs) are increasingly used as a standardized means of integrating and reporting patients’ own perspectives in the assessment of their health and medical condition. PROs are typically defined as ‘any report of the status of a patient’s health condition that comes directly from the patient, without interpretation of the patient’s response by a clinician or anyone else’.1 Combined with clinical outcomes, PROs reflect the totality of outcomes of care in patients. Ideally, healthcare aims at improving both clinical outcomes and PROs (Figure 1).2

Effective healthcare improves both clinical and patient-reported outcomes.
Figure 1

Effective healthcare improves both clinical and patient-reported outcomes.

Whereas PROs were initially used for descriptive clinical research and population-based surveys, they gradually found their way into clinical practice.3,4 PROs are of particular importance for the monitoring and management of chronic conditions affecting quality of life. They can be used for individual assessment to support decisions and to evaluate aspects of quality of care.5–8 To support the use of PROs in the routine clinical setting, electronic- or ePROs have been developed recently, and real-time data collection is gaining more traction.9 Moreover, PROs are increasingly used to assess treatments and interventions in clinical trials, informing regulatory and reimbursement decisions for drugs and medical devices.10–14 However, the use of PROs is not without methodological challenges; there are gaps between the underpinning evidence and the current practical implementation, which challenges their use and interpretation.15,16

Papers advocating for the use of PROs in the field of cardiology have been published by the American Heart Association (AHA) in 201317 and the European Society of Cardiology (ESC) in 2014.18 The AHA statement advocated for the assessment of patient-reported health status as a measure of cardiovascular health,17 whereas the ESC document was a call for a more comprehensive integration of PROs in cardiovascular trials.18 Given recent developments and the continuous expansion of PROs in the clinical arena, this present statement aims to define what PROs are, to describe how they can be measured in cardiovascular populations, and to discuss how PROs can be further integrated into cardiovascular research, clinical practice, and regulatory and reimbursement decisions. Although this statement specifically addresses the use of PROs in cardiovascular populations, the topics discussed are relevant for other conditions and specialities as well.

Development of this statement

This statement was developed in an iterative way. First, the consensus panel/writing group was formed by identifying all relevant and important ESC constituent bodies, and ensuring the representation of these bodies in the writing group. Second, the writing group has met and the different sections to be included in the statement were determined. Third, mini-teams were formed to write each of the sections. The content of the different sections was based on the expertise of the panel members and the relevant literature in the domain. Fourth, the different sections were compiled and integrated. Parts were rewritten to avoid overlap between the sections, and to obtain a common writing style. Fifth, gaps or inconsistencies in the message were dealt with by the chairs of the writing group. Sixth, the entire statement was reviewed and revised by the writing group in two consecutive iterations. Seventh, the document was finalized and approval from the entire writing group was obtained. Eighth, the statement was submitted to the participating associations/councils/committee for review and approval.

What are PROs?

Although the definition of PROs by the U.S. Food and Drug Administration (FDA), as cited above, is widely accepted, there is less consensus on the components of PROs. According to this definition, PROs pertain to the status of a patient's health condition as directly reported by the patient.1 Such patient-reported health status may include symptoms, functional status, and health-related quality of life (HRQoL) (Figure 2).17 One of the earliest frameworks on PROs suggested that other outcomes, in addition to patient-reported health, are relevant such as global impression and well-being (which reflect the overall quality of life), adherence to therapies and healthy lifestyles (which reflect health behaviours), and satisfaction with the treatment (which reflect experiences with care) (Figure 2).19 These extensions led to the following definition of PROs: ‘any report of the status of a patient’s health condition, health behaviour, or experience with healthcare that comes directly from the patient, without interpretation of the patient’s response by a clinician or anyone else’.20,21 This extended definition was the first one that explicitly included patient experiences as PROs. Importantly, patient experiences here refer to experiences with the care processes, and do not pertain to the hospitality function of healthcare facilities. Patient experiences can be measured using patient-reported experience measures (PREMs: see below).

Components of patient-reported outcomes.
Figure 2

Components of patient-reported outcomes.

It is important to clarify that not all the information that is provided by patients can be viewed as PROs. For instance, data from wearables, such as activity trackers, could be construed as patient-generated outcomes, rather than PROs. Further, feedback from patients provided as free text, although important, is also not a PRO.

How are PROs measured?

PROs are typically measured using patient-reported outcome measures (PROMs). However, given that experiences with healthcare are also considered as a PRO (see above), PREMs should be seen as an additional measure to assess PROs, next to PROMS.

There are three types of PROMs: generic, disease-specific, and domain-specific instruments.5 It is advised that these types of PROMs are used in combination as they provide complementary information.22 Generic PROMs comprise questions that are general in nature and therefore can be used in any population of respondents. Such generic PROMs are mostly chosen when comparing different patient populations, patients with different levels of comorbidities, or when comparing a patient group with healthy controls. Generic PROMs are typically multidimensional and cover a broad range of functional domains, such as mobility, emotions, or self-care. Examples of widely used generic PROMs are the EuroQol-5 dimension,23 the SF-36,24 or PROMIS.25

Disease-specific PROMs are used when outcomes relating to a specific condition are of interest. Such instruments are often more sensitive than generic PROMs when used in a particular patient population, because they can be more focused and detailed. Most disease-specific PROMs are multidimensional, such as the Minnesota Living with Heart Failure (MLHF) Questionnaire26 or the Myocardial Infarction Dimensional Assessment Scale (MIDAS).27

Domain-specific PROMs cover a specific symptom or issue. Since they measure a single phenomenon or construct, they are often, but not always, unidimensional and narrow in scope, but they can have varying levels of depth. An example of a domain-specific PROM with little depth is the unidimensional visual analogue scale for pain intensity.28 By contrast, the McGill Pain Questionnaire is a multidimensional domain-specific PROM of greater depth, that is designed to measure the sensory, affective, and evaluative aspects of pain and its intensity.28 Some domain-specific PROMs are also disease-specific (e.g. health behaviours in congenital heart disease.29)

PROMs for particular cardiovascular diseases

An early standardized questionnaire that was used to assess cardiovascular symptoms was the one on angina pectoris that was developed and validated by Geoffrey Rose and published by the World Health Organization in 1962.30 Nowadays, it is considered to be the first instrument to document PRO. Since then, a plethora of disease-specific PROMs has been developed to assess symptomatic burden, functional status or quality of life in diverse cardiovascular conditions, such as ischemic heart disease, heart failure, arrhythmias, cardiac surgery, heart transplantation, and congenital heart disease. Table 1 provides an inventory of cardiac-specific PROMs. Most of these PROMs are multidimensional, whereas others measure a single construct, such as behaviour. These disease-specific measures allow researchers and clinicians to measure PROs in a more sensitive fashion than when using generic measures. For some instruments, extensive and short versions are available. Several reviews and in-depth evaluations on cardiac-specific PROMs have been published over the past years, including reviews that scrutinized and compared the psychometric properties of different instruments.33,45,46,51,97,100,103,128,139,143–145 Based on the findings of these reviews, we provide summary information on the level of support for each individual instrument (Table 1). First, we checked whether the systematic reviews evaluated the instruments under study according to the COSMIN standards (see below). Second, for those reviews that did evaluate the standards, we determined whether all, most, or only some of the standards were met. Meeting all of the standards provides the strongest support for using these particular instruments. If the psychometric properties of the instruments have not yet been evaluated in systematic reviews, this indicates a need for further research rather than a reason to avoid using them.

Table 1

Disease-specific PROMs (multidimensional or domain-specific) developed for cardiovascular patient populations

NameDomainDeveloped forLevel of support
Cardiac patients
Cardiac Event Threat Questionnaire (CTQ)31MultidimensionalCardiac patients/
Cardiac Health Profile (CHP)32MultidimensionalCardiac patients33
LifeWare Cardiac Assessment Index (LIFEWARE CAI)34MultidimensionalCardiac patients33
Multidimensional Index of Life Quality (MILQ)35MultidimensionalCardiac patients+33
Quality of Life Index-Cardiac Version (QLI-CV)36MultidimensionalCardiac patients33
Duke Activity Status Index (DASI)37Physical functioningCardiac patients/
Specific Activity Scale38Physical functioningCardiac patients/
Cardiac anxiety questionnaire39AnxietyCardiac patients/
Cardiac Depression Scale (CDS)40DepressionCardiac patients/
Cardiac distress inventory41Psychological functioningCardiac patients/
Arrhythmias and electrophysiology
Patient Perception of Arrhythmia Questionnaire (PPAQ)42MultidimensionalArrhythmias33
AF643,44MultidimensionalAtrial fibrillation33,45,46
AFImpact47MultidimensionalAtrial fibrillation33
AF-QoL48MultidimensionalAtrial fibrillation33,45
Atrial Fibrillation Effect on QualiTy-of-Life (AFEQT)49MultidimensionalAtrial fibrillation+33,45
Atrial Fibrillation Quality of Life Questionnaire (AFQLQ)50MultidimensionalAtrial fibrillation33,45,51
Quality of life in AF patients (QLAF)52MultidimensionalAtrial fibrillation33,45
University of Toronto Atrial Fibrillation Severity Scale (AFSS)53MultidimensionalAtrial fibrillation46,51
Cardiff Cardiac Ablation PROM (C-CAP)54,55MultidimensionalPre- and post-ablation/
Arrhythmia-Specific questionnaire in Tachycardia and Arrhythmia (ASTA)56SymptomsArrhythmias33,46,51
Umeå 22 Arrhythmia Questions (U22)57SymptomsArrhythmias46
Canadian Cardiovascular Society-Severity of Atrial Fibrillation (CCS-SAF)58SymptomsAtrial fibrillation46
Mayo Atrial Fibrillation-Specific Symptom Inventory (MAFSI)59SymptomsAtrial fibrillation46
Symptom Checklist—Frequency and Severity Scale (SCL) aka Toronto AF Symptoms Check List60SymptomsAtrial fibrillation51
Knowledge, Attitude, and Behaviour questionnaire to patients with Atrial Fibrillation undergoing Radiofrequency Catheter Ablation61Self-managementAtrial fibrillation/
Knowledge and self-management tool62Self-managementAtrial fibrillation/
VALIOSA (Satisfaction with remote cardiac monitoring)63Experience with careImplanted cardiac devices/
Ischaemic heart disease
Modified Postoperative Recovery Profile questionnaire re (PRP-CABG)64MultidimensionalCABG/
Coronary Revascularisation Outcome Questionnaire (CROQ)65MultidimensionalCABG or PTCA+33
Angina Pectoris Quality of Life Questionnaire (APQLQ)66MultidimensionalIschaemic heart disease+33
Cardiovascular Limitations and Symptoms Profile (CLASP)67MultidimensionalIschaemic heart disease+33
Health Complaints Scale (HCS)68MultidimensionalIschaemic heart disease33
HeartQol69,70MultidimensionalIschaemic heart disease+33
Quality of Life Index (QLI)71MultidimensionalIschaemic heart disease/
Quality of Life Instruments for Chronic Diseases—Coronary Heart Disease (QLICD-CHD)72MultidimensionalIschaemic heart disease+33
Seattle Angina Questionnaire (SAQ19)73MultidimensionalIschaemic heart disease+33
Short version of the Seattle Angina Questionnaire (SAQ7)74MultidimensionalIschaemic heart disease/
Summary Index for the Assessment of Quality of Life in Angina Pectoris75MultidimensionalIschaemic heart disease/
MacNew Heart Disease Questionnaire (aka QLMI-2)76MultidimensionalMyocardial infarction++33
Myocardial Infarction Dimensional Assessment Scale (MIDAS)27MultidimensionalMyocardial infarction+33
Quality of Life Questionnaire (QLMI)77MultidimensionalMyocardial infarction/
Cardiac Surgery Symptom Inventory (CSSI)78SymptomsCABG/
Cardiac Symptom Survey (CSS)79SymptomsCABG46
Heart Surgery Symptom Inventory (HSSI)80SymptomsCABG/
Symptoms of Illness Score (SOIS)81SymptomsCABG/valve surgery/
Symptom Inventory82SymptomsCardiac surgery/
Cardiac Symptoms Scale83SymptomsCardiac surgery/PTCA/
Acute Coronary Syndrome (ACS) symptom checklist84SymptomsAcute Coronary Syndrome46
McSweeney Acute and Prodromal Myocardial Infarction Symptom Survey (MAPMISS)85SymptomsIschaemic heart disease46
Symptoms of Acute Coronary Syndrome Inventory (SACSI)86SymptomsAcute Coronary Syndrome46
Symptom Scale87SymptomsIschaemic heart disease/
Shortened WHO Rose Angina Questionnaire88SymptomsIschaemic heart disease/
WHO Rose angina questionnaire30SymptomsIschaemic heart disease/
Angina-related Limitations at Work Questionnaire (ALWQ)89Work-related functioningIschaemic heart disease/
Congenital heart disease
ACHD PRO, Adult Congenital Heart Disease—Patient-Reported Outcome90MultidimensionalCongenital heart disease+33
Congenital Heart Disease—TNO/AZL Adult Quality Of Life (CHD-TAAQOL)91MultidimensionalCongenital heart disease33
PedsQl cardiac module92MultidimensionalCongenital heart disease/
Pediatric Cardiac QOL Inventory93MultidimensionalCongenital heart disease/
Congenital Heart Adolescent and Teenager Questionnaire (CHAT)94MultidimensionalCongenital heart disease/
ConQol95MultidimensionalCongenital heart disease/
Health Behavior Scale—Congenital Heart Disease29BehaviourCongenital heart disease/
Heart failure and transplantation
Cardiac Health Profile of Congestive Heart Failure (CHPchf)96MultidimensionalHeart failure97
Care-Related Quality of Life survey for Chronic Heart Failure (CaReQol CHF)98MultidimensionalHeart failure33
Chronic Heart Failure Assessment Tool (CHAT)99MultidimensionalHeart failure33,97,100
Chronic Heart Failure-PRO Measure (CHF-PROM)101MultidimensionalHeart failure+33
Chronic Heart Failure Questionnaire (CHQ/CHFQ)102MultidimensionalHeart failure33,97,100,103
Heart Failure-Functional Status Assessment (HF-FSA)104MultidimensionalHeart failure33
Heart Failure Symptom Checklist105MultidimensionalHeart failure/
Kansas City Cardiomyopathy Questionnaire (KCCQ)106MultidimensionalHeart failure++33,97
Knowledge, attitude, self-care practice and HRQoL of Heart Failure patients (KAPQ-HF)107MultidimensionalHeart failure+33
Left Ventricular Dysfunction Questionnaire (LVD-36)108MultidimensionalHeart failure+33,100,103
MD Anderson Symptom Inventory e Heart Failure (MDASI-HF)109MultidimensionalHeart failure33
Minnesota Living with Heart Failure (MLHF)26MultidimensionalHeart failure+33,97,100,103
Patient-Reported Outcomes Measurement Information System-Plus-Heart Failure (PROMIS-Plus-HF)110MultidimensionalHeart failure+33
Quality of Life Questionnaire in Severe Heart Failure (QLQ-SHF)111MultidimensionalHeart failure33,97,103
Short version of the Kansas City Cardiomyopathy Questionnaire (KCCQ-12)112MultidimensionalHeart failure/
Traditional Chinese Medicine inquiry (TCM inquiry)113MultidimensionalHeart failure/
Heart Transplant Stressor Scale114MultidimensionalHeart transplantation/
Rating Question Form115MultidimensionalHeart transplantation/
Rotterdam Quality of Life Questionnaire116MultidimensionalHeart transplantation/
LVAD Stressor Scale (modified)117MultidimensionalLVAD/
Quality of Life with a Ventricular Assistive Device Questionnaire (QOLVAD)118MultidimensionalLVAD33
Heart Failure Somatic Awareness Scale (HFSAS)119SymptomsHeart failure33,46
Heart Failure Somatic Perception Scale (HFSPS)120SymptomsHeart failure46
Memorial Symptom Assessment Scale-Heart Failure (MSAS-HF)121SymptomsHeart failure33,46
San Diego Heart Failure Questionnaire (SDHFQ)122SymptomsHeart failure33,100
Symptom Checklist (SCL)123SymptomsHeart failure46
Symptom Status Questionnaire—Heart Failure (SSQ-HF)124SymptomsHeart failure46
Heart Failure Functional Status Inventory (HFFSI)125Symptoms; Functional capabilitiesHeart failure33,100
European Heart Failure Self-care Behaviour Scale (EHFScBS)126,127Self-careHeart failure+128,129
Evaluation Scale for Self-monitoring by Patients with Chronic Heart Failure (ESSMHF)130Self-careHeart failure128
Self-care of Heart Failure Index (SCHFI)131Self-careHeart failure+128
Spiritual Self-care Practice Scale (SSCPS)132Self-careHeart failure128
Valvular diseases
Heart Valve Disease Impact on daily life (IDCV)133MultidimensionalHeart valve disease33
Toronto Aortic Stenosis Quality of Life Questionnaire (TASQ)134MultidimensionalSAVR/TAVI33
Blood pressure
Impact of Syncope on Quality of Life (ISQL)135MultidimensionalSyncope33
Orthostatic Hypotension Questionnaire (OHQ)136MultidimensionalHypotension+33
Quality of Life Instruments for Chronic Diseases—Hypertension (QLICH-HY)137MultidimensionalHypertension
Hill-Bone Compliance Scale138Medication adherenceHypertension139
Treatment Adherence Questionnaire for Patients with Hypertension (TAQPH)140Medication adherenceHypertension139
Therapeutic Adherence Scale for Hypertensive Patients (TASHP)141Medication adherenceHypertension139
Hypertension Self-Care Profile (HBP SCP)142Self-careHypertension/
NameDomainDeveloped forLevel of support
Cardiac patients
Cardiac Event Threat Questionnaire (CTQ)31MultidimensionalCardiac patients/
Cardiac Health Profile (CHP)32MultidimensionalCardiac patients33
LifeWare Cardiac Assessment Index (LIFEWARE CAI)34MultidimensionalCardiac patients33
Multidimensional Index of Life Quality (MILQ)35MultidimensionalCardiac patients+33
Quality of Life Index-Cardiac Version (QLI-CV)36MultidimensionalCardiac patients33
Duke Activity Status Index (DASI)37Physical functioningCardiac patients/
Specific Activity Scale38Physical functioningCardiac patients/
Cardiac anxiety questionnaire39AnxietyCardiac patients/
Cardiac Depression Scale (CDS)40DepressionCardiac patients/
Cardiac distress inventory41Psychological functioningCardiac patients/
Arrhythmias and electrophysiology
Patient Perception of Arrhythmia Questionnaire (PPAQ)42MultidimensionalArrhythmias33
AF643,44MultidimensionalAtrial fibrillation33,45,46
AFImpact47MultidimensionalAtrial fibrillation33
AF-QoL48MultidimensionalAtrial fibrillation33,45
Atrial Fibrillation Effect on QualiTy-of-Life (AFEQT)49MultidimensionalAtrial fibrillation+33,45
Atrial Fibrillation Quality of Life Questionnaire (AFQLQ)50MultidimensionalAtrial fibrillation33,45,51
Quality of life in AF patients (QLAF)52MultidimensionalAtrial fibrillation33,45
University of Toronto Atrial Fibrillation Severity Scale (AFSS)53MultidimensionalAtrial fibrillation46,51
Cardiff Cardiac Ablation PROM (C-CAP)54,55MultidimensionalPre- and post-ablation/
Arrhythmia-Specific questionnaire in Tachycardia and Arrhythmia (ASTA)56SymptomsArrhythmias33,46,51
Umeå 22 Arrhythmia Questions (U22)57SymptomsArrhythmias46
Canadian Cardiovascular Society-Severity of Atrial Fibrillation (CCS-SAF)58SymptomsAtrial fibrillation46
Mayo Atrial Fibrillation-Specific Symptom Inventory (MAFSI)59SymptomsAtrial fibrillation46
Symptom Checklist—Frequency and Severity Scale (SCL) aka Toronto AF Symptoms Check List60SymptomsAtrial fibrillation51
Knowledge, Attitude, and Behaviour questionnaire to patients with Atrial Fibrillation undergoing Radiofrequency Catheter Ablation61Self-managementAtrial fibrillation/
Knowledge and self-management tool62Self-managementAtrial fibrillation/
VALIOSA (Satisfaction with remote cardiac monitoring)63Experience with careImplanted cardiac devices/
Ischaemic heart disease
Modified Postoperative Recovery Profile questionnaire re (PRP-CABG)64MultidimensionalCABG/
Coronary Revascularisation Outcome Questionnaire (CROQ)65MultidimensionalCABG or PTCA+33
Angina Pectoris Quality of Life Questionnaire (APQLQ)66MultidimensionalIschaemic heart disease+33
Cardiovascular Limitations and Symptoms Profile (CLASP)67MultidimensionalIschaemic heart disease+33
Health Complaints Scale (HCS)68MultidimensionalIschaemic heart disease33
HeartQol69,70MultidimensionalIschaemic heart disease+33
Quality of Life Index (QLI)71MultidimensionalIschaemic heart disease/
Quality of Life Instruments for Chronic Diseases—Coronary Heart Disease (QLICD-CHD)72MultidimensionalIschaemic heart disease+33
Seattle Angina Questionnaire (SAQ19)73MultidimensionalIschaemic heart disease+33
Short version of the Seattle Angina Questionnaire (SAQ7)74MultidimensionalIschaemic heart disease/
Summary Index for the Assessment of Quality of Life in Angina Pectoris75MultidimensionalIschaemic heart disease/
MacNew Heart Disease Questionnaire (aka QLMI-2)76MultidimensionalMyocardial infarction++33
Myocardial Infarction Dimensional Assessment Scale (MIDAS)27MultidimensionalMyocardial infarction+33
Quality of Life Questionnaire (QLMI)77MultidimensionalMyocardial infarction/
Cardiac Surgery Symptom Inventory (CSSI)78SymptomsCABG/
Cardiac Symptom Survey (CSS)79SymptomsCABG46
Heart Surgery Symptom Inventory (HSSI)80SymptomsCABG/
Symptoms of Illness Score (SOIS)81SymptomsCABG/valve surgery/
Symptom Inventory82SymptomsCardiac surgery/
Cardiac Symptoms Scale83SymptomsCardiac surgery/PTCA/
Acute Coronary Syndrome (ACS) symptom checklist84SymptomsAcute Coronary Syndrome46
McSweeney Acute and Prodromal Myocardial Infarction Symptom Survey (MAPMISS)85SymptomsIschaemic heart disease46
Symptoms of Acute Coronary Syndrome Inventory (SACSI)86SymptomsAcute Coronary Syndrome46
Symptom Scale87SymptomsIschaemic heart disease/
Shortened WHO Rose Angina Questionnaire88SymptomsIschaemic heart disease/
WHO Rose angina questionnaire30SymptomsIschaemic heart disease/
Angina-related Limitations at Work Questionnaire (ALWQ)89Work-related functioningIschaemic heart disease/
Congenital heart disease
ACHD PRO, Adult Congenital Heart Disease—Patient-Reported Outcome90MultidimensionalCongenital heart disease+33
Congenital Heart Disease—TNO/AZL Adult Quality Of Life (CHD-TAAQOL)91MultidimensionalCongenital heart disease33
PedsQl cardiac module92MultidimensionalCongenital heart disease/
Pediatric Cardiac QOL Inventory93MultidimensionalCongenital heart disease/
Congenital Heart Adolescent and Teenager Questionnaire (CHAT)94MultidimensionalCongenital heart disease/
ConQol95MultidimensionalCongenital heart disease/
Health Behavior Scale—Congenital Heart Disease29BehaviourCongenital heart disease/
Heart failure and transplantation
Cardiac Health Profile of Congestive Heart Failure (CHPchf)96MultidimensionalHeart failure97
Care-Related Quality of Life survey for Chronic Heart Failure (CaReQol CHF)98MultidimensionalHeart failure33
Chronic Heart Failure Assessment Tool (CHAT)99MultidimensionalHeart failure33,97,100
Chronic Heart Failure-PRO Measure (CHF-PROM)101MultidimensionalHeart failure+33
Chronic Heart Failure Questionnaire (CHQ/CHFQ)102MultidimensionalHeart failure33,97,100,103
Heart Failure-Functional Status Assessment (HF-FSA)104MultidimensionalHeart failure33
Heart Failure Symptom Checklist105MultidimensionalHeart failure/
Kansas City Cardiomyopathy Questionnaire (KCCQ)106MultidimensionalHeart failure++33,97
Knowledge, attitude, self-care practice and HRQoL of Heart Failure patients (KAPQ-HF)107MultidimensionalHeart failure+33
Left Ventricular Dysfunction Questionnaire (LVD-36)108MultidimensionalHeart failure+33,100,103
MD Anderson Symptom Inventory e Heart Failure (MDASI-HF)109MultidimensionalHeart failure33
Minnesota Living with Heart Failure (MLHF)26MultidimensionalHeart failure+33,97,100,103
Patient-Reported Outcomes Measurement Information System-Plus-Heart Failure (PROMIS-Plus-HF)110MultidimensionalHeart failure+33
Quality of Life Questionnaire in Severe Heart Failure (QLQ-SHF)111MultidimensionalHeart failure33,97,103
Short version of the Kansas City Cardiomyopathy Questionnaire (KCCQ-12)112MultidimensionalHeart failure/
Traditional Chinese Medicine inquiry (TCM inquiry)113MultidimensionalHeart failure/
Heart Transplant Stressor Scale114MultidimensionalHeart transplantation/
Rating Question Form115MultidimensionalHeart transplantation/
Rotterdam Quality of Life Questionnaire116MultidimensionalHeart transplantation/
LVAD Stressor Scale (modified)117MultidimensionalLVAD/
Quality of Life with a Ventricular Assistive Device Questionnaire (QOLVAD)118MultidimensionalLVAD33
Heart Failure Somatic Awareness Scale (HFSAS)119SymptomsHeart failure33,46
Heart Failure Somatic Perception Scale (HFSPS)120SymptomsHeart failure46
Memorial Symptom Assessment Scale-Heart Failure (MSAS-HF)121SymptomsHeart failure33,46
San Diego Heart Failure Questionnaire (SDHFQ)122SymptomsHeart failure33,100
Symptom Checklist (SCL)123SymptomsHeart failure46
Symptom Status Questionnaire—Heart Failure (SSQ-HF)124SymptomsHeart failure46
Heart Failure Functional Status Inventory (HFFSI)125Symptoms; Functional capabilitiesHeart failure33,100
European Heart Failure Self-care Behaviour Scale (EHFScBS)126,127Self-careHeart failure+128,129
Evaluation Scale for Self-monitoring by Patients with Chronic Heart Failure (ESSMHF)130Self-careHeart failure128
Self-care of Heart Failure Index (SCHFI)131Self-careHeart failure+128
Spiritual Self-care Practice Scale (SSCPS)132Self-careHeart failure128
Valvular diseases
Heart Valve Disease Impact on daily life (IDCV)133MultidimensionalHeart valve disease33
Toronto Aortic Stenosis Quality of Life Questionnaire (TASQ)134MultidimensionalSAVR/TAVI33
Blood pressure
Impact of Syncope on Quality of Life (ISQL)135MultidimensionalSyncope33
Orthostatic Hypotension Questionnaire (OHQ)136MultidimensionalHypotension+33
Quality of Life Instruments for Chronic Diseases—Hypertension (QLICH-HY)137MultidimensionalHypertension
Hill-Bone Compliance Scale138Medication adherenceHypertension139
Treatment Adherence Questionnaire for Patients with Hypertension (TAQPH)140Medication adherenceHypertension139
Therapeutic Adherence Scale for Hypertensive Patients (TASHP)141Medication adherenceHypertension139
Hypertension Self-Care Profile (HBP SCP)142Self-careHypertension/

AF, Atrial Fibrillation; CABG, Coronary Artery Bypass Grafting; DS, domain-specific; ICD, Implantable Cardioverter Defibrillator; LVAD, Left Ventricular Assist Device; PTCA, Percutaneous Transluminal Coronary Angioplasty; SC, Single construct; SAVR, Surgical Aortic Valve Replacement; TAVI, Transcatheter Aortic Valve Implantation Level of support; /, psychometric properties not evaluated any systematic review; −, the cited systematic review indicated that none or only some of the psychometric properties of this instrument have met COSMIN standards; +, systematic review indicated support for most psychometric properties; ++, systematic review indicated support for all psychometric properties.

Table 1

Disease-specific PROMs (multidimensional or domain-specific) developed for cardiovascular patient populations

NameDomainDeveloped forLevel of support
Cardiac patients
Cardiac Event Threat Questionnaire (CTQ)31MultidimensionalCardiac patients/
Cardiac Health Profile (CHP)32MultidimensionalCardiac patients33
LifeWare Cardiac Assessment Index (LIFEWARE CAI)34MultidimensionalCardiac patients33
Multidimensional Index of Life Quality (MILQ)35MultidimensionalCardiac patients+33
Quality of Life Index-Cardiac Version (QLI-CV)36MultidimensionalCardiac patients33
Duke Activity Status Index (DASI)37Physical functioningCardiac patients/
Specific Activity Scale38Physical functioningCardiac patients/
Cardiac anxiety questionnaire39AnxietyCardiac patients/
Cardiac Depression Scale (CDS)40DepressionCardiac patients/
Cardiac distress inventory41Psychological functioningCardiac patients/
Arrhythmias and electrophysiology
Patient Perception of Arrhythmia Questionnaire (PPAQ)42MultidimensionalArrhythmias33
AF643,44MultidimensionalAtrial fibrillation33,45,46
AFImpact47MultidimensionalAtrial fibrillation33
AF-QoL48MultidimensionalAtrial fibrillation33,45
Atrial Fibrillation Effect on QualiTy-of-Life (AFEQT)49MultidimensionalAtrial fibrillation+33,45
Atrial Fibrillation Quality of Life Questionnaire (AFQLQ)50MultidimensionalAtrial fibrillation33,45,51
Quality of life in AF patients (QLAF)52MultidimensionalAtrial fibrillation33,45
University of Toronto Atrial Fibrillation Severity Scale (AFSS)53MultidimensionalAtrial fibrillation46,51
Cardiff Cardiac Ablation PROM (C-CAP)54,55MultidimensionalPre- and post-ablation/
Arrhythmia-Specific questionnaire in Tachycardia and Arrhythmia (ASTA)56SymptomsArrhythmias33,46,51
Umeå 22 Arrhythmia Questions (U22)57SymptomsArrhythmias46
Canadian Cardiovascular Society-Severity of Atrial Fibrillation (CCS-SAF)58SymptomsAtrial fibrillation46
Mayo Atrial Fibrillation-Specific Symptom Inventory (MAFSI)59SymptomsAtrial fibrillation46
Symptom Checklist—Frequency and Severity Scale (SCL) aka Toronto AF Symptoms Check List60SymptomsAtrial fibrillation51
Knowledge, Attitude, and Behaviour questionnaire to patients with Atrial Fibrillation undergoing Radiofrequency Catheter Ablation61Self-managementAtrial fibrillation/
Knowledge and self-management tool62Self-managementAtrial fibrillation/
VALIOSA (Satisfaction with remote cardiac monitoring)63Experience with careImplanted cardiac devices/
Ischaemic heart disease
Modified Postoperative Recovery Profile questionnaire re (PRP-CABG)64MultidimensionalCABG/
Coronary Revascularisation Outcome Questionnaire (CROQ)65MultidimensionalCABG or PTCA+33
Angina Pectoris Quality of Life Questionnaire (APQLQ)66MultidimensionalIschaemic heart disease+33
Cardiovascular Limitations and Symptoms Profile (CLASP)67MultidimensionalIschaemic heart disease+33
Health Complaints Scale (HCS)68MultidimensionalIschaemic heart disease33
HeartQol69,70MultidimensionalIschaemic heart disease+33
Quality of Life Index (QLI)71MultidimensionalIschaemic heart disease/
Quality of Life Instruments for Chronic Diseases—Coronary Heart Disease (QLICD-CHD)72MultidimensionalIschaemic heart disease+33
Seattle Angina Questionnaire (SAQ19)73MultidimensionalIschaemic heart disease+33
Short version of the Seattle Angina Questionnaire (SAQ7)74MultidimensionalIschaemic heart disease/
Summary Index for the Assessment of Quality of Life in Angina Pectoris75MultidimensionalIschaemic heart disease/
MacNew Heart Disease Questionnaire (aka QLMI-2)76MultidimensionalMyocardial infarction++33
Myocardial Infarction Dimensional Assessment Scale (MIDAS)27MultidimensionalMyocardial infarction+33
Quality of Life Questionnaire (QLMI)77MultidimensionalMyocardial infarction/
Cardiac Surgery Symptom Inventory (CSSI)78SymptomsCABG/
Cardiac Symptom Survey (CSS)79SymptomsCABG46
Heart Surgery Symptom Inventory (HSSI)80SymptomsCABG/
Symptoms of Illness Score (SOIS)81SymptomsCABG/valve surgery/
Symptom Inventory82SymptomsCardiac surgery/
Cardiac Symptoms Scale83SymptomsCardiac surgery/PTCA/
Acute Coronary Syndrome (ACS) symptom checklist84SymptomsAcute Coronary Syndrome46
McSweeney Acute and Prodromal Myocardial Infarction Symptom Survey (MAPMISS)85SymptomsIschaemic heart disease46
Symptoms of Acute Coronary Syndrome Inventory (SACSI)86SymptomsAcute Coronary Syndrome46
Symptom Scale87SymptomsIschaemic heart disease/
Shortened WHO Rose Angina Questionnaire88SymptomsIschaemic heart disease/
WHO Rose angina questionnaire30SymptomsIschaemic heart disease/
Angina-related Limitations at Work Questionnaire (ALWQ)89Work-related functioningIschaemic heart disease/
Congenital heart disease
ACHD PRO, Adult Congenital Heart Disease—Patient-Reported Outcome90MultidimensionalCongenital heart disease+33
Congenital Heart Disease—TNO/AZL Adult Quality Of Life (CHD-TAAQOL)91MultidimensionalCongenital heart disease33
PedsQl cardiac module92MultidimensionalCongenital heart disease/
Pediatric Cardiac QOL Inventory93MultidimensionalCongenital heart disease/
Congenital Heart Adolescent and Teenager Questionnaire (CHAT)94MultidimensionalCongenital heart disease/
ConQol95MultidimensionalCongenital heart disease/
Health Behavior Scale—Congenital Heart Disease29BehaviourCongenital heart disease/
Heart failure and transplantation
Cardiac Health Profile of Congestive Heart Failure (CHPchf)96MultidimensionalHeart failure97
Care-Related Quality of Life survey for Chronic Heart Failure (CaReQol CHF)98MultidimensionalHeart failure33
Chronic Heart Failure Assessment Tool (CHAT)99MultidimensionalHeart failure33,97,100
Chronic Heart Failure-PRO Measure (CHF-PROM)101MultidimensionalHeart failure+33
Chronic Heart Failure Questionnaire (CHQ/CHFQ)102MultidimensionalHeart failure33,97,100,103
Heart Failure-Functional Status Assessment (HF-FSA)104MultidimensionalHeart failure33
Heart Failure Symptom Checklist105MultidimensionalHeart failure/
Kansas City Cardiomyopathy Questionnaire (KCCQ)106MultidimensionalHeart failure++33,97
Knowledge, attitude, self-care practice and HRQoL of Heart Failure patients (KAPQ-HF)107MultidimensionalHeart failure+33
Left Ventricular Dysfunction Questionnaire (LVD-36)108MultidimensionalHeart failure+33,100,103
MD Anderson Symptom Inventory e Heart Failure (MDASI-HF)109MultidimensionalHeart failure33
Minnesota Living with Heart Failure (MLHF)26MultidimensionalHeart failure+33,97,100,103
Patient-Reported Outcomes Measurement Information System-Plus-Heart Failure (PROMIS-Plus-HF)110MultidimensionalHeart failure+33
Quality of Life Questionnaire in Severe Heart Failure (QLQ-SHF)111MultidimensionalHeart failure33,97,103
Short version of the Kansas City Cardiomyopathy Questionnaire (KCCQ-12)112MultidimensionalHeart failure/
Traditional Chinese Medicine inquiry (TCM inquiry)113MultidimensionalHeart failure/
Heart Transplant Stressor Scale114MultidimensionalHeart transplantation/
Rating Question Form115MultidimensionalHeart transplantation/
Rotterdam Quality of Life Questionnaire116MultidimensionalHeart transplantation/
LVAD Stressor Scale (modified)117MultidimensionalLVAD/
Quality of Life with a Ventricular Assistive Device Questionnaire (QOLVAD)118MultidimensionalLVAD33
Heart Failure Somatic Awareness Scale (HFSAS)119SymptomsHeart failure33,46
Heart Failure Somatic Perception Scale (HFSPS)120SymptomsHeart failure46
Memorial Symptom Assessment Scale-Heart Failure (MSAS-HF)121SymptomsHeart failure33,46
San Diego Heart Failure Questionnaire (SDHFQ)122SymptomsHeart failure33,100
Symptom Checklist (SCL)123SymptomsHeart failure46
Symptom Status Questionnaire—Heart Failure (SSQ-HF)124SymptomsHeart failure46
Heart Failure Functional Status Inventory (HFFSI)125Symptoms; Functional capabilitiesHeart failure33,100
European Heart Failure Self-care Behaviour Scale (EHFScBS)126,127Self-careHeart failure+128,129
Evaluation Scale for Self-monitoring by Patients with Chronic Heart Failure (ESSMHF)130Self-careHeart failure128
Self-care of Heart Failure Index (SCHFI)131Self-careHeart failure+128
Spiritual Self-care Practice Scale (SSCPS)132Self-careHeart failure128
Valvular diseases
Heart Valve Disease Impact on daily life (IDCV)133MultidimensionalHeart valve disease33
Toronto Aortic Stenosis Quality of Life Questionnaire (TASQ)134MultidimensionalSAVR/TAVI33
Blood pressure
Impact of Syncope on Quality of Life (ISQL)135MultidimensionalSyncope33
Orthostatic Hypotension Questionnaire (OHQ)136MultidimensionalHypotension+33
Quality of Life Instruments for Chronic Diseases—Hypertension (QLICH-HY)137MultidimensionalHypertension
Hill-Bone Compliance Scale138Medication adherenceHypertension139
Treatment Adherence Questionnaire for Patients with Hypertension (TAQPH)140Medication adherenceHypertension139
Therapeutic Adherence Scale for Hypertensive Patients (TASHP)141Medication adherenceHypertension139
Hypertension Self-Care Profile (HBP SCP)142Self-careHypertension/
NameDomainDeveloped forLevel of support
Cardiac patients
Cardiac Event Threat Questionnaire (CTQ)31MultidimensionalCardiac patients/
Cardiac Health Profile (CHP)32MultidimensionalCardiac patients33
LifeWare Cardiac Assessment Index (LIFEWARE CAI)34MultidimensionalCardiac patients33
Multidimensional Index of Life Quality (MILQ)35MultidimensionalCardiac patients+33
Quality of Life Index-Cardiac Version (QLI-CV)36MultidimensionalCardiac patients33
Duke Activity Status Index (DASI)37Physical functioningCardiac patients/
Specific Activity Scale38Physical functioningCardiac patients/
Cardiac anxiety questionnaire39AnxietyCardiac patients/
Cardiac Depression Scale (CDS)40DepressionCardiac patients/
Cardiac distress inventory41Psychological functioningCardiac patients/
Arrhythmias and electrophysiology
Patient Perception of Arrhythmia Questionnaire (PPAQ)42MultidimensionalArrhythmias33
AF643,44MultidimensionalAtrial fibrillation33,45,46
AFImpact47MultidimensionalAtrial fibrillation33
AF-QoL48MultidimensionalAtrial fibrillation33,45
Atrial Fibrillation Effect on QualiTy-of-Life (AFEQT)49MultidimensionalAtrial fibrillation+33,45
Atrial Fibrillation Quality of Life Questionnaire (AFQLQ)50MultidimensionalAtrial fibrillation33,45,51
Quality of life in AF patients (QLAF)52MultidimensionalAtrial fibrillation33,45
University of Toronto Atrial Fibrillation Severity Scale (AFSS)53MultidimensionalAtrial fibrillation46,51
Cardiff Cardiac Ablation PROM (C-CAP)54,55MultidimensionalPre- and post-ablation/
Arrhythmia-Specific questionnaire in Tachycardia and Arrhythmia (ASTA)56SymptomsArrhythmias33,46,51
Umeå 22 Arrhythmia Questions (U22)57SymptomsArrhythmias46
Canadian Cardiovascular Society-Severity of Atrial Fibrillation (CCS-SAF)58SymptomsAtrial fibrillation46
Mayo Atrial Fibrillation-Specific Symptom Inventory (MAFSI)59SymptomsAtrial fibrillation46
Symptom Checklist—Frequency and Severity Scale (SCL) aka Toronto AF Symptoms Check List60SymptomsAtrial fibrillation51
Knowledge, Attitude, and Behaviour questionnaire to patients with Atrial Fibrillation undergoing Radiofrequency Catheter Ablation61Self-managementAtrial fibrillation/
Knowledge and self-management tool62Self-managementAtrial fibrillation/
VALIOSA (Satisfaction with remote cardiac monitoring)63Experience with careImplanted cardiac devices/
Ischaemic heart disease
Modified Postoperative Recovery Profile questionnaire re (PRP-CABG)64MultidimensionalCABG/
Coronary Revascularisation Outcome Questionnaire (CROQ)65MultidimensionalCABG or PTCA+33
Angina Pectoris Quality of Life Questionnaire (APQLQ)66MultidimensionalIschaemic heart disease+33
Cardiovascular Limitations and Symptoms Profile (CLASP)67MultidimensionalIschaemic heart disease+33
Health Complaints Scale (HCS)68MultidimensionalIschaemic heart disease33
HeartQol69,70MultidimensionalIschaemic heart disease+33
Quality of Life Index (QLI)71MultidimensionalIschaemic heart disease/
Quality of Life Instruments for Chronic Diseases—Coronary Heart Disease (QLICD-CHD)72MultidimensionalIschaemic heart disease+33
Seattle Angina Questionnaire (SAQ19)73MultidimensionalIschaemic heart disease+33
Short version of the Seattle Angina Questionnaire (SAQ7)74MultidimensionalIschaemic heart disease/
Summary Index for the Assessment of Quality of Life in Angina Pectoris75MultidimensionalIschaemic heart disease/
MacNew Heart Disease Questionnaire (aka QLMI-2)76MultidimensionalMyocardial infarction++33
Myocardial Infarction Dimensional Assessment Scale (MIDAS)27MultidimensionalMyocardial infarction+33
Quality of Life Questionnaire (QLMI)77MultidimensionalMyocardial infarction/
Cardiac Surgery Symptom Inventory (CSSI)78SymptomsCABG/
Cardiac Symptom Survey (CSS)79SymptomsCABG46
Heart Surgery Symptom Inventory (HSSI)80SymptomsCABG/
Symptoms of Illness Score (SOIS)81SymptomsCABG/valve surgery/
Symptom Inventory82SymptomsCardiac surgery/
Cardiac Symptoms Scale83SymptomsCardiac surgery/PTCA/
Acute Coronary Syndrome (ACS) symptom checklist84SymptomsAcute Coronary Syndrome46
McSweeney Acute and Prodromal Myocardial Infarction Symptom Survey (MAPMISS)85SymptomsIschaemic heart disease46
Symptoms of Acute Coronary Syndrome Inventory (SACSI)86SymptomsAcute Coronary Syndrome46
Symptom Scale87SymptomsIschaemic heart disease/
Shortened WHO Rose Angina Questionnaire88SymptomsIschaemic heart disease/
WHO Rose angina questionnaire30SymptomsIschaemic heart disease/
Angina-related Limitations at Work Questionnaire (ALWQ)89Work-related functioningIschaemic heart disease/
Congenital heart disease
ACHD PRO, Adult Congenital Heart Disease—Patient-Reported Outcome90MultidimensionalCongenital heart disease+33
Congenital Heart Disease—TNO/AZL Adult Quality Of Life (CHD-TAAQOL)91MultidimensionalCongenital heart disease33
PedsQl cardiac module92MultidimensionalCongenital heart disease/
Pediatric Cardiac QOL Inventory93MultidimensionalCongenital heart disease/
Congenital Heart Adolescent and Teenager Questionnaire (CHAT)94MultidimensionalCongenital heart disease/
ConQol95MultidimensionalCongenital heart disease/
Health Behavior Scale—Congenital Heart Disease29BehaviourCongenital heart disease/
Heart failure and transplantation
Cardiac Health Profile of Congestive Heart Failure (CHPchf)96MultidimensionalHeart failure97
Care-Related Quality of Life survey for Chronic Heart Failure (CaReQol CHF)98MultidimensionalHeart failure33
Chronic Heart Failure Assessment Tool (CHAT)99MultidimensionalHeart failure33,97,100
Chronic Heart Failure-PRO Measure (CHF-PROM)101MultidimensionalHeart failure+33
Chronic Heart Failure Questionnaire (CHQ/CHFQ)102MultidimensionalHeart failure33,97,100,103
Heart Failure-Functional Status Assessment (HF-FSA)104MultidimensionalHeart failure33
Heart Failure Symptom Checklist105MultidimensionalHeart failure/
Kansas City Cardiomyopathy Questionnaire (KCCQ)106MultidimensionalHeart failure++33,97
Knowledge, attitude, self-care practice and HRQoL of Heart Failure patients (KAPQ-HF)107MultidimensionalHeart failure+33
Left Ventricular Dysfunction Questionnaire (LVD-36)108MultidimensionalHeart failure+33,100,103
MD Anderson Symptom Inventory e Heart Failure (MDASI-HF)109MultidimensionalHeart failure33
Minnesota Living with Heart Failure (MLHF)26MultidimensionalHeart failure+33,97,100,103
Patient-Reported Outcomes Measurement Information System-Plus-Heart Failure (PROMIS-Plus-HF)110MultidimensionalHeart failure+33
Quality of Life Questionnaire in Severe Heart Failure (QLQ-SHF)111MultidimensionalHeart failure33,97,103
Short version of the Kansas City Cardiomyopathy Questionnaire (KCCQ-12)112MultidimensionalHeart failure/
Traditional Chinese Medicine inquiry (TCM inquiry)113MultidimensionalHeart failure/
Heart Transplant Stressor Scale114MultidimensionalHeart transplantation/
Rating Question Form115MultidimensionalHeart transplantation/
Rotterdam Quality of Life Questionnaire116MultidimensionalHeart transplantation/
LVAD Stressor Scale (modified)117MultidimensionalLVAD/
Quality of Life with a Ventricular Assistive Device Questionnaire (QOLVAD)118MultidimensionalLVAD33
Heart Failure Somatic Awareness Scale (HFSAS)119SymptomsHeart failure33,46
Heart Failure Somatic Perception Scale (HFSPS)120SymptomsHeart failure46
Memorial Symptom Assessment Scale-Heart Failure (MSAS-HF)121SymptomsHeart failure33,46
San Diego Heart Failure Questionnaire (SDHFQ)122SymptomsHeart failure33,100
Symptom Checklist (SCL)123SymptomsHeart failure46
Symptom Status Questionnaire—Heart Failure (SSQ-HF)124SymptomsHeart failure46
Heart Failure Functional Status Inventory (HFFSI)125Symptoms; Functional capabilitiesHeart failure33,100
European Heart Failure Self-care Behaviour Scale (EHFScBS)126,127Self-careHeart failure+128,129
Evaluation Scale for Self-monitoring by Patients with Chronic Heart Failure (ESSMHF)130Self-careHeart failure128
Self-care of Heart Failure Index (SCHFI)131Self-careHeart failure+128
Spiritual Self-care Practice Scale (SSCPS)132Self-careHeart failure128
Valvular diseases
Heart Valve Disease Impact on daily life (IDCV)133MultidimensionalHeart valve disease33
Toronto Aortic Stenosis Quality of Life Questionnaire (TASQ)134MultidimensionalSAVR/TAVI33
Blood pressure
Impact of Syncope on Quality of Life (ISQL)135MultidimensionalSyncope33
Orthostatic Hypotension Questionnaire (OHQ)136MultidimensionalHypotension+33
Quality of Life Instruments for Chronic Diseases—Hypertension (QLICH-HY)137MultidimensionalHypertension
Hill-Bone Compliance Scale138Medication adherenceHypertension139
Treatment Adherence Questionnaire for Patients with Hypertension (TAQPH)140Medication adherenceHypertension139
Therapeutic Adherence Scale for Hypertensive Patients (TASHP)141Medication adherenceHypertension139
Hypertension Self-Care Profile (HBP SCP)142Self-careHypertension/

AF, Atrial Fibrillation; CABG, Coronary Artery Bypass Grafting; DS, domain-specific; ICD, Implantable Cardioverter Defibrillator; LVAD, Left Ventricular Assist Device; PTCA, Percutaneous Transluminal Coronary Angioplasty; SC, Single construct; SAVR, Surgical Aortic Valve Replacement; TAVI, Transcatheter Aortic Valve Implantation Level of support; /, psychometric properties not evaluated any systematic review; −, the cited systematic review indicated that none or only some of the psychometric properties of this instrument have met COSMIN standards; +, systematic review indicated support for most psychometric properties; ++, systematic review indicated support for all psychometric properties.

In 2012, the International Consortium for Health Outcomes Measurement (ICHOM) was launched. ICHOM aims to develop condition-specific standard outcome sets to support the assessment of ‘value-based care’. The ICHOM outcome sets comprise clinical and patient-reported outcomes, and are developed by working parties consisting of clinicians and patient representatives. To date, standard outcome sets for hypertension management in low- and middle-income countries,146 atrial fibrillation,147 congenital heart disease,148 coronary heart disease,149 and heart failure150 and have been developed.

Another organization that develops and inventorizes core outcome sets is the COMET initiative (https://www.comet-initiative.org/). COMET is a European Union/Medical Research Council funded organization that supports and publishes resources, such as a handbook on ‘core outcome set’ development and standards for reporting, i.e. the COS-STAR statement.151 Existing ‘core outcome sets’ for different conditions, including heart and circulatory problems, can be found on the COMET website: https://www.comet-initiative.org/studies. It is important to know that COMET comprises outcome sets that are developed for clinical trials, not necessarily for clinical purposes.

How to choose the most appropriate PROM?

Whether for clinical or research purposes, it is important to select PROMs that provide valid and reliable information in an efficient way. Hence, a sound evaluation of the attributes of the PROMs is essential to find high-quality PROMs that match the intended purposes. The initial evaluative systems were developed for HRQoL instruments.21 Later on, systems were developed for evaluating a broader range of PROMs.

One such system is the ‘Evaluating the Measurement of Patient-Reported Outcomes’ (EMPRO) tool.152 The EMPRO tool comprises 39 items that are organized into eight attributes: Conceptual and measurement model (seven items); Reliability (eight items); Validity (six items); Responsiveness (three items); Interpretability (three items); Administration burden (seven items); Alternative modes of administration (two items); and Cross-cultural and linguistic adaptations (three items). Each item can be scored using a 4-point Likert scale.152 An online platform system for the EMPRO has been developed.153

Another evaluation system, which is the most extensive and most widely used, is the ‘COnsensus-based Standards for the selection of health Measurement INstruments’ (COSMIN). COSMIN developed a taxonomy154 and created checklists to assess the methodological quality of individual studies155 and systematic reviews156 of PROMs. The latest COSMIN checklist comprises 116 items over 10 domains: development (35 items); content validity (31 items); structural validity (four items); internal consistency (five items); cross-cultural validity/measurement invariance (four items); reliability (eight items); measurement error (six items); criterion validity (three items); hypothesis testing for construct validity (seven items); and responsiveness (13 items).156 Items are scored on a 4-point rating system. Whereas COSMIN provides in-depth information on the measurement properties (validity, reliability, and responsiveness), EMPRO gives a broader perspective on the PROM by also assessing the modes and burden of administration of the questionnaire.

In general, it is advised to use a combination of generic and disease-specific instruments to include the advantages of both. When choosing PROMs, patient representatives should be involved (see section on Patient Perspective). It is also important to be aware that some PROMs or specific questions might pose ethical issues when used in research. For instance, it should not remain unnoticed until the end of data collection if a patient reports major depression associated with suicidal ideas. Extreme scores on questionnaires, additional information provided by a patient, or discussions between a patient and research personnel can provide critical information, which is called PRO Alerts.157 A clear strategy is needed on what to do when PRO Alerts occur.157 Recently, PRO ethical guidelines have been developed.158 These guidelines include 14 ethical recommendations to be considered when PROs are assessed in clinical research.158 A final aspect to bear in mind is the terms and conditions of the use of the selected PROMs. Most PROMs can be used free of charge. However, there are some PROMs with very strict regulations for their use and high licensing fees, which may even change over time.159 In such a case, it is appropriate to check if there are good alternatives that are free of charge.

What if there is no suitable PROM available?

If a relevant PROM for a specific condition or problem does not exist, there are three possible ways to proceed:160 (i) a PROM for a condition that is closely related could be used; (ii) a generic instrument could be used; or (iii) a new PROM could be developed.160 The first two options are suboptimal, but the latter option is time-consuming and requires expertise in instrument development and psychometrics. The development of a PROM comprises different steps, such as choosing a conceptual/theoretical framework, generating items, scale formation, testing face validity, and extensive psychometric testing.161 The process of development and psychometric evaluation needs to be thoroughly described.162 When a PROM for a related condition is to be used, it is important that the use of the instrument is evaluated by cognitive interviews with patients having the specific disease to assess its relevance and comprehensiveness.

The patient perspective on PROs

The ESC Patient Forum has been included in the development of this position paper from its inception, and its members were widely consulted and more specifically represented (RM, DF). In a focus group session on 6 October 2020 Forum members expressed broad support for the development and use of PROs in research and clinical practice. They expressed how PROs can facilitate a more holistic evaluation of how various cardiac treatments and procedures impact them as an individual, including mental and physical aspects. Where treatment side effects include fatigue or mood disturbance, these should be explained and patient preferences ought to be taken into consideration. Patient Forum members were keen to emphasize that life-prolonging treatment is often not what an individual patient or their families will wish for—rather, most people want to optimize their quality of life. Patients also recognize heart disease as a chronic condition and want PROs to be regularly updated as time progresses, rather than being regarded as a static endpoint.

Patients believe PROs can serve as an aid to shared decision-making, and their application may tilt the balance in favour of an enhanced focus on patient-centred decision-making. Indeed, patients consider PROs to be the appropriate complement to more clinically focused assessments. The introduction of ePROs and real-time data collection is viewed with interest, though a greater consideration of how they might be integrated into clinical practice is needed. Even greater deliberation is needed when PROs are being considered for the remuneration of healthcare providers.

It is paramount that PROs should capture what matters to patients, and therefore meaningful involvement of patients at all stages of their development is required. The results from PROs obtained in a clinic or for research purposes should be used as a prompt to initiate communication with the patients, especially when the scores deviate from the normal range or from patients’ previous responses. They can also support adherence by integrating feedback from the PRO to facilitate shared decision-making, particularly as patients’ circumstances and choices change over time. Issues such as fatigue can have a much more dramatic impact for patients than a score conveys, with the statement ‘Quality of life is My judgement, not yours’ echoing strongly from this feedback.

PROs in routine clinical care

When used in clinical practice, PROs have the potential to capture patients’ symptoms, functioning, and individual health goals in a quantifiable way, that can be used as part of the dialogue between patients and clinicians concerning diagnostic and treatment decisions.163 This shared decision-making is a critical element of person-centred care.164 Experience with routine assessment of PROs is built up in different clinical areas, such as cancer,165,166 rheumatic diseases,167,168 and orthopaedics.169,170 Within cardiology, there is growing interest from clinicians and patients, but the use of PROs in real-life clinical practice remains sparsely tested or implemented171 and clinicians see several barriers.172

The use of PROs in clinical practice can improve communication with patients and families, collaboration among healthcare professionals, monitoring of disease progression, and evaluation of treatment outcomes (Figure 3). Indeed, PROs can inform healthcare professionals to have a better understanding of the perspective of each particular patient, and they improve clinicians’ assessment of the health status of patients.173 PROs assess what matters to patients in a systematic way. In cardiac rehabilitation, PROs are particularly important and seem to be decisive for success as they predict positive outcomes.174 When PROs are assessed cross-sectionally, they can be compared with population benchmarks. It is also interesting and valid to assess PROs in a longitudinal fashion, because it allows the evaluation of within-person evolutions.

Benefits of the use of patient-reported outcomes in clinical practice.
Figure 3

Benefits of the use of patient-reported outcomes in clinical practice.

The use of PROMs in clinical care has been shown to be effective in improving patient management.175 Hence, giving feedback on PROM findings to healthcare professionals can be considered as an intervention. Clinicians who want to implement PRO assessment in their clinical practice can rely on the user’s guide developed by the International Society for Quality of Life Research (ISOQOL).176 Healthcare providers need to be educated how to interpret a new measure and how the results can be integrated into the processes of care. Indeed, information from PROMs, being routinely collected through smart phones, patient portals, in-clinic kiosks, or tablets, should be integrated into the medical record in a location that is easily accessed by the clinicians (e.g. the page where the vital signs are located). Further, it is important that clinicians discuss the findings with patients.172 Obviously, this all requires time, financial resources, personnel, and digital infrastructures to implement the assessment of PROs successfully.

While the implementation of PROs in clinical care is aimed mainly at supporting healthcare professionals and healthcare systems by providing data for their clinical decision-making, PROs can also increase patients’ understanding of their health status. In this respect, the use of graphical displays or dashboards is indispensable.177,178 However, one needs to take the graphical literacy of patients and families into consideration.179 Research has shown that visual analogies or infographics are more effective in increasing patients’ understanding of their condition.179

An important feature is that patients should be able to indicate the relative importance of each PRO. As such, they give a weighting to individual items according to what matters to them. Integrating relative importance of items in PROMs is in its infancy, but should be further developed to make PRO assessment more in line with the preferences of individual patients.

PROs in quality monitoring and improvement

There is a growing awareness that PROs have a place in the evaluation of quality of care. This is rooted in the concept of value-based healthcare, which is defined as improving patient-relevant outcomes, relative to the cost per patient for achieving these improvements.180 In this respect, PRO-based performance measures, also known as PRO-based quality indicators, are of key importance.20 PRO-based performance measures entail an aggregation of information collected through PROMs or PREMs.20,21 Data are aggregated for an accountable healthcare entity, such as a ward, a hospital, or a home care agency.21 Performance measures are preferably expressed as ratios. An example is the percentage of patients with depressive feelings, as shown by a score of >9 on the Patient Health Questionnaire-9 items (PHQ9), who have a follow-up score of <5 at 6 months. The higher the percentage, the better the care that has been provided, because the goals of treatment and care have been reached. Quality indicators that are linked to ESC guidelines that encompass PROMs and PREMs8,181,182 are particularly useful for monitoring the quality of care from patients’ perspectives. It is important that performance measures are risk-adjusted.183

The monitoring of quality of care can also be conducted at regional, national, or international level. For this purpose, quality registries are developed. Quality registries serve as a benchmark to compare healthcare institutions/organizations or to evaluate the effects of quality improvement initiatives. In many national or international registries, the variables related to PROMs and PREMs are not recorded.8,181 Therefore, we call for including patients’ perspective into these existing registries184 with appropriate public funding for relevant PROMs or PREMs that have been validated. Consensus about which PROs to use for each condition has yet to be reached across the national cardiac clinical registries in different countries. The development of data standards for the European Unified Registries for Heart Care Evaluation and Randomized Trials (EuroHeart) are exemplary in this respect. PROs, and more specific HRQoL, are named as key domains that have to be included in the registry.185,186

PROs in clinical trials

The importance of PROs in clinical trials has been recognized since the early 1990s. Indeed, it was found that the adverse event forms that were completed by physicians in two randomized controlled trials on antihypertensive agents captured only 7% of the symptoms that were reported by patients using a structured symptom distress scale.187 Since then, increasingly more clinical trials have used PROs either as primary endpoints of interest, secondary endpoints, or exploratory/tertiary endpoints. In ClinicalTrials.gov, the proportion of trials that included PROs rose from 14% in 2004–07188 to 27% in 2007–13.189 Similarly, the Australian and New Zealand Clinical Trial Registry showed that 45% of the trials had PROs as trial endpoints in 2005–17.190 This illustrates that the value of PROs in clinical trials has been widely recognized, because the typical endpoints in clinical trials do not always give an accurate reflection of all the risks, benefits, quality of life, and costs for patients.191

In clinical trials, PRO endpoints should be decided a priori, submitted for ethical review, and approved in the trial protocol. For this, existing ‘core outcome sets’ can be relied on. It is advisable to have an expert in psychometrics and clinical interpretations of PROs on the trial committee, and to involve patients in selecting suitable PRO instruments and designing how these instruments will be captured. Regulatory and professional bodies show an emerging consensus when it comes to selecting PROMs for clinical trials.192 Nonetheless, the interpretation of PRO data in clinical trials can be challenging because of a lack of familiarity with their clinical importance.16 Therefore, developers of questionnaires or experts in psychometrics should guide trialists on how to use, analyse and interpret the data obtained by that questionnaire. Recent examples are the specific guidance given on the use of the Seattle Angina Questionnaire and the Kansas City Cardiomyopathy Questionnaire in clinical trials.15,16 When reporting PRO findings, recommendations for designing, analysing, and reporting, such as SPIRIT-PRO193 and CONSORT-PRO,194 should be followed.

PROs in regulatory affairs

PROs are used for regulatory approval of drugs or medical devices, for example, to support a product label claim. International regulatory agencies have acknowledged that valid, well defined, and rigorously collected measurements of PROs can complement existing measurements of safety and efficacy, as evidence for making regulatory decisions.195

Regarding medicines, fundamental steps that have been proposed toward making drug development a more patient-centred process include engaging patient representatives during the lifecycle of a drug’s development, identifying feasible patient-centred outcomes, and including PROMs in drug labels to support patients and providers when they make therapeutic decisions. The FDA released guidance on the utility of PRO data in 2009, in order to streamline the review of PROMs and associated clinical trial data and to improve methods for considering patients’ perspectives when reviewing medical products.1 In 2019, the FDA specified that a beneficial effect on symptoms or physical function could be the basis for approving a drug to treat heart failure, even if it has no favourable effect on survival or hospitalizations.196 Sponsors are encouraged to consult with the FDA early, to obtain agreement on proposed end-points.196 In 2015, the European Medicines Agency (EMA) stated in a guideline on the investigation of medicines for acute heart failure, that ‘Improvement in quality of life and/or patients’ self-assessed global clinical status, based on validated ordinal measures of response relative to baseline, could be used as secondary endpoint’.197 Further guidance in 2017 stated that PROs should be included as secondary endpoints in chronic heart failure studies, when they should be considered as supportive, but it also acknowledged that, under special circumstances, measures of symptom burden may be acceptable as a primary endpoint.198

The EU Regulation on medical devices (MDR, EU 2017/745, implemented on 26 May 2021 after a transition period) has increased the requirements for clinical evidence concerning new high-risk medical devices.199 Before approval, ‘clinical investigations’ (a term which includes clinical trials) should demonstrate a positive impact on ‘patient-relevant clinical outcomes’ [MDR Article 2 (53) and Article 61].199 After market access, manufacturers have responsibility for continued surveillance, and they are required to submit an annual safety update report.200 In a 2020 document, the FDA gives guidance on the collection, analysis, and integration of patient perspectives in the development, evaluation, and surveillance of medical devices.201 It is argued that information from well-defined and reliable PRO instruments can provide valuable evidence for benefit-risk assessments and can be used in medical device labelling.201 There are no specific European guidance documents on the application of PROs to evaluate medical devices, but the ESC is leading a project (CORE-MD) that will summarize the evidence and recommend to regulators how that could be done.14 As part of the CORE-MD project, it will be scrutinized to what extent minimal clinically important differences (MCID) have been developed and used for regulatory purposes.

PROs for reimbursement and health economics purposes

Following the idea that ‘value lies in the eyes of the patient’,202 it is not surprising to witness increasing use of PROs to inform a broad range of decisions, including those related to coverage and reimbursement, as well as payments to providers.202,203 For instance, there has been a strong endorsement to integrate PROs in a value-based payment reform that dramatically changes the provider reimbursement landscape in the US.10 PROMs and PREMs can be used in reimbursement decisions in pay-for-performance systems, because the quality of care is then also assessed through the lens of patients.204 An example is the Quality and Outcomes Framework in the UK, where primary care practices are financially rewarded for achieving quality standards that include patients’ experiences.205 Indeed, pay-for-performance programs have to take patient experience into account, to avoid disheartening patients and discouraging them from providing feedback on which effective quality improvement must rely.206 However, reimbursements based on PROs should account for adequate risk adjustments. If not, healthcare providers and practices may be penalized for taking care of sicker, more complex, or socially disadvantaged patients, who will have worse PRO scores.

PROs are increasingly recognized as an important focus in health technology assessments (HTAs). HTAs have become a dominant framework for making decisions related to coverage and reimbursement of new medical technologies, and dossiers submitted to HTA agencies often include PRO data, while HRQoL data and utilities (see Figure 2) are often incorporated into cost-effectiveness analyses.

To date, there is still limited evidence of the use of PROs by HTA bodies in Europe and beyond.207,208 The evidence available is focused mainly on understanding the use of quality-adjusted life years (QALYs), which are mostly based on generic HRQoL measures (i.e. EQ-5D).209 The use of other types of PROs in informing reimbursement decisions (i.e. functional status, symptoms, activities of daily living) has not been sufficiently explored. The inclusion of PROs in reimbursement decisions varies greatly by country and also within a country by payer type, whether national, regional, or local decision-maker.210 This is not a surprise because the extent to which a country relies on the use of HTA in healthcare decision-making is influenced by the underlying culture and values embedded in the institutional context of the country’s particular healthcare system.211

PROs in a digital world

Recent advances in information and communication technology have led to a rapid increase in the means by which patients can provide insights into their health status. It is now possible to collect electronic versions of previously paper-based questionnaires, and to supplement this with data collected from real life, such as patient activity, pain levels, sleep quality, and social interaction. Such ePROs (PRO data using electronic data capture) are now firmly embedded in clinical trials and regulatory approval frameworks,212 and increasingly used in routine clinical practice.213 Also, electronic health records are increasingly integrating PROMs.214 Guidance on the development of digital patient-reported outcome performance measures is available.215

ePROs can, at least in theory, be used more frequently and triggered by patients as well as by healthcare professionals or clinical trialists. This may influence the patient-healthcare professional interaction, facilitating a more flexible mode and frequency of follow-up or surveillance, a better patient-centred conversation supporting a shared care decision-making approach, and a more nuanced understanding of how a condition or its treatment affects the individual.164,216 ePROs also allow for Computer Adaptive Testing (CAT), the basic principle of which is to avoid asking questions that are redundant, given the responses to prior questions. For instance, if a respondent indicated that they are able to walk 1 kilometre without symptoms, whether they can walk a few hundred metres is no longer a relevant question and can therefore be omitted. With appropriate data display, ePROs can stimulate patients to manage their own monitoring and treatment, supporting them in the journey to self-care if so desired. In this respect, it is important to use visualization methods that are most effective in communicating with patients.179 Arguably, ePROs can be used successfully only in patients with sufficient eHealth literacy.217

Future directions

In cardiology, the use of PROs is increasing. This statement has highlighted their applications in cardiovascular clinical practice, for monitoring of quality of care, and as input for regulatory and reimbursement decisions. Nonetheless, there is much room for further developments, for building capacity and expertise, and for wider adoption of evidence-based PROs in the cardiovascular arena. Research should explore which instruments are best for discerning patients’ concerns and for impacting on decisions to improve outcomes, while respecting the preferences of individual patients on whether or not they wish to contribute their experience in this way. Suggestions for future developments are summarized in Box 1.

Box 1
Optimal practice and future directions for the use of patient-reported outcomes (PROs)

PROs in clinical/shared decision-making

  • Clinicians should familiarize themselves or be educated about what PROs are, how they can be used and how to interpret the data.

  • The measurement of PROs is to be integrated into standard clinical practice (i) to benchmark individual patients with the population and (ii) to assess within-person evolutions to evaluate the effectiveness of treatment and patient management.

  • PROMs should be adapted such that patients can indicate the relative importance of each PRO to make PROs preference-sensitive.

  • Healthcare professionals should give feedback to patients on their PRO scores. The use of PROMs can enhance patients’ understanding and improve their health behaviours.

  • When communicating PRO scores with patients, the use of visual analogies is advocated, because most people have limited experience of interpreting graphs.

  • Managers and administrators need to provide the time, personnel, financial resources, and digital infrastructure to clinicians to allow them to implement evidence-based (validated) PRO assessments.

  • PROs should be included among methods used to inform the development and evaluate the effectiveness of population health programmes.

PROs in quality monitoring and improvement

  • Quality of care assessment should include PRO-based performance measures, which ought to be risk-adjusted.

  • Professional guidelines, such as those of the ESC, should encompass a description of which PROMs and PREMs could be used to assess the performance of, and/or the adherence to, their recommendations.

  • For cardiac clinical registries, international consensus should be reached about which generic and disease-specific PROMs and PREMs to include for each cardiac condition.

PROs in clinical trials

  • PRO endpoints should be decided a priori and included in the ethical review and the trial registration.

  • Trial committees should have PRO expertise.

  • Patients should be involved in selecting suitable PRO instruments.

  • Guidance for the use, analysis, and interpretation of PROs in clinical trials should be developed.

  • Recommendations for designing, analysing and reporting PRO findings should be used (e.g. SPIRIT-PRO; CONSORT-PRO).

  • PRO Alerts are advised to capture issues that require prompt intervention.

PROs for regulatory purposes

  • Minimal requirements for PROMs suitable for regulatory purposes should be developed.

  • Minimal clinically important differences (MCID) should be determined for all PROMs that are (to be) used for regulatory purposes.

  • Existing EU guidance on the clinical evaluation of medical devices218 and the recommendations from the International Standardization Organization219 should be revised to include specific advice concerning PROs.

PROs for reimbursement and health economics purposes

  • The use of a broad range of PROs (i.e. functional status, symptoms, activities of daily living, empowerment) in informing reimbursement decisions should be further evaluated.

  • Consensus has to be reached among patients, clinicians, and decision-makers on choosing the appropriate PROMs.

  • Reimbursements based on PROs should account for risk adjustments and case mixes.

  • Health Technology Assessment (HTA) should consider both generic and disease-specific measures in order to allow comparisons across conditions as well as to capture specificities of a particular disease.

  • International consensus on adequate data-gathering methods ought to be reached to promote integrated PRO assessment in health decision-making across countries.

PROs in digital healthcare

  • A good information governance and digital infrastructure need to be in place to allow the use of ePROs.

  • Computer Adaptive Testing (CAT) should be implemented to reduce the response burden and produce optimal tests.

  • The digital literacy of patients has to be evaluated to avoid that the digital transformation is increasing health inequalities and inequity in society.

  • Clinicians need to be trained on how to interpret and apply ePRO data, allowing time in the workflow (and if necessary, reimbursement) to maximize the value of this added layer of information and insight.

  • PROMs should be integrated with electronic health records.

CAT, Computer Adaptive Testing; HTA, Health Technology Assessment; PRO, Patient-Reported Outcomes; PROMs, Patient-Reported Outcome Measures; PREMs, Patient-Reported Experience Measures; PRIMs, Patient-Reported Importance Measures.

Conclusion

The use of PROs provides insights into the perspective of patients. This statement aims to stimulate the use of PROs in cardiovascular medicine by providing guidance to clinicians, researchers, and policy-makers. We propose a new definition of PROs and advise on future developments and optimal use of PROs in shared clinical decision-making, quality monitoring and improvement, clinical trials, regulatory and reimbursement decisions, and the digital health arena (Graphical Abstract). We hope that this statement will provide a practical guide on the potential of PROs and stimulate the growth of a cadre of experts supporting further development and adoption of PROs in cardiology.

Supplementary data

Supplementary data are not available at European Heart Journal online.

Declarations

Disclosure of Interest

B.B., B.C., T.J., F.S. declare no conflict of interest. P.M. reports a leadership role in ACNAP; and being Editor-in-Chief of the European Journal of Cardiovascular Nursing. T.M.N. reports grants from the Western Norway Regional Health Authority; travel support from Haukeland University Hospital; and a leadership role in the Ethics and Oversight Committee of the European Society of Cardiology. E.B. reports grants from Fundacio MArato TV3; consulting fees from Biosense Webster; speakers fees from Bayer and Biosense Webster; leadership roles in the EHRA advocacy committee. B.C. reports participation in data safety monitoring boards/Advisory boards of the Fondation Leducq; translational research group SAB, German Centre for Cardiovascular Research, and Max Delbrück Centre for Molecular Medicine SAB, Helmholtz Association, Germany; leadership roles in the IHU LIRYC research institute Bordeaux, France, Netherlands Heart Institute, and the Association of Physicians of Great Britain & Ireland; Receipt of ECG monitors from iRhythm to support screening trial of A.F. M.R.C. reports leadership roles at the European Society of Cardiology, the Atrial Fibrillation Association, and the Pumping Marvellous Foundation; and being employed by AstraZeneca (since August 2022). D.F. reports grants from the British Heart Foundation, Burdette Trust, and the Northern Ireland Chest Heart & Stroke; participation in data safety monitoring boards/Advisory boards of EHRA-PATHS and PROFID; leadership roles in the Advocacy Committee of the European Society of Cardiology and the Northern Ireland Chest Heart & Stroke. A.G.F. reports grants from the EU Horizon 2020 for the CORE-MD project. P.K. received grants for the AFFECT-AF trial, MAESTRIA trial, British Heart Foundation, the German Centre for Cardiovascular Research, Deutsche Forschungsgemeinschaft, Leducq Foundation, European Union, Medical Research Council; inventor of two patents; travel and meeting support of the European Society of Cardiology; leadership roles at the European Society of Cardiology. J.M. is co-owner of CERC CRO. R.M. reports travel and meeting support from the European Society of Cardiology; leadership roles in European Society of Cardiology (ESC), Cardiomyopathy UK, Pumping Marvellous, Royal Brompton Hospital, London, NICE (National Institute for Care Excellence), IRONMAN trial, MitoDCM, Coalition for Reducing Bureaucracy in Clinical Trials. J.S. reports grants from Barts Charity, National Institute for Health and Care Research UK, Health Education England; consulting fees for SedateUK; travel and meeting support from ACNAP; participation in data safety monitoring and advisory board for the Val-Card trial; leadership roles for the Aortic Dissection Charitable Trust, the Council of Deans for health research, and ACNAP science committee. A.T. reports consulting fees for the European Society of Cardiology. A.D.Z. reports leadership roles in the National PRO initiative in cardiac diseases and have been part of the HeartQol development.

Data Availability

This statement is based on previously published material. Hence, no new data are presented.

Funding

All authors declare no funding for this contribution.

References

1

US Department of Health and Human Service Food and Drug Administration
.
Guidance for industry. Patient-reported outcome measures: Use in medical product development to support labeling claims. In. Silver Spring, MD: Food and Drug Administration; 2009
.

2

Liu
JB
,
Pusic
AL
,
Temple
LK
,
Ko
CYK
.
Patient-reported outcomes in surgery: listening to patients improves quality of life
.
Bull Am Coll Surg
2017
;
102
:
19
23
.

3

Noonan
VK
,
Lyddiatt
A
,
Ware
P
,
Jaglal
SB
,
Riopelle
RJ
,
Bingham
CO
, et al.
Montreal Accord on patient-reported outcomes (PROs) use series—paper 3: patient-reported outcomes can facilitate shared decision-making and guide self-management
.
J Clin Epidemiol
2017
;
89
:
125
35
. https://doi.org/10.1016/j.jclinepi.2017.04.017

4

Bingham
CO
,
Noonan
VK
,
Auger
C
,
Feldman
DE
,
Ahmed
S
,
Bartlett
SJ
.
Montreal Accord on patient-reported outcomes (PROs) use series—paper 4: patient-reported outcomes can inform clinical decision making in chronic care
.
J Clin Epidemiol
2017
;
89
:
136
41
. https://doi.org/10.1016/j.jclinepi.2017.04.014

5

Lauck
SB
,
Lewis
KB
,
Borregaard
B
,
de Sousa
I
.
What is the right decision for me?” integrating patient perspectives through shared decision-making for valvular heart disease therapy
.
Can J Cardiol
2021
;
37
:
1054
63
. https://doi.org/10.1016/j.cjca.2021.02.022

6

Basch
E
,
Barbera
L
,
Kerrigan
CL
,
Velikova
G
.
Implementation of patient-reported outcomes in routine medical care
.
Am Soc Clin Oncol Educ Book
2018
;
38
:
122
34
. https://doi.org/10.1200/EDBK_200383

7

Spertus
JA
.
Understanding how patients fare: insights into the health Status patterns of patients with coronary disease and the future of evidence-based shared medical decision-making
.
Circ Cardiovasc Qual Outcomes
2018
;
11
:
e004555
. https://doi.org/10.1161/CIRCOUTCOMES.118.004555

8

Arbelo
E
,
Aktaa
S
,
Bollmann
A
,
D'Avila
A
,
Drossart
I
,
Dwight
J
, et al.
Quality indicators for the care and outcomes of adults with atrial fibrillation
.
Europace
2021
;
23
:
494
5
. https://doi.org/10.1093/europace/euaa253

9

Schwartzberg
L
.
Electronic patient-reported outcomes: the time is ripe for integration into patient care and clinical research
.
Am Soc Clin Oncol Educ Book
2016
;
35
:
e89
96
. https://doi.org/10.1200/EDBK_158749

10

Squitieri
L
,
Bozic
KJ
,
Pusic
AL
.
The role of patient-reported outcome measures in value-based payment reform
.
Value Health
2017
;
20
:
834
6
. https://doi.org/10.1016/j.jval.2017.02.003

11

Psotka
MA
,
von Maltzahn
R
,
Anatchkova
M
,
Agodoa
I
,
Chau
D
,
Malik
FI
, et al.
Patient-reported outcomes in chronic heart failure: applicability for regulatory approval
.
JACC Heart Fail
2016
;
4
:
791
804
. https://doi.org/10.1016/j.jchf.2016.04.010

12

Steinberg
BA
,
Dorian
P
,
Anstrom
KJ
,
Hess
R
,
Mark
DB
,
Noseworthy
PA
, et al.
Patient-reported outcomes in atrial fibrillation research: results of a clinicaltrials.gov analysis
.
JACC Clin Electrophysiol
2019
;
5
:
599
605
. https://doi.org/10.1016/j.jacep.2019.03.008

13

Patrick
DL
,
Burke
LB
,
Powers
JH
,
Scott
JA
,
Rock
EP
,
Dawisha
S
, et al.
Patient-reported outcomes to support medical product labeling claims: fDA perspective
.
Value Health
2007
;
10
:
S125
37
. https://doi.org/10.1111/j.1524-4733.2007.00275.x

14

Fraser
AG
,
Nelissen
R
,
Kjærsgaard-Andersen
P
,
Szymański
P
,
Melvin
T
,
Piscoi
P
.
Improved clinical investigation and evaluation of high-risk medical devices: the rationale and objectives of CORE-MD (Coordinating Research and Evidence for Medical Devices)
.
Eur Heart J Qual Care Clin Outcomes
2022
;
8
:
249
58
. https://doi.org/10.1093/ehjqcco/qcab059

15

Spertus
JA
,
Jones
PG
,
Sandhu
AT
,
Arnold
SV
.
Interpreting the Kansas city cardiomyopathy questionnaire in clinical trials and clinical care: JACC state-of-the-art review
.
J Am Coll Cardiol
2020
;
76
:
2379
90
. https://doi.org/10.1016/j.jacc.2020.09.542

16

Thomas
M
,
Jones
PG
,
Arnold
SV
,
Spertus
JA
.
Interpretation of the Seattle angina questionnaire as an outcome measure in clinical trials and clinical care: a review
.
JAMA Cardiol
2021
;
6
:
593
9
. https://doi.org/10.1001/jamacardio.2020.7478

17

Rumsfeld
JS
,
Alexander
KP
,
Goff
DC
Jr
,
Graham
MM
,
Ho
PM
,
Masoudi
FA
, et al.
Cardiovascular health: the importance of measuring patient-reported health status: a scientific statement from the American Heart Association
.
Circulation
2013
;
127
:
2233
49
. https://doi.org/10.1161/CIR.0b013e3182949a2e

18

Anker
SD
,
Agewall
S
,
Borggrefe
M
,
Calvert
M
,
Jaime Caro
J
,
Cowie
MR
, et al.
The importance of patient-reported outcomes: a call for their comprehensive integration in cardiovascular clinical trials
.
Eur Heart J
2014
;
35
:
2001
9
. https://doi.org/10.1093/eurheartj/ehu205

19

Acquadro
C
,
Berzon
R
,
Dubois
D
,
Leidy
NK
,
Marquis
P
,
Revicki
D
, et al.
Incorporating the patient's perspective into drug development and communication: an ad hoc task force report of the Patient-Reported Outcomes (PRO) Harmonization Group meeting at the Food and Drug Administration, February 16, 2001
.
Value Health
2003
;
6
:
522
31
. https://doi.org/10.1046/j.1524-4733.2003.65309.x

20

National Quality Forum
.
Patient Reported Outcomes (PRO) in Performance Measurement
.
Washington DC
:
National Quality Forum
;
2013
.

21

Cella
D
,
Hahn
EA
,
Jensen
SE
,
Butt
Z
,
Nowinski
CJ
,
Rothrock
N
, et al.
Patient-Reported Outcomes in Performance Measurement
.:
Research Triangle Institute
;
2015
. p
91
.

22

Devlin
NJ
,
Appleby
J
.
Getting the Most out of PROMS: Putting Health Outcomes at the Heart of NHS Decision-Making
.
London, UK
:
The King’s Fund
;
2010
. p
83
.

23

EuroQol Group
.
Euroqol–a new facility for the measurement of health-related quality of life
.
Health Policy
1990
;
16
:
199
208
. https://doi.org/10.1016/0168-8510(90)90421-9

24

Ware
JE
,
Snow
KK
,
Kosinski
M
,
Gandek
B
.
SF-36 Health Survey: Manual & Interpretation Guide
.
Boston
:
The Health Institute, New England Medical Center
;
1993
.

25

Cella
D
,
Yount
S
,
Rothrock
N
,
Gershon
R
,
Cook
K
,
Reeve
B
, et al.
The patient-reported outcomes measurement information system (PROMIS): progress of an NIH roadmap cooperative group during its first two years
.
Med Care
2007
;
45
:
S3
S11
. https://doi.org/10.1097/01.mlr.0000258615.42478.55

26

Rector
TS
,
Kubo
SH
,
Cohn
JN
.
Patients’ self-assessment of their congestive heart failure. Part 2: content, reliability and validity of a new measure, the Minnesota living with heart failure questionnaire
.
Heart Fail
1987
;
3
:
198
209
.

27

Thompson
DR
,
Jenkinson
C
,
Roebuck
A
,
Lewin
RJ
,
Boyle
RM
,
Chandola
T
.
Development and validation of a short measure of health status for individuals with acute myocardial infarction: the myocardial infarction dimensional assessment scale (MIDAS)
.
Qual Life Res
2002
;
11
:
535
43
. https://doi.org/10.1023/A:1016354516168

28

Hawker
GA
,
Mian
S
,
Kendzerska
T
,
French
M
.
Measures of adult pain: visual analog scale for pain (VAS pain), numeric rating scale for pain (NRS pain), McGill pain questionnaire (MPQ), short-form McGill pain questionnaire (SF-MPQ), chronic pain grade scale (CPGS), short form-36 bodily pain scale (SF-36 BPS), and measure of intermittent and constant osteoarthritis pain (ICOAP)
.
Arthritis Care Res (Hoboken)
2011
;
63
:
S240
52
. https://doi.org/10.1002/acr.20543

29

Goossens
E
,
Luyckx
K
,
Mommen
N
,
Gewillig
M
,
Budts
W
,
Zupancic
N
, et al.
Health risk behaviors in adolescents and emerging adults with congenital heart disease: psychometric properties of the health behavior scale-congenital heart disease
.
Eur J Cardiovasc Nurs
2013
;
12
:
544
57
. https://doi.org/10.1177/1474515113475934

30

Rose
GA
.
The diagnosis of ischaemic heart pain and intermittent claudication in field surveys
.
Bull World Health Organ
1962
;
27
:
645
58
.

31

Bennett
SJ
,
Puntenney
PJ
,
Walker
NL
,
Ashley
ND
.
Development of an instrument to measure threat related to cardiac events
.
Nurs Res
1996
;
45
:
266
70
. https://doi.org/10.1097/00006199-199609000-00003

32

Währborg
P
,
Emanuelsson
H
.
The cardiac health profile: content, reliability and validity of a new disease-specific quality of life questionnaire
.
Coron Artery Dis
1996
;
7
:
823
9
. https://doi.org/10.1097/00019501-199611000-00006

33

Chew
DS
,
Whitelaw
S
,
Vaduganathan
M
,
Mark
DB
,
Van Spall
HGC
.
Patient-reported outcome measures in cardiovascular disease: an evidence map of the psychometric properties of health status instruments
.
Ann Intern Med
2022
;
175
:
1431
9
. https://doi.org/10.7326/M22-2234

34

Mithal
M
,
Granger
CV
,
Naughton
JP
,
Haberl
ED
,
Jones
JD
.
Measuring functional status and health-related quality of life in patients participating in an outpatient phase II cardiac rehabilitation program
.
Crit Rev Phys Rehabil Med
2007
;
19
:
153
67
. https://doi.org/10.1615/CritRevPhysRehabilMed.v19.i2.50

35

Avis
NE
,
Smith
KW
,
Hambleton
RK
,
Feldman
HA
,
Selwyn
A
,
Jacobs
A
.
Development of the multidimensional index of life quality. A quality of life measure for cardiovascular disease
.
Med Care
1996
;
34
:
1102
20
. https://doi.org/10.1097/00005650-199611000-00005

36

Ferrans
CE
,
Powers
MJ
.
Quality of life index: development and psychometric properties
.
Adv Nurs Sci
1985
;
8
:
15
24
. https://doi.org/10.1097/00012272-198510000-00005

37

Hlatky
MA
,
Boineau
RE
,
Higginbotham
MB
,
Lee
KL
,
Mark
DB
,
Califf
RM
, et al.
A brief self-administered questionnaire to determine functional capacity (the Duke Activity Status Index)
.
Am J Cardiol
1989
;
64
:
651
4
. https://doi.org/10.1016/0002-9149(89)90496-7

38

Goldman
L
,
Hashimoto
B
,
Cook
EF
,
Loscalzo
A
.
Comparative reproducibility and validity of systems for assessing cardiovascular functional class: advantages of a new specific activity scale
.
Circulation
1981
;
64
:
1227
34
. https://doi.org/10.1161/01.CIR.64.6.1227

39

Eifert
GH
,
Thompson
RN
,
Zvolensky
MJ
,
Edwards
K
,
Frazer
NL
,
Haddad
JW
, et al.
The cardiac anxiety questionnaire: development and preliminary validity
.
Behav Res Ther
2000
;
38
:
1039
53
. https://doi.org/10.1016/S0005-7967(99)00132-1

40

Hare
DL
,
Davis
CR
.
Cardiac depression scale: validation of a new depression scale for cardiac patients
.
J Psychosom Res
1996
;
40
:
379
86
. https://doi.org/10.1016/0022-3999(95)00612-5

41

Jackson
A
,
Rogerson
M
,
Le Grande
M
,
Thompson
D
,
Ski
C
,
Alvarenga
M
, et al.
Protocol for the development and validation of a measure of persistent psychological and emotional distress in cardiac patients: the cardiac distress inventory
.
BMJ Open
2020
;
10
:
e034946
. https://doi.org/10.1136/bmjopen-2019-034946

42

Wood
KA
,
Stewart
AL
,
Drew
BJ
,
Scheinman
MM
,
Froelicher
ES
.
Development and initial psychometric evaluation of the patient perspective of arrhythmia questionnaire
.
Res Nurs Health
2009
;
32
:
504
16
. https://doi.org/10.1002/nur.20347

43

Härdén
M
,
Nyström
B
,
Kulich
K
,
Carlsson
J
,
Bengtson
A
,
Edvardsson
N
.
Validity and reliability of a new, short symptom rating scale in patients with persistent atrial fibrillation
.
Health Qual Life Outcomes
2009
;
7
:
65
. https://doi.org/10.1186/1477-7525-7-65

44

Härdén
M
,
Nyström
B
,
Bengtson
A
,
Medin
J
,
Frison
L
,
Edvardsson
N
.
Responsiveness of AF6, a new, short, validated, atrial fibrillation-specific questionnaire–symptomatic benefit of direct current cardioversion
.
J Interv Card Electrophysiol
2010
;
28
:
185
91
. https://doi.org/10.1007/s10840-010-9487-3

45

Kotecha
D
,
Ahmed
A
,
Calvert
M
,
Lencioni
M
,
Terwee
CB
,
Lane
DA
.
Patient-reported outcomes for quality of life assessment in atrial fibrillation: a systematic review of measurement properties
.
PLoS One
2016
;
11
:
e0165790
. https://doi.org/10.1371/journal.pone.0165790

46

Zimmerman
L
,
Pozehl
B
,
Vuckovic
K
,
Barnason
S
,
Schulz
P
,
Seo
Y
, et al.
Selecting symptom instruments for cardiovascular populations
.
Heart Lung
2016
;
45
:
475
96
. https://doi.org/10.1016/j.hrtlng.2016.08.012

47

Coyne
KS
,
Edvardsson
N
,
Rydén
A
.
Development and validation of the AFImpact: an atrial fibrillation-specific measure of patient-reported health-related quality of life
.
Value Health
2017
;
20
:
1355
61
. https://doi.org/10.1016/j.jval.2017.06.005

48

Badia
X
,
Arribas
F
,
Ormaetxe
JM
,
Peinado
R
,
de Los Terreros
MS
.
Development of a questionnaire to measure health-related quality of life (HRQoL) in patients with atrial fibrillation (AF-QoL)
.
Health Qual Life Outcomes
2007
;
5
:
37
. https://doi.org/10.1186/1477-7525-5-37

49

Spertus
J
,
Dorian
P
,
Bubien
R
,
Lewis
S
,
Godejohn
D
,
Reynolds
MR
, et al.
Development and validation of the atrial fibrillation effect on QualiTy-of-life (AFEQT) questionnaire in patients with atrial fibrillation
.
Circ Arrhythm Electrophysiol
2011
;
4
:
15
25
. https://doi.org/10.1161/CIRCEP.110.958033

50

Yamashita
T
,
Kumagai
K
,
Koretsune
Y
,
Mitamura
H
,
Okumura
K
,
Ogawa
S
, et al.
A new method for evaluating quality of life specific to patients with atrial fibrillation: atrial fibrillation quality of life questionnaire (AFQLQ)
.
Japan J Electrocardiol
2003
;
23
:
332
43
. https://doi.org/10.5105/jse.23.332

51

Sale
A
,
Yu
J
.
Quality of life instruments in atrial fibrillation: a systematic review of measurement properties
.
Health Qual Life Outcomes
2022
;
20
:
143
. https://doi.org/10.1186/s12955-022-02057-y

52

Braganca
EO
,
Filho
BL
,
Maria
VH
,
Levy
D
,
de Paola
AA
.
Validating a new quality of life questionnaire for atrial fibrillation patients
.
Int J Cardiol
2010
;
143
:
391
8
. https://doi.org/10.1016/j.ijcard.2009.03.087

53

Maglio
C
,
Sra
J
,
Paquette
M
,
Dorian
P
,
Bygrave
A
,
Wood
KA
, et al.
Measuring quality of life and symptom severity in patients with atrial fibrillation
.
Pacing Clin Electrophysiol
1998
;
21
:
839
.

54

White
J
,
Withers
KL
,
Lencioni
M
,
Carolan-Rees
G
,
Wilkes
AR
,
Wood
KA
, et al.
Cardiff cardiac ablation patient-reported outcome measure (C-CAP): validation of a new questionnaire set for patients undergoing catheter ablation for cardiac arrhythmias in the UK
.
Qual Life Res
2016
;
25
:
1571
83
. https://doi.org/10.1007/s11136-015-1194-1

55

Withers
KL
,
White
J
,
Carolan-Rees
G
,
Patrick
H
,
O'Callaghan
P
,
Murray
S
, et al.
Patient reported outcome measures for cardiac ablation procedures: a multicentre pilot to develop a new questionnaire
.
Europace
2014
;
16
:
1626
33
. https://doi.org/10.1093/europace/euu032

56

Walfridsson
U
,
Arestedt
K
,
Stromberg
A
.
Development and validation of a new arrhythmia-specific questionnaire in tachycardia and arrhythmia (ASTA) with focus on symptom burden
.
Health Qual Life Outcomes
2012
;
10
:
44
. https://doi.org/10.1186/1477-7525-10-44

57

Kesek
M
,
Tollefsen
T
,
Höglund
N
,
Rönn
F
,
Näslund
U
,
Jensen
SM
.
U22, a protocol to quantify symptoms associated with supraventricular tachycardia
.
Pacing Clin Electrophysiol
2009
;
32
:
S105
8
. https://doi.org/10.1111/j.1540-8159.2008.02263.x

58

Dorian
P
,
Guerra
PG
,
Kerr
CR
,
O'Donnell
SS
,
Crystal
E
,
Gillis
AM
, et al.
Validation of a new simple scale to measure symptoms in atrial fibrillation: the Canadian cardiovascular society severity in atrial fibrillation scale
.
Circ Arrhythm Electrophysiol
2009
;
2
:
218
24
. https://doi.org/10.1161/CIRCEP.108.812347

59

Wokhlu
A
,
Hodge
DO
,
Monahan
K
,
Haroldson
J
,
Wock
KJ
,
Asirvatham
SJ
, et al.
Unique AF-specific symptom score assesses long-term symptom relief after ablation
.
Circulation
2008
;
118
:
S589
. https://doi.org/10.1161/circ.118.suppl_18.S_589-a

60

Bubien
RS
,
Knotts-Dolson
SM
,
Plumb
VJ
,
Kay
GN
.
Effect of radiofrequency catheter ablation on health-related quality of life and activities of daily living in patients with recurrent arrhythmias
.
Circulation
1996
;
94
:
1585
91
. https://doi.org/10.1161/01.CIR.94.7.1585

61

Xu
W
,
Sun
G
,
Lin
Z
,
Chen
M
,
Yang
B
,
Chen
H
, et al.
Knowledge, attitude, and behavior in patients with atrial fibrillation undergoing radiofrequency catheter ablation
.
J Interv Card Electrophysiol
2010
;
28
:
199
207
. https://doi.org/10.1007/s10840-010-9496-2

62

McCabe
PJ
,
Schad
S
,
Hampton
A
,
Holland
DE
.
Knowledge and self-management behaviors of patients with recently detected atrial fibrillation
.
Heart Lung
2008
;
37
:
79
90
. https://doi.org/10.1016/j.hrtlng.2007.02.006

63

Ruiz Díaz
MA
,
García
ME
,
Aguilera
RM
,
Prat
XV
,
García
JS
,
Orozco
MA
, et al.
Patient satisfaction with remote monitoring of cardiac implantable electronic devices: the VALIOSA questionnaire
.
BMC Health Serv Res
2020
;
20
:
354
. https://doi.org/10.1186/s12913-020-05216-3

64

Bratt
A
,
Allvin
R
,
Wann-Hansson
C
.
Modifying a generic postoperative recovery profile instrument to an instrument specifically targeting coronary artery bypass grafting
.
Scand J Caring Sci
2017
;
31
:
475
86
. https://doi.org/10.1111/scs.12360

65

Schroter
S
,
Lamping
DL
.
Coronary revascularisation outcome questionnaire (CROQ): development and validation of a new, patient based measure of outcome in coronary bypass surgery and angioplasty
.
Heart
2004
;
90
:
1460
6
. https://doi.org/10.1136/hrt.2003.021899

66

Marquis
P
,
Fayol
C
,
Joire
JE
.
Clinical validation of a quality of life questionnaire in angina pectoris patients
.
Eur Heart J
1995
;
16
:
1554
60
. https://doi.org/10.1093/oxfordjournals.eurheartj.a060777

67

Lewin
RJ
,
Thompson
DR
,
Martin
CR
,
Stuckey
N
,
Devlen
J
,
Michaelson
S
, et al.
Validation of the cardiovascular limitations and symptoms profile (CLASP) in chronic stable angina
.
J Cardiopulm Rehabil
2002
;
22
:
184
91
. https://doi.org/10.1097/00008483-200205000-00010

68

Denollet
J
.
Health complaints and outcome assessment in coronary heart disease
.
Psychosom Med
1994
;
56
:
463
74
. https://doi.org/10.1097/00006842-199409000-00012

69

Oldridge
N
,
Höfer
S
,
McGee
H
,
Conroy
R
,
Doyle
F
,
Saner
H
.
The HeartQoL: part I. Development of a new core health-related quality of life questionnaire for patients with ischemic heart disease
.
Eur J Prev Cardiol
2014
;
21
:
90
7
. https://doi.org/10.1177/2047487312450544

70

Oldridge
N
,
Höfer
S
,
McGee
H
,
Conroy
R
,
Doyle
F
,
Saner
H
.
The HeartQoL: part II. Validation of a new core health-related quality of life questionnaire for patients with ischemic heart disease
.
Eur J Prev Cardiol
2014
;
21
:
98
106
. https://doi.org/10.1177/2047487312450545

71

Rukholm
E
,
McGirr
M
.
A quality-of-life index for clients with ischemic heart disease: establishing reliability and validity
.
Rehabil Nurs
1994
;
19
:
12
6
. https://doi.org/10.1002/j.2048-7940.1994.tb01296.x

72

Wan
C
,
Li
H
,
Fan
X
,
Yang
R
,
Pan
J
,
Chen
W
, et al.
Development and validation of the coronary heart disease scale under the system of quality of life instruments for chronic diseases QLICD-CHD: combinations of classical test theory and generalizability theory
.
Health Qual Life Outcomes
2014
;
12
:
82
. https://doi.org/10.1186/1477-7525-12-82

73

Spertus
JA
,
Winder
JA
,
Dewhurst
TA
,
Deyo
RA
,
Prodzinski
J
,
McDonell
M
, et al.
Development and evaluation of the Seattle angina questionnaire: a new functional status measure for coronary artery disease
.
J Am Coll Cardiol
1995
;
25
:
333
41
. https://doi.org/10.1016/0735-1097(94)00397-9

74

Chan
PS
,
Jones
PG
,
Arnold
SA
,
Spertus
JA
.
Development and validation of a short version of the Seattle angina questionnaire
.
Circ Cardiovasc Qual Outcomes
2014
;
7
:
640
7
. https://doi.org/10.1161/CIRCOUTCOMES.114.000967

75

Wilson
A
,
Wiklund
I
,
Lahti
T
,
Wahl
M
.
A summary index for the assessment of quality of life in angina pectoris
.
J Clin Epidemiol
1991
;
44
:
981
8
. https://doi.org/10.1016/0895-4356(91)90069-L

76

Valenti
L
,
Lim
L
,
Heller
RF
,
Knapp
J
.
An improved questionnaire for assessing quality of life after acute myocardial infarction
.
Qual Life Res
1996
;
5
:
151
61
. https://doi.org/10.1007/BF00435980

77

Hillers
TK
,
Guyatt
GH
,
Oldridge
N
,
Crowe
J
,
Willan
A
,
Griffith
L
, et al.
Quality of life after myocardial infarction
.
J Clin Epidemiol
1994
;
47
:
1287
96
. https://doi.org/10.1016/0895-4356(94)90134-1

78

Miller
KH
,
Grindel
CG
.
Comparison of symptoms of younger and older patients undergoing coronary artery bypass surgery
.
Clin Nurs Res
2004
;
13
:
179
93
; discussion
194
8
. https://doi.org/10.1177/1054773804265693

79

Nieveen
JL
,
Zimmerman
LM
,
Barnason
SA
,
Yates
BC
.
Development and content validity testing of the cardiac symptom survey in patients after coronary artery bypass grafting
.
Heart Lung
2008
;
37
:
17
27
. https://doi.org/10.1016/j.hrtlng.2006.12.002

80

LaPier
TK
,
Chunkwon
J
.
Development and content validity of the heart surgery symptom inventory
.
Acute Care Perspect
2002
;
11
:
5
12
.

81

Jenkins
CD
,
Jono
RT
,
Stanton
BA
,
Stroup-Benham
CA
.
The measurement of health-related quality of life: major dimensions identified by factor analysis
.
Soc Sci Med
1990
;
31
:
925
31
. https://doi.org/10.1016/0277-9536(90)90032-N

82

Artinian
NT
,
Duggan
C
,
Miller
P
.
Age differences in patient recovery patterns following coronary artery bypass surgery
.
Am J Crit Care
1993
;
2
:
453
61
. https://doi.org/10.4037/ajcc1993.2.6.453

83

Plach
SK
,
Heidrich
SM
.
Women's perceptions of their social roles after heart surgery and coronary angioplasty
.
Heart Lung
2001
;
30
:
117
27
. https://doi.org/10.1067/mhl.2001.113561

84

Devon
HA
,
Rosenfeld
A
,
Steffen
AD
,
Daya
M
.
Sensitivity, specificity, and sex differences in symptoms reported on the 13-item acute coronary syndrome checklist
.
J Am Heart Assoc
2014
;
3
:
e000586
. https://doi.org/10.1161/JAHA.113.000586

85

McSweeney
JC
,
O'Sullivan
P
,
Cody
M
,
Crane
PB
.
Development of the McSweeney acute and prodromal myocardial infarction symptom survey
.
J Cardiovasc Nurs
2004
;
19
:
58
67
. https://doi.org/10.1097/00005082-200401000-00010

86

DeVon
HA
,
Ryan
CJ
,
Ochs
AL
,
Shapiro
M
.
Symptoms across the continuum of acute coronary syndromes: differences between women and men
.
Am J Crit Care
2008
;
17
:
14
24
; quiz
25
. https://doi.org/10.4037/ajcc2008.17.1.14

87

Keresztes
P
,
Holm
K
,
Penckofer
S
,
Merritt
S
.
Measurement of functional ability in patients with coronary artery disease
.
J Nurs Meas
1993
;
1
:
19
28
. https://doi.org/10.1891/1061-3749.1.1.19

88

Lawlor
DA
,
Adamson
J
,
Ebrahim
S
.
Performance of the WHO rose angina questionnaire in post-menopausal women: are all of the questions necessary?
J Epidemiol Community Health
2003
;
57
:
538
41
. https://doi.org/10.1136/jech.57.7.538

89

Lerner
DJ
,
Amick
BC
III
,
Malspeis
S
,
Rogers
WH
,
Gomes
DR
,
Salem
DN
.
The angina-related limitations at work questionnaire
.
Qual Life Res
1998
;
7
:
23
32
. https://doi.org/10.1023/A:1008880704343

90

Cedars
AM
,
Ko
JM
,
John
AS
,
Vittengl
J
,
Stefanescu-Schmidt
AC
,
Jarrett
RB
, et al.
Development of a novel adult congenital heart disease-specific patient-reported outcome metric
.
J Am Heart Assoc
2020
;
9
:
e015730
. https://doi.org/10.1161/JAHA.119.015730

91

Kamphuis
M
,
Zwinderman
KH
,
Vogels
T
,
Vliegen
HW
,
Kamphuis
RP
,
Ottenkamp
J
, et al.
A cardiac-specific health-related quality of life module for young adults with congenital heart disease: development and validation
.
Qual Life Res
2004
;
13
:
735
45
. https://doi.org/10.1023/B:QURE.0000021690.84029.a3

92

Uzark
K
,
Jones
K
,
Burwinkle
TM
,
Varni
JW
.
The pediatric quality of life inventory in children with heart disease
.
Prog Ped Cardiol
2003
;
18
:
141
8
. https://doi.org/10.1016/S1058-9813(03)00087-0

93

Marino
BS
,
Shera
D
,
Wernovsky
G
,
Tomlinson
RS
,
Aguirre
A
,
Gallagher
M
, et al.
The development of the pediatric cardiac quality of life inventory: a quality of life measure for children and adolescents with heart disease
.
Qual Life Res
2008
;
17
:
613
26
. https://doi.org/10.1007/s11136-008-9323-8

94

McCrindle
BW
,
Williams
RV
,
Mital
S
,
Clark
BJ
,
Russell
JL
,
Klein
G
, et al.
Physical activity levels in children and adolescents are reduced after the Fontan procedure, independent of exercise capacity, and are associated with lower perceived general health
.
Arch Dis Child
2007
;
92
:
509
14
. https://doi.org/10.1136/adc.2006.105239

95

Macran
S
,
Birks
Y
,
Parsons
J
,
Sloper
P
,
Hardman
G
,
Kind
P
, et al.
The development of a new measure of quality of life for children with congenital cardiac disease
.
Cardiol Young
2006
;
16
:
165
72
. https://doi.org/10.1017/S1047951106000102

96

Mannheimer
B
,
Andersson
B
,
Carlsson
L
,
Währborg
P
.
The validation of a new quality of life questionnaire for patients with congestive heart failure-an extension of the cardiac health profile
.
Scand Cardiovasc J
2007
;
41
:
235
41
. https://doi.org/10.1080/14017430701422454

97

Garin
O
,
Herdman
M
,
Vilagut
G
,
Ferrer
M
,
Ribera
A
,
Rajmil
L
, et al.
Assessing health-related quality of life in patients with heart failure: a systematic, standardized comparison of available measures
.
Heart Fail Rev
2014
;
19
:
359
67
. https://doi.org/10.1007/s10741-013-9394-7

98

van Kessel
P
,
de Boer
D
,
Hendriks
M
,
Plass
AM
.
Measuring patient outcomes in chronic heart failure: psychometric properties of the Care-Related Quality of Life survey for Chronic Heart Failure (CaReQoL CHF)
.
BMC Health Serv Res
2017
;
17
:
536
. https://doi.org/10.1186/s12913-017-2452-4

99

Dunderdale
K
,
Thompson
DR
,
Beer
SF
,
Furze
G
,
Miles
JN
.
Development and validation of a patient-centered health-related quality-of-life measure: the chronic heart failure assessment tool
.
J Cardiovasc Nurs
2008
;
23
:
364
70
. https://doi.org/10.1097/01.JCN.0000317439.82704.e8

100

Kelkar
AA
,
Spertus
J
,
Pang
P
,
Pierson
RF
,
Cody
RJ
,
Pina
IL
, et al.
Utility of patient-reported outcome instruments in heart failure
.
JACC Heart Fail
2016
;
4
:
165
75
. https://doi.org/10.1016/j.jchf.2015.10.015

101

Tian
J
,
Zhao
J
,
Zhang
Q
,
Ren
J
,
Han
L
,
Li
J
, et al.
Assessment of chronic disease self-management in patients with chronic heart failure based on the MCID of patient-reported outcomes by the multilevel model
.
BMC Cardiovasc Disord
2021
;
21
:
58
. https://doi.org/10.1186/s12872-021-01872-3

102

Guyatt
GH
,
Nogradi
S
,
Halcrow
S
,
Singer
J
,
Sullivan
MJ
,
Fallen
EL
.
Development and testing of a new measure of health status for clinical trials in heart failure
.
J Gen Intern Med
1989
;
4
:
101
7
. https://doi.org/10.1007/BF02602348

103

Garin
O
,
Ferrer
M
,
Pont
A
,
Rué
M
,
Kotzeva
A
,
Wiklund
I
, et al.
Disease-specific health-related quality of life questionnaires for heart failure: a systematic review with meta-analyses
.
Qual Life Res
2009
;
18
:
71
85
. https://doi.org/10.1007/s11136-008-9416-4

104

Moshkovich
O
,
Benjamin
K
,
Hall
K
,
Murphy
R
,
von Maltzahn
R
,
Gorsh
B
, et al.
Development of a conceptual model and patient-reported outcome measures for assessing symptoms and functioning in patients with heart failure
.
Qual Life Res
2020
;
29
:
2835
48
. https://doi.org/10.1007/s11136-020-02537-y

105

Grady
KL
,
Jalowiec
A
,
Grusk
BB
,
White-Williams
C
,
Robinson
JA
.
Symptom distress in cardiac transplant candidates
.
Heart Lung
1992
;
21
:
434
9
.

106

Green
CP
,
Porter
CB
,
Bresnahan
DR
,
Spertus
JA
.
Development and evaluation of the Kansas city cardiomyopathy questionnaire: a new health status measure for heart failure
.
J Am Coll Cardiol
2000
;
35
:
1245
55
. https://doi.org/10.1016/S0735-1097(00)00531-3

107

Hisham S
A
,
Hashim
R
,
Putri
W
,
Jamil
N
,
Latiff
A
.
Development & validation of a bilingual psychometric instrument for assessment of knowledge, attitude, self-care practice and health-related quality of life (KAPQHF) among heart failure patients
.
J Cardiovasc Dis Res
2020
;
11
:
04
11
. https://doi.org/10.31838/jcdr.2020.11.04.02

108

O'Leary
CJ
,
Jones
PW
.
The left ventricular dysfunction questionnaire (LVD-36): reliability, validity, and responsiveness
.
Heart
2000
;
83
:
634
40
. https://doi.org/10.1136/heart.83.6.634

109

Fadol
A
,
Mendoza
T
,
Gning
I
,
Kernicki
J
,
Symes
L
,
Cleeland
CS
, et al.
Psychometric testing of the MDASI-HF: a symptom assessment instrument for patients with cancer and concurrent heart failure
.
J Card Fail
2008
;
14
:
497
507
. https://doi.org/10.1016/j.cardfail.2008.01.012

110

Ahmad
FS
,
Kallen
MA
,
Schifferdecker
KE
,
Carluzzo
KL
,
Yount
SE
,
Gelow
JM
, et al.
Development and initial validation of the PROMIS®-plus-HF profile measure
.
Circ Heart Fail
2019
;
12
:
e005751
. https://doi.org/10.1161/CIRCHEARTFAILURE.118.005751

111

Wiklund
I
,
Lindvall
K
,
Swedberg
K
,
Zupkis
RV
.
Self-assessment of quality of life in severe heart failure. An instrument for clinical use
.
Scand J Psychol
1987
;
28
:
220
5
. https://doi.org/10.1111/j.1467-9450.1987.tb00758.x

112

Spertus
JA
,
Jones
PG
.
Development and validation of a short version of the Kansas city cardiomyopathy questionnaire
.
Circ Cardiovasc Qual Outcomes
2015
;
8
:
469
76
. https://doi.org/10.1161/CIRCOUTCOMES.115.001958

113

Fu
TC
,
Lin
YC
,
Chang
CM
,
Chou
WL
,
Yuan
PH
,
Liu
MH
, et al.
Validation of a new simple scale to measure symptoms in heart failure from traditional Chinese medicine view: a cross-sectional questionnaire study
.
BMC Complement Altern Med
2016
;
16
:
342
. https://doi.org/10.1186/s12906-016-1306-7

114

Jalowiec
A
,
Grady
KL
,
White-Williams
C
.
Stressors in patients awaiting a heart transplant
.
Behav Med
1994
;
19
:
145
54
. https://doi.org/10.1080/08964289.1994.9935185

115

Grady
KL
,
Jalowiec
A
,
White-Williams
C
.
Patient compliance at one year and two years after heart transplantation
.
J Heart Lung Transplant
1998
;
17
:
383
94
.

116

de Jeu
JH
,
Pedersen
SS
,
Balk
AH
,
van Domburg
RT
,
Vantrimpont
PJ
,
Erdman
RA
.
Development of the rotterdam quality of life questionnaire for heart transplant recipients
.
Neth Heart J
2003
;
11
:
289
93
.

117

Grady
KL
,
Meyer
P
,
Mattea
A
,
White-Williams
C
,
Ormaza
S
,
Kaan
A
, et al.
Improvement in quality of life outcomes 2 weeks after left ventricular assist device implantation
.
J Heart Lung Transplant
2001
;
20
:
657
69
. https://doi.org/10.1016/S1053-2498(01)00253-4

118

Sandau
KE
,
Lee
CS
,
Faulkner
KM
,
Pozehl
B
,
Eckman
P
,
Garberich
R
, et al.
Health-related quality of life in patients with a left ventricular assist device (QOLVAD) questionnaire: initial psychometrics of a new instrument
.
J Cardiovasc Nurs
2021
;
36
:
172
84
. https://doi.org/10.1097/JCN.0000000000000774

119

Jurgens
CY
,
Fain
JA
,
Riegel
B
.
Psychometric testing of the heart failure somatic awareness scale
.
J Cardiovasc Nurs
2006
;
21
:
95
102
. https://doi.org/10.1097/00005082-200603000-00004

120

Jurgens
CY
,
Lee
CS
,
Riegel
B
.
Psychometric analysis of the heart failure somatic perception scale as a measure of patient symptom perception
.
J Cardiovasc Nurs
2017
;
32
:
140
7
. https://doi.org/10.1097/JCN.0000000000000320

121

Zambroski
CH
,
Moser
DK
,
Bhat
G
,
Ziegler
C
.
Impact of symptom prevalence and symptom burden on quality of life in patients with heart failure
.
Eur J Cardiovasc Nurs
2005
;
4
:
198
206
. https://doi.org/10.1016/j.ejcnurse.2005.03.010

122

Shabetai
R
.
Cardiomyopathy: how far have we come in 25 years, how far yet to go?
J Am Coll Cardiol
1983
;
1
:
252
63
. https://doi.org/10.1016/S0735-1097(83)80026-6

123

Friedman
MM
.
Gender differences in the health related quality of life of older adults with heart failure
.
Heart Lung
2003
;
32
:
320
7
. https://doi.org/10.1016/S0147-9563(03)00098-0

124

Heo
S
,
Moser
DK
,
Pressler
SJ
,
Dunbar
SB
,
Mudd-Martin
G
,
Lennie
TA
.
Psychometric properties of the symptom Status questionnaire-heart failure
.
J Cardiovasc Nurs
2015
;
30
:
136
44
. https://doi.org/10.1097/JCN.0000000000000102

125

Dracup
K
,
Walden
JA
,
Stevenson
LW
,
Brecht
ML
.
Quality of life in patients with advanced heart failure
.
J Heart Lung Transplant
1992
;
11
:
273
9
.

126

Jaarsma
T
,
Strömberg
A
,
Mårtensson
J
,
Dracup
K
.
Development and testing of the European heart failure self-care behaviour scale
.
Eur J Heart Fail
2003
;
5
:
363
70
. https://doi.org/10.1016/S1388-9842(02)00253-2

127

Jaarsma
T
,
Arestedt
KF
,
Mårtensson
J
,
Dracup
K
,
Strömberg
A
.
The European heart failure self-care behaviour scale revised into a nine-item scale (EHFScB-9): a reliable and valid international instrument
.
Eur J Heart Fail
2009
;
11
:
99
105
. https://doi.org/10.1093/eurjhf/hfn007

128

Chen
Y
,
Lu
M
,
Jia
L
.
Psychometric properties of self-reported measures of self-management for chronic heart failure patients: a systematic review
.
Eur J Cardiovasc Nurs
2023
:
zvad028
. https://doi.org/10.1093/eurjcn/zvad028

129

Köberich
S
,
Kato
NP
,
Kugler
C
,
Strömberg
A
,
Jaarsma
T
.
Methodological quality of studies assessing validity and reliability of the European heart failure self-care behaviour scale: a systematic review using the COSMIN methodology
.
Eur J Cardiovasc Nurs
2021
;
20
:
501
12
. https://doi.org/10.1093/eurjcn/zvab018

130

Hattori
Y
,
Taru
C
,
Miyawaki
I
.
Development of an evaluation scale for self-monitoring by patients with heart failure
.
Kobe J Med Sci
2011
;
57
:
E63
74
.

131

Riegel
B
,
Carlson
B
,
Moser
DK
,
Sebern
M
,
Hicks
FD
,
Roland
V
.
Psychometric testing of the self-care of heart failure index
.
J Card Fail
2004
;
10
:
350
60
. https://doi.org/10.1016/j.cardfail.2003.12.001

132

White
ML
,
Schim
SM
.
Development of a spiritual self-care practice scale
.
J Nurs Meas
2013
;
21
:
450
62
. https://doi.org/10.1891/1061-3749.21.3.450

133

Padilha
KM
,
Gallani
MC
,
Colombo
RC
.
Validity of an instrument to measure the impact of valve heart disease on the patient's daily life
.
J Clin Nurs
2007
;
16
:
1285
91
. https://doi.org/10.1111/j.1365-2702.2007.01765.x

134

Frank
D
,
Kennon
S
,
Bonaros
N
,
Romano
M
,
Lefèvre
T
,
Di Mario
C
, et al.
Trial protocol for the validation of the ‘Toronto aortic stenosis quality of life (TASQ) questionnaire’ in patients undergoing surgical aortic valve replacement (SAVR) or transfemoral (TF) transcatheter aortic valve implantation (TAVI): the TASQ registry
.
Open Heart
2019
;
6
:
e001008
. https://doi.org/10.1136/openhrt-2019-001008

135

Rose
MS
,
Koshman
ML
,
Ritchie
D
,
Sheldon
R
.
The development and preliminary validation of a scale measuring the impact of syncope on quality of life
.
Europace
2009
;
11
:
1369
74
. https://doi.org/10.1093/europace/eup106

136

Kaufmann
H
,
Malamut
R
,
Norcliffe-Kaufmann
L
,
Rosa
K
,
Freeman
R
.
The orthostatic hypotension questionnaire (OHQ): validation of a novel symptom assessment scale
.
Clin Auton Res
2012
;
22
:
79
90
. https://doi.org/10.1007/s10286-011-0146-2

137

Wan
C
,
Jiang
R
,
Tu
XM
,
Tang
W
,
Pan
J
,
Yang
R
, et al.
The hypertension scale of the system of quality of life instruments for chronic diseases, QLICD-HY: a development and validation study
.
Int J Nurs Stud
2012
;
49
:
465
80
. https://doi.org/10.1016/j.ijnurstu.2011.10.010

138

Kim
MT
,
Hill
MN
,
Bone
LR
,
Levine
DM
.
Development and testing of the hill-bone compliance to high blood pressure therapy scale
.
Prog Cardiovasc Nurs
2000
;
15
:
90
6
. https://doi.org/10.1111/j.1751-7117.2000.tb00211.x

139

Tegegn
HG
,
Wark
S
,
Tursan d'Espaignet
E
,
Spark
MJ
.
Measurement properties of patient-reported outcome measures for medication adherence in cardiovascular disease: a COSMIN systematic review
.
Clin Drug Investig
2022
;
42
:
879
908
. https://doi.org/10.1007/s40261-022-01199-7

140

Ma
C
,
Chen
S
,
You
L
,
Luo
Z
,
Xing
C
.
Development and psychometric evaluation of the treatment adherence questionnaire for patients with hypertension
.
J Adv Nurs
2012
;
68
:
1402
13
. https://doi.org/10.1111/j.1365-2648.2011.05835.x

141

He
W
,
Bonner
A
,
Anderson
D
.
Patient reported adherence to hypertension treatment: a revalidation study
.
Eur J Cardiovasc Nurs
2016
;
15
:
150
6
. https://doi.org/10.1177/1474515115603902

142

Han
HR
,
Lee
H
,
Commodore-Mensah
Y
,
Kim
M
.
Development and validation of the hypertension self-care profile: a practical tool to measure hypertension self-care
.
J Cardiovasc Nurs
2014
;
29
:
E11
20
. https://doi.org/10.1097/JCN.0b013e3182a3fd46

143

Alguren
B
,
Coenen
M
,
Malm
D
,
Fridlund
B
,
Martensson
J
,
Arestedt
K
, et al.
A scoping review and mapping exercise comparing the content of patient-reported outcome measures (PROMs) across heart disease-specific scales
.
J Patient Rep Outcomes
2020
;
4
:
7
. https://doi.org/10.1186/s41687-019-0165-7

144

Subramanian
M
,
Kozower
BD
,
Brown
LM
,
Khullar
OV
,
Fernandez
FG
.
Patient-reported outcomes in cardiothoracic surgery
.
Ann Thorac Surg
2019
;
107
:
294
301
. https://doi.org/10.1016/j.athoracsur.2018.06.005

145

Thompson
LE
,
Bekelman
DB
,
Allen
LA
,
Peterson
PN
.
Patient-reported outcomes in heart failure: existing measures and future uses
.
Curr Heart Fail Rep
2015
;
12
:
236
46
. https://doi.org/10.1007/s11897-015-0253-9

146

Zack
R
,
Okunade
O
,
Olson
E
,
Salt
M
,
Amodeo
C
,
Anchala
R
, et al.
Improving hypertension outcome measurement in low- and middle-income countries
.
Hypertension
2019
;
73
:
990
7
. https://doi.org/10.1161/HYPERTENSIONAHA.118.11916

147

Seligman
WH
,
Das-Gupta
Z
,
Jobi-Odeneye
AO
,
Arbelo
E
,
Banerjee
A
,
Bollmann
A
, et al.
Development of an international standard set of outcome measures for patients with atrial fibrillation: a report of the International Consortium for Health Outcomes Measurement (ICHOM) atrial fibrillation working group
.
Eur Heart J
2020
;
41
:
1132
40
. https://doi.org/10.1093/eurheartj/ehz871

148

Hummel
K
,
Whittaker
S
,
Sillett
N
,
Basken
A
,
Berghammer
M
,
Chalela
T
, et al.
Development of an international standard set of clinical and patient-reported outcomes for children and adults with congenital heart disease: a report from the international consortium for health outcomes measurement congenital heart disease working group
.
Eur Heart J Qual Care Clin Outcomes
2021
;
7
:
354
65
. https://doi.org/10.1093/ehjqcco/qcab009

149

McNamara
RL
,
Spatz
ES
,
Kelley
TA
,
Stowell
CJ
,
Beltrame
J
,
Heidenreich
P
, et al.
Standardized outcome measurement for patients with coronary artery disease: consensus from the International Consortium for Health Outcomes Measurement (ICHOM)
.
J Am Heart Assoc
2015
;
4
:
e001767
. https://doi.org/10.1161/JAHA.115.001767

150

Burns
DJP
,
Arora
J
,
Okunade
O
,
Beltrame
JF
,
Bernardez-Pereira
S
,
Crespo-Leiro
MG
, et al.
International consortium for health outcomes measurement (ICHOM): standardized patient-centered outcomes measurement set for heart failure patients
.
JACC Heart Fail
2020
;
8
:
212
22
. https://doi.org/10.1016/j.jchf.2019.09.007

151

Kirkham
JJ
,
Gorst
S
,
Altman
DG
,
Blazeby
JM
,
Clarke
M
,
Devane
D
, et al.
Core outcome set-STAndards for reporting: the COS-STAR statement
.
PLoS Med
2016
;
13
:
e1002148
. https://doi.org/10.1371/journal.pmed.1002148

152

Valderas
JM
,
Ferrer
M
,
Mendívil
J
,
Garin
O
,
Rajmil
L
,
Herdman
M
, et al.
Development of EMPRO: a tool for the standardized assessment of patient-reported outcome measures
.
Value Health
2008
;
11
:
700
8
. https://doi.org/10.1111/j.1524-4733.2007.00309.x

153

Garin
O
,
García-Forero
C
,
Vilagut
G
,
Pardo
Y
,
Alayo
I
,
Oriol Zerbe
C
, et al.
PRM217—the online version of EMPRO: a new platform system for the standardized appraisal of PRO instruments
.
Value Health
2018
;
21
:
S393
. https://doi.org/10.1016/j.jval.2018.09.2335

154

Mokkink
LB
,
Terwee
CB
,
Patrick
DL
,
Alonso
J
,
Stratford
PW
,
Knol
DL
, et al.
The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes
.
J Clin Epidemiol
2010
;
63
:
737
45
. https://doi.org/10.1016/j.jclinepi.2010.02.006

155

Mokkink
LB
,
Terwee
CB
,
Knol
DL
,
Stratford
PW
,
Alonso
J
,
Patrick
DL
, et al.
The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content
.
BMC Med Res Methodol
2010
;
10
:
22
. https://doi.org/10.1186/1471-2288-10-22

156

Mokkink
LB
,
de Vet
HCW
,
Prinsen
CAC
,
Patrick
DL
,
Alonso
J
,
Bouter
LM
, et al.
COSMIN Risk of bias checklist for systematic reviews of patient-reported outcome measures
.
Qual Life Res
2018
;
27
:
1171
9
. https://doi.org/10.1007/s11136-017-1765-4

157

Kyte
D
,
Draper
H
,
Calvert
M
.
Patient-reported outcome alerts: ethical and logistical considerations in clinical trials
.
JAMA
2013
;
310
:
1229
30
. https://doi.org/10.1001/jama.2013.277222

158

Cruz Rivera
S
,
Aiyegbusi
OL
,
Ives
J
,
Draper
H
,
Mercieca-Bebber
R
,
Ells
C
, et al.
Ethical considerations for the inclusion of patient-reported outcomes in clinical research: the PRO ethics guidelines
.
JAMA
2022
;
327
:
1910
9
. https://doi.org/10.1001/jama.2022.6421

159

Marcus
A
.
Pay up or retract? Survey creator's demands for money rile some health researchers
.
Science
2017
;
15
:
169
82
. https://doi.org/10.1126/science.aap9445

160

Comins
JD
,
Brodersen
J
,
Siersma
V
,
Jensen
J
,
Hansen
CF
,
Krogsgaard
MR
.
Choosing the most appropriate PROM for clinical studies in sports medicine
.
Scand J Med Sci Sports
2021
;
31
:
1209
15
. https://doi.org/10.1111/sms.13906

161

Comins
JD
,
Brodersen
J
,
Siersma
V
,
Jensen
J
,
Hansen
CF
,
Krogsgaard
MR
.
How to develop a condition-specific PROM
.
Scand J Med Sci Sports
2021
;
31
:
1216
24
. https://doi.org/10.1111/sms.13868

162

Gagnier
JJ
,
Lai
J
,
Mokkink
LB
,
Terwee
CB
.
COSMIN Reporting guideline for studies on measurement properties of patient-reported outcome measures
.
Qual Life Res
2021
;
30
:
2197
218
. https://doi.org/10.1007/s11136-021-02822-4

163

Wohlfahrt
P
,
Stehlik
J
,
Pan
IZ
,
Ryan
JJ
.
Empowering people living with heart failure
.
Heart Fail Clin
2020
;
16
:
409
20
. https://doi.org/10.1016/j.hfc.2020.06.002

164

Snyder
CF
,
Aaronson
NK
,
Choucair
AK
,
Elliott
TE
,
Greenhalgh
J
,
Halyard
MY
, et al.
Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations
.
Qual Life Res
2012
;
21
:
1305
14
. https://doi.org/10.1007/s11136-011-0054-x

165

Howell
D
,
Molloy
S
,
Wilkinson
K
,
Green
E
,
Orchard
K
,
Wang
K
, et al.
Patient-reported outcomes in routine cancer clinical practice: a scoping review of use, impact on health outcomes, and implementation factors
.
Ann Oncol
2015
;
26
:
1846
58
. https://doi.org/10.1093/annonc/mdv181

166

Stover
A
,
Irwin
DE
,
Chen
RC
,
Chera
BS
,
Mayer
DK
,
Muss
HB
, et al.
Integrating patient-reported outcome measures into routine cancer care: cancer patients’ and clinicians’ perceptions of acceptability and value
.
EGEMS (Wash DC)
2015
;
3
:
1169
. https://doi.org/10.13063/2327-9214.1169

167

Bartlett
SJ
,
De Leon
E
,
Orbai
AM
,
Haque
UJ
,
Manno
RL
,
Ruffing
V
, et al.
Patient-reported outcomes in RA care improve patient communication, decision-making, satisfaction and confidence: qualitative results
.
Rheumatology
2020
;
59
:
1662
70
. https://doi.org/10.1093/rheumatology/kez506

168

Subash
M
,
Liu
LH
,
DeQuattro
K
,
Choden
S
,
Jacobsohn
L
,
Katz
P
, et al.
The development of the rheumatology informatics system for effectiveness learning collaborative for improving patient-reported outcome collection and patient-centered communication in adult rheumatology
.
ACR Open Rheumatol
2021
;
3
:
690
8
. https://doi.org/10.1002/acr2.11310

169

Hamilton
DF
,
Giesinger
JM
,
Giesinger
K
.
Technological developments enable measuring and using patient-reported outcomes data in orthopaedic clinical practice
.
World J Orthop
2020
;
11
:
584
94
. https://doi.org/10.5312/wjo.v11.i12.584

170

Tew
M
,
Dalziel
K
,
Clarke
P
,
Smith
A
,
Choong
PF
,
Dowsey
M
.
Patient-reported outcome measures (PROMs): can they be used to guide patient-centered care and optimize outcomes in total knee replacement?
Qual Life Res
2020
;
29
:
3273
83
. https://doi.org/10.1007/s11136-020-02577-4

171

Gallagher
AM
,
Lucas
R
,
Cowie
MR
.
Assessing health-related quality of life in heart failure patients attending an outpatient clinic: a pragmatic approach
.
ESC Heart Fail
2019
;
6
:
3
9
. https://doi.org/10.1002/ehf2.12363

172

Wohlfahrt
P
,
Zickmund
SL
,
Slager
S
,
Allen
LA
,
Nicolau
JN
,
Kfoury
AG
, et al.
Provider perspectives on the feasibility and utility of routine patient-reported outcomes assessment in heart failure: a qualitative analysis
.
J Am Heart Assoc
2020
;
9
:
e013047
. https://doi.org/10.1161/JAHA.119.013047

173

Sandhu
AT
,
Zheng
J
,
Kalwani
NM
,
Gupta
A
,
Calma
J
,
Skye
M
, et al.
Impact of patient-reported outcome measurement in heart failure clinic on clinician health Status assessment and patient experience: a substudy of the PRO-HF trial
.
Circ Heart Fail
2023
;
16
:
e010280
. https://doi.org/10.1161/CIRCHEARTFAILURE.122.010280

174

Salzwedel
A
,
Koran
I
,
Langheim
E
,
Schlitt
A
,
Nothroff
J
,
Bongarth
C
, et al.
Patient-reported outcomes predict return to work and health-related quality of life six months after cardiac rehabilitation: results from a German multi-centre registry (OutCaRe)
.
PLoS One
2020
;
15
:
e0232752
. https://doi.org/10.1371/journal.pone.0232752

175

Boyce
MB
,
Browne
JP
.
Does providing feedback on patient-reported outcomes to healthcare professionals result in better outcomes for patients? A systematic review
.
Qual Life Res
2013
;
22
:
2265
78
. https://doi.org/10.1007/s11136-013-0390-0

176

International Society for Quality of Life Research (prepared by Aaronson N ET, Greenhalgh J, Halyard M, Hess R, Miller D, Reeve B, Santana M, Snyder C). User’s Guide to Implementing Patient-Reported Outcomes Assessment in Clinical Practice, version 2 (January 2015)
.
2015
.

177

Liu
LH
,
Garrett
SB
,
Li
J
,
Ragouzeos
D
,
Berrean
B
,
Dohan
D
, et al.
Patient and clinician perspectives on a patient-facing dashboard that visualizes patient reported outcomes in rheumatoid arthritis
.
Health Expect
2020
;
23
:
846
59
. https://doi.org/10.1111/hex.13057

178

Tolbert
E
,
Brundage
M
,
Bantug
E
,
Blackford
AL
,
Smith
K
,
Snyder
C
.
Picture this: presenting longitudinal patient-reported outcome research study results to patients
.
Med Decis Making
2018
;
38
:
994
1005
. https://doi.org/10.1177/0272989X18791177

179

Turchioe M
R
,
Grossman
LV
,
Myers
AC
,
Baik
D
,
Goyal
P
,
Masterson Creber
RM
.
Visual analogies, not graphs, increase patients’ comprehension of changes in their health status
.
J Am Med Inform Assoc
2020
;
27
:
677
89
. https://doi.org/10.1093/jamia/ocz217

180

Porter
ME
.
A strategy for health care reform–toward a value-based system
.
N Engl J Med
2009
;
361
:
109
12
. https://doi.org/10.1056/NEJMp0904131

181

Schiele
F
,
Aktaa
S
,
Rossello
X
,
Ahrens
I
,
Claeys
MJ
,
Collet
JP
, et al.
2020 Update of the quality indicators for acute myocardial infarction: a position paper of the association for acute cardiovascular care: the study group for quality indicators from the ACVC and the NSTE-ACS guideline group
.
Eur Heart J Acute Cardiovasc Care
2021
;
10
:
224
33
. https://doi.org/10.1093/ehjacc/zuaa037

182

Aktaa
S
,
Gencer
B
,
Arbelo
E
,
Davos
CH
,
Désormais
I
,
Hollander
M
, et al.
European Society of cardiology quality indicators for cardiovascular disease prevention: developed by the working group for cardiovascular disease prevention quality indicators in collaboration with the European association for preventive cardiology of the European society of cardiology
.
Eur J Prev Cardiol
2022
;
29
:
1060
71
. https://doi.org/10.1093/eurjpc/zwab160

183

Tran
AT
,
Fonarow
GC
,
Arnold
SV
,
Jones
PG
,
Thomas
LE
,
Hill
CL
, et al.
Risk adjustment model for preserved health Status in patients with heart failure and reduced ejection fraction: the CHAMP-HF registry
.
Circ Cardiovasc Qual Outcomes
2021
;
14
:
e008072
. https://doi.org/10.1161/CIRCOUTCOMES.121.008072

184

Nelson
EC
,
Dixon-Woods
M
,
Batalden
PB
,
Homa
K
,
Van Citters
AD
,
Morgan
TS
, et al.
Patient focused registries can improve health, care, and science
.
BMJ
2016
;
354
:
i3319
. https://doi.org/10.1136/bmj.i3319

185

Aktaa
S
,
Batra
G
,
Cleland
JGF
,
Coats
A
,
Lund
LH
,
McDonagh
T
, et al.
Data standards for heart failure: the European unified registries for heart care evaluation and randomized trials (EuroHeart)
.
Eur Heart J
2022
;
43
:
2185
95
. https://doi.org/10.1093/eurheartj/ehac151

186

Aktaa
S
,
Batra
G
,
James
SK
,
Blackman
DJ
,
Ludman
PF
,
Mamas
MA
, et al.
Data standards for transcatheter aortic valve implantation: the European unified registries for heart care evaluation and randomised trials (EuroHeart)
.
Eur Heart J Qual Care Clin Outcomes
2022
:
qcac063
. https://doi.org/10.1093/ehjqcco/qcac063

187

Anderson
RB
,
Testa
MA
.
Symptom distress checklists as a component of quality of life measurement: comparing prompted reports by patient and physician with concurrent adverse event reports via the physician
.
Drug Inf J
1994
;
28
:
89
114
. https://doi.org/10.1177/009286159402800112

188

Scoggins
JF
,
Patrick
DL
.
The use of patient-reported outcomes instruments in registered clinical trials: evidence from ClinicalTrials.gov
.
Contemp Clin Trials
2009
;
30
:
289
92
. https://doi.org/10.1016/j.cct.2009.02.005

189

Vodicka
E
,
Kim
K
,
Devine
EB
,
Gnanasakthy
A
,
Scoggins
JF
,
Patrick
DL
.
Inclusion of patient-reported outcome measures in registered clinical trials: evidence from ClinicalTrials.gov (2007–2013)
.
Contemp Clin Trials
2015
;
43
:
1
9
. https://doi.org/10.1016/j.cct.2015.04.004

190

Mercieca-Bebber
R
,
King
MT
,
Calvert
MJ
,
Stockler
MR
,
Friedlander
M
.
The importance of patient-reported outcomes in clinical trials and strategies for future optimization
.
Patient Relat Outcome Meas
2018
;
9
:
353
67
. https://doi.org/10.2147/PROM.S156279

191

Warsame
R
,
D’Souza
A
.
Patient reported outcomes have arrived: a practical overview for clinicians in using patient reported outcomes in oncology
.
Mayo Clin Proc
2019
;
94
:
2291
301
. https://doi.org/10.1016/j.mayocp.2019.04.005

192

Crossnohere
NL
,
Brundage
M
,
Calvert
MJ
,
King
M
,
Reeve
BB
,
Thorner
E
, et al.
International guidance on the selection of patient-reported outcome measures in clinical trials: a review
.
Qual Life Res
2021
;
30
:
21
40
. https://doi.org/10.1007/s11136-020-02625-z

193

Calvert
M
,
Kyte
D
,
Mercieca-Bebber
R
,
Slade
A
,
Chan
AW
,
King
MT
, et al.
Guidelines for inclusion of patient-reported outcomes in clinical trial protocols the SPIRIT-PRO extension
.
JAMA
2018
;
319
:
483
94
. https://doi.org/10.1001/jama.2017.21903

194

Calvert
M
,
Blazeby
J
,
Altman
DG
,
Revicki
DA
,
Moher
D
,
Brundage
MD
.
Reporting of patient-reported outcomes in randomized trials: the CONSORT PRO extension
.
Jama
2013
;
309
:
814
22
. https://doi.org/10.1001/jama.2013.879

195

Kuehn
CM
.
A proposed framework for patient-focused policy at the U. S. Food and Drug Administration
.
Biomedicines
2019
;
7
:
64
. https://doi.org/10.3390/biomedicines7030064

196

US Department of Health and Human Service Food and Drug Administration
.
Treatment for Heart Failure: Endpoints for Drug Development: Guidance for Industry. Silver Spring, MD: Food and Drug Administration
;
2019
.

197

European Medicines Agency
.
Guideline on Clinical Investigation of Medicinal Products for the Treatment of Acute Heart Failure (CPMP/EWP/2986/03 Rev. 1)
.
London, UK
:
European Medicines Agency
;
2015
. p
15
.

198

European Medicines Agency
.
Guideline on Clinical Investigation of Medicinal Products for the Treatment of Chronic Heart Failure (CPMP/EWP/235/95, Rev.2)
.
London, UK
:
European Medicines Agency
;
2017
,
15
.

199

Regulation (EU) 2017/745 of the European Parliament and of the council of 5 April 2017 on medical devices, amending Directive 2001/83/EC, Regulation (EC) No 178/2002 and Regulation (EC) No 1223/2009 and repealing Council Directives 90/385/EEC and 93/42/EEC. In: Official Journal of the European Union, (ed). Brussel: European Parliament and of the Council of the European Union; 2017, 1–175
.

200

Fraser
AG
,
Byrne
RA
,
Kautzner
J
,
Butchart
EG
,
Szymański
P
,
Leggeri
I
, et al.
Implementing the new European regulations on medical devices-clinical responsibilities for evidence-based practice: a report from the regulatory affairs committee of the European society of cardiology
.
Eur Heart J
2020
;
41
:
2589
96
. https://doi.org/10.1093/eurheartj/ehaa382

201

US Department of Health and Human Service Food and Drug Administration
.
Principles for Selecting, Developing, Modifying, and Adapting Patient-Reported Outcome Instruments for Use in Medical Device Evaluation. Draft Guidance for Industry and Food and Drug Administration Staff, and Other Stakeholders. Silver Spring, MD: Food and Drug Administration; 2020
.

202

Ciani
O
,
Federici
CB
.
Value lies in the eye of the patients: the why, what, and how of patient-reported outcomes measures
.
Clin Ther
2020
;
42
:
25
33
. https://doi.org/10.1016/j.clinthera.2019.11.016

203

Weszl
M
,
Rencz
F
,
Brodszky
V
.
Is the trend of increasing use of patient-reported outcome measures in medical device studies the sign of shift towards value-based purchasing in Europe?
Eur J Health Econ
2019
;
20
:
133
40
. https://doi.org/10.1007/s10198-019-01070-1

204

Wasson
JH
,
Sox
HC
,
Miller
HD
.
Aligning payments, services, and quality in primary care
.
JAMA
2021
;
326
:
805
6
. https://doi.org/10.1001/jama.2021.12775

205

Roland
M
.
Linking physicians’ pay to the quality of care–a major experiment in the United Kingdom
.
N Engl J Med
2004
;
351
:
1448
54
. https://doi.org/10.1056/NEJMhpr041294

206

Schlesinger
M
,
Grob
R
,
Shaller
D
.
Using patient-reported information to improve clinical practice
.
Health Serv Res
2015
;
50
:
2116
54
. https://doi.org/10.1111/1475-6773.12420

207

Drummond
M
,
Torbica
A
,
Tarricone
R
.
Should health technology assessment be more patient centric? If so, how?
Eur J Health Econ
2020
;
21
:
1117
20
. https://doi.org/10.1007/s10198-020-01182-z

208

(EUnetHTA) ENfHTA
.
Endpoints Used for Relative Effectiveness Assessment: Clinical Endpoints
.
Diemen, The Netherlands
:
EUnetHTA
;
2015
.

209

Brazier
JE
,
Rowen
D
,
Lloyd
A
,
Karimi
M
.
Future directions in valuing benefits for estimating QALYs: is time up for the EQ-5D?
Value Health
2019
;
22
:
62
8
. https://doi.org/10.1016/j.jval.2018.12.001

210

Barnieh
L
,
Manns
B
,
Harris
A
,
Blom
M
,
Donaldson
C
,
Klarenbach
S
, et al.
A synthesis of drug reimbursement decision-making processes in organisation for economic co-operation and development countries
.
Value Health
2014
;
17
:
98
108
. https://doi.org/10.1016/j.jval.2013.10.008

211

Torbica
A
,
Fornaro
G
,
Tarricone
R
,
Drummond
MF
.
Do social values and institutional context shape the use of economic evaluation in reimbursement decisions? An empirical analysis
.
Value Health
2020
;
23
:
17
24
. https://doi.org/10.1016/j.jval.2019.11.001

212

Marquis-Gravel
G
,
Roe
MT
,
Turakhia
MP
,
Boden
W
,
Temple
R
,
Sharma
A
, et al.
Technology-enabled clinical trials: transforming medical evidence generation
.
Circulation
2019
;
140
:
1426
36
. https://doi.org/10.1161/CIRCULATIONAHA.119.040798

213

Ahmed
S
,
Ware
P
,
Gardner
W
,
Witter
J
,
Bingham
CO
,
Kairy
D
, et al.
Montreal Accord on patient-reported outcomes (PROs) use series—paper 8: patient-reported outcomes in electronic health records can inform clinical and policy decisions
.
J Clin Epidemiol
2017
;
89
:
160
7
. https://doi.org/10.1016/j.jclinepi.2017.04.011

214

Snyder
C
,
Wu
AW
.
Users’ guide to integrating patient-reported outcomes in electronic health records
.
Baltimore, MD
:
Johns Hopkins University
;
2017
.

215

National Quality Forum
.
Building a Roadmap from Patient-Reported Outcome Measures to Patient-Reported Outcome Performance Measures—Technical Guidance, updated Final Draft
.
Washington DC
:
National Quality Forum
;
2022
.

216

Greenhalgh
J
,
Gooding
K
,
Gibbons
E
,
Dalkin
S
,
Wright
J
,
Valderas
J
, et al.
How do patient reported outcome measures (PROMs) support clinician-patient communication and patient care? A realist synthesis
.
J Patient Rep Outcomes
2018
;
2
:
42
. https://doi.org/10.1186/s41687-018-0061-6

217

Norman
C
.
Ehealth literacy 2.0: problems and opportunities with an evolving concept
.
J Med Internet Res
2011
;
13
:
e125
. https://doi.org/10.2196/jmir.2035

218

European Commission
.
Health Technology and Cosmetics. Clinical Evaluation: A Guide for Manufacturers and Notified Bodies Under Directives 93/42/EEC and 90/385/EEC (MEDDEV 2.7/1 Revision 4)
.
Brussels
:
European Commission
;
2016
.

219

International Standardization Organization
.
Clinical Investigation of Medical Devices for Human Subjects—Good Clinical Practice (ISO 14155)
.
Geneva, Switzerland
:
International Standardization Organization
;
2020
.

This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://dbpia.nl.go.kr/pages/standard-publication-reuse-rights)