The prevalence of chronic conditions and multimorbidity is rising worldwide [1, 2]. This growth has placed increasing demands on existing acute-oriented healthcare systems and has resulted in poor quality of care and deficient patient experiences as a consequence of the fragmentation and lack of coordination in the organisation and delivery of care for people living with chronic diseases .
Although many advances have been made in the treatment available to chronically ill patients, most patients are multimorbid with diverse clusters of chronic diseases, and current or potential complex health and social care needs. Management of these needs requires integral and proactive action and, in many cases, these complex patients do not receive the care recommended by evidence-based clinical practice guidelines .
Furthermore, there is also a lack of patients’ involvement and collaboration in the design and co-creation of health services, especially for those with chronic illnesses. As a consequence, the delivery of effective, high-quality chronic care requires a systemic transformation  that goes beyond merely adding new isolated interventions to the existing acute-focused healthcare system . It requires patient engagement, widespread use of quality improvement methods and innovations in chronic care.
Two decades ago, Wagner et al. developed the Chronic Care Model , a framework for delivering care to patients with chronic conditions and for guiding quality improvement in chronic care. This model is focused on providing proactive, planned, integrated and patient-centred care. There is evidence that the Chronic Care Model improves clinical outcomes and experiences of chronically ill patients receiving care [8, 9, 10].
Cramm and collaborators have demonstrated that, over time, quality of care and changes therein translate into more positive experiences for patients with chronic conditions . Therefore, patient experience can, if appropriately measured, indicate the quality of chronic illness care and can provide important information to improve quality of care, patient safety and clinical effectiveness .
Consistent with the Chronic Care Model, Glasgow et al.  developed the Patient Assessment of Chronic Illness Care scale (PACIC) to assess patient experience with chronic care delivery. This scale has been used internationally among patients with a variety of chronic health conditions, and has been adapted and validated in many countries. In a systematic review, Vrijhoef et al  identified it as the most applicable and relevant questionnaire for measuring the quality of integrated chronic care from the patient’s perspective. Recently, Singer et al [15, 16] developed the Patient Perceptions of Integrated Care survey (PPIC), assessing a six-dimension model of integrated care. PACIC and PPIC focus on the experience between patients and the doctors and nurses who regularly provide their care. These instruments do not incorporate elements related to ICT developments in chronic care and do not directly assess the coordination between health care and social care providers.
Many new integrated care models are built to incorporate a patient’s narrative of needs, preferences and expectations [17, 18], acknowledging the essential role they have in their own care and the need for truly patient-centred care . However, there is a dearth of accepted metrics .
Our group previously developed IEMAC-ARCHO, a self-assessment tool of readiness for chronicity in healthcare organisations [21, 22]. Subsequently, the need to develop an instrument to assess patient experience of chronic integrated care was identified for the following reasons:
Therefore, the purpose of this paper is to describe the process of development and validation of a new tool to measure self-reported patient experience of integrated chronic care.
This is a design and validation study of a new instrument to assess the experience of patients with chronic conditions, who, because of their health status, have continuous interactions with social and health care professionals and services. The new tool is theoretically based on the Chronic Care Model and is inspired by patient-centred integrated care approaches.
The tool is intended to be used routinely to assess the patients experience of chronic illness care. For this reason, the following characteristics have been prioritised in its design : small size (affordable), focused on the areas which patients consider important (appropriate), elements that support the processes of transformation and attention to chronicity (sensitive), orientation to what happens during the interaction with professionals (relevant), easy to understand (simple), a limited selection of elements (feasibility), suitable in any context (adaptable), and well-founded to ensure its psychometric properties (valid and reliable).
In this study, patient experience is defined as the information that the person facilitates on what has happened (to her) in her continued interaction with the health and social care professionals and services and on how she has lived that interaction and its outcomes. Meanwhile integrated care was conceptualised according to the Chronic Care Model and its subsequent adaptation by the WHO [3, 7].
The steps followed in this study are shown in Figure 1.
The literature was reviewed to identify existing tools and their characteristics to evaluate patient experience with integrated chronic care. A scoping review was carried out using MEDLINE and Web-of-Knowledge. Only studies in English or Spanish published in the last ten years (until January 2015) were included considering the availability of a previous high quality systematic review conducted by Vrijhoef et al . “Patient Experience” and “Patient Perceptions” with “Integrated Care” or “Chronic Care” were used as search terms. References from retrieved articles were examined to locate further studies. A total of 58 articles were found, their abstracts were revised and 18 of them were fully reviewed and incorporated as relevant sources of information. The results were initially analysed, structured and made available to all members of the research team.
Based on the previous results, the research team developed, by consensus, a pool of 28 reactive items. This set included a minimum of two items for each characteristic of care identified as relevant. Items were elaborated by the research team in successive work-team sessions considering: patient experience dimensions identified in the literature, as well as IEMAC/ARCHO [21, 22] dimensions and interventions.
An expert panel was carried out from September to November 2014 using an online survey involving 15 professionals from primary care, public health, social services, management, quality and safety boards and research institutions. The selection of the participants was based on their knowledge and expertise, each having at least 15 years of experience in clinical or managerial positions. They were recruited by personal contact.
Experts evaluated: content validity (redundancies, absences, misleading questions), face validity (understanding, friendliness, adequacy, ordinal structure), relevance to justify items’ inclusion, adequacy of the type of response scale and the instrument as a whole. The results of their answers prompted some changes in the reactive items to be explored in this new instrument.
Two pilot groups, each of 18 patients with chronic conditions, were conducted in December 2014. Patients were recruited through patient organisations for a variety of health conditions and had different characteristics (age, gender, socioeconomic). These patients evaluated the 28 reactive items of the questionnaire, regarding appropriateness, readability, acceptability and necessary time of response for each item, as well as two possible types of response scales. These patients considered the comprehension of this 28-item questionnaire as very good (4.8/5) as well as appropriate (4.6/5). The average time of response was 15 minutes. As a result, the wording of seven items was modified to improve understanding.
To establish the psychometric properties of the instrument and select those items with the best behaviour, a field study was performed in April-May 2015 with the participation of 350 patients (sample size calculated for a p=q=0.50, 5% error and a level of significance for two queues of 0.05). These were patients older than 16 years of age, with at least one chronic disease, who visited general medicine or nursing consultants at 11 primary care centres of four regional health services in Spain (Catalonia, Madrid, Basque Country and Valencia). Among those who met the inclusion criteria, patients were recruited by the interviewer by random systematic cluster sampling with proportional allocation (K=3). The questionnaire was self-administered, and only at the request of the patient, applied by means of a personal interview. Patients interviewed were informed of the purpose of the study and informed consent was obtained. The demographic and clinical variables of the study were collected in a booklet of data collection (BDC) designed for this study. The interviewers received a briefing on the selection procedure of the patients to be interviewed and on the correct application of the questionnaire. Twelve patients declined to answer.
In the analysis, the ceiling-floor effects and the correlation of each item with the scale total score were considered, where values above 0.30 were acceptable . To establish the construct validity, a preliminary study to determine the unidimensionality of the factors was conducted through the use of an exploratory factorial analysis (EFA) using principal components, with Varimax rotation of the resulting array. To remove factors, criteria were applied using Eigenvalues equal to 1 (calculating previously the statisticians Kaiser-Meyer-Olkin and the Bartlett’s test to determine the appropriateness of performed EFA). Factorial loads higher than 0.50 were considered as acceptable . The internal consistency reliability of a first version of the instrument was calculated using the statistical Cronbach’s Alpha, assuming acceptable values equal to or greater than 0.70 [32, 33].
Subsequently, a confirmatory factorial analysis (CFA) was carried out, using all data and a random selection (N=115) of data from patients receiving health care in different health services, to confirm the hypotheses concerning the underlying structure generated by the exploratory factorial analysis and to rate the ‘goodness of fit’. This analysis was performed using the three-factor model that was derived from EFA to verify that the isolated factors finally had not changed their structure and that statistics employed in the exploratory analysis remained satisfactory. To check the measurement model validity, the standardized root mean square residual (SRMR), the Jöreskog-Sörbom goodness of fit index (GFI), the normed fix index (NFI), and the comparative fix index (CFI) were used. Pearson correlations between factors were also calculated to check the factors’ independence.
The quality criteria for measurement properties of health status instruments proposed by Terwee et al.  were considered to assess the acceptability of the questionnaire’s elements.
The ability of the questionnaire to discriminate between isolated dimensions was tested by performing t-test, ANOVA or Chi-Square, because differences in scores were expected based on differences in care delivery.
The protocol of the study was approved by the Ethics Committee of the University Miguel Hernández, the institution who coordinated the study, and the Madrid Health Service Research Central Commission.
Three hundred thirty-eight patients responded to the questionnaire (response rate 96.6%). Table 1 depicts their characteristics.
|Age (mean, SD)||66.5||14.1|
|Patients living alone||83||24.6|
|Prescribed drugs (mean, SD)||4.1||3.8|
|Prescribed drugs grouped|
|Who manages the medication|
|The patient’s partner, another family member or caregiver||32||9.5|
|Disorders (a patient may suffer from more than one)|
|Other cardiovascular diseases||97||28.7|
|Months from the diagnosis|
|Diabetes (mean, SD)||144.6||147.4|
|Arterial hypertension (mean, SD)||114.8||126.0|
|COPD (mean, SD)||116.9||137.0|
|Other cardiovascular diseases (mean, SD)||89.6||78.0|
|No hospitalisation in the last three years||197||58.3|
|No hospitalisation in the last year||253||74.9|
|No emergency visit in the last year||190||56.2|
|No general practitioner appointment in the last year||6||1.8|
|Hospitalisation in the last three years (mean, SD)||0.7||1.1|
|Hospitalisation in the last year (mean, SD)||0.3||0.6|
|Emergency visits in the last year (mean, SD)||0.9||1.8|
|General practitioner’ appointments last year (mean, SD)||7.4||11.5|
Seven items were ruled out for their ceiling-floor effects. The remaining 21 were included in the subsequent analysis, after verifying that there was acceptable variability in the answers of the patients.
The values of the Alpha of Cronbach were calculated by eliminating each item in an individualised way. No items were ruled out considering these data. The values of the correlations item-total ranged between 0.18 and 0.61. Three items with correlations inferior to 0.30 were ruled out before applying the technique of the exploratory factorial analysis.
A first factorial solution, with 15 items, joined together in five first order factors, with a principal factor explaining the 51.6% of the variance, and four items with significant saturations in more than one factor. In the following exploratory factorial analysis, 11 items were included, each with factorial saturations higher than 0.5 and commonalities between 0.43 and 0.70. This factorial solution converged in three factors, explaining the 57.5% of the common variance (Table 2). Based on our observation, Factor 1, named “Productive Interactions”, refers to the characteristics and content of interactions between patients and professionals oriented to improve outcomes, for example the professionals who care for me listen to me and ask me about my needs/habits and preferences and they are concerned with my quality of life. Factor 2, named “New Relational Model”, refers to new forms of patient interaction with the health care system, through the internet or with peers. Factor 3, named “Patient Self-Management”, refers to the ability of individuals to manage their own care and improve their wellbeing based on professional-mediated interventions.
|Item Abbreviation||Items||Communalities||Item-total Correlation||Alpha if item deleted||Mean*||SD||PI||NRM||PSM|
|P24||I review the adherence to my treatment and care plan with the professionals who care for me.||0.70||0.60||0.73||4.0||1.2||0,78|
|P26||The professionals who care for me are concerned with my quality of life and I feel they are committed to my wellbeing.||0.64||0.53||0.73||4.1||1.2||0,77|
|P22||Health and social care services are coordinated to improve my wellbeing and quality of life in my environment (family, neighbourhood, town).||0.62||0.9||0.74||4.0||1.2||0,77|
|P9||The professionals who care for me listen to me and ask me about my needs, habits and preferences to adapt my treatment and care plan.||0.50||0.40||0.75||4.0||1.2||0,70|
|P13||I can consult my clinical record, tests results, programmed visits and access to other services through the internet or the mobile app of my health service.||0.64||0.23||0.77||1.4||1.0||0.83|
|P8||The professionals who care for me inform me about trustful webpages and internet forums that I can consult to better know my disease, its treatment and the consequences they may have on my life.||0.69||0.31||0.76||1.6||1.1||0.83|
|P12||The professionals who care for me invite me to participate in patients groups to share information and experiences on how to care for ourselves and improve our health.||0.53||0.42||0.75||2.1||1.4||0.56|
|P17||I’ve been able to agree with the professionals who care for me on specific objectives regarding diet, physical exercise and medication to get better control of my health problems.||0.61||0.47||0.74||3.6||1.4||0.74|
|P1||The professionals who care for me inform me about the health and social resources available in my neighbourhood or town that I can use to improve my health problems and take better care of myself.||0.46||0.31||0.77||3.1||1.6||0.68|
|P6||The professionals who care for me review with me all of the medication I take, how I take it and how it suits me.||0.49||0.41||0.75||4.0||1.3||0.51|
|P11||I feel that my confidence in my ability to take care of myself, manage my health problems and keep my autonomy has improved.||0.43||0.44||0.75||4.1||1.1||0.43|
|Percentage of explained common variance (57%)||24%||17%||16%|
The confirmatory factor analysis (CFA), in the second stage of the study, indicated an acceptable fit to the data. The estimates of the parameters and factor loadings of the model are shown in Table 3 and Figure 2. This figure also shows the optimised model of the questionnaire factorial structure based on confirmatory factor analysis.
|Evaluating model fit||Fit indices||A model is regarded as acceptable if:||CFA Index values
|N= 338||N= 115|
|Absolute fit indices||SRMR||Value<0.08||0.05||0.06|
|Relative fit indices||NFI||Value ≈1||0.92||0.91|
|CFI||0.9< Value <0.95||0.96||0.95|
The analysis of the convergent validity was satisfactory. All standardised loads were found to be significant for the respective factor and to be greater than 0.6. The average variance extracted was greater than 0.5 . The composite reliability indexes were greater than 0.7 , indicating acceptable reliability for all factors (Table 4).
|Factor (abbreviation)||Items||Standardized loadsa|
|Productive Interactions (PI)||P22||0.895 (12.106)|
|New Relational Model (NRM)||P13||0.960 (13.244)|
|Patient Self-management (PSM)||P17||0.762 (9.060)|
In the discriminant analysis, Table 5 shows the inter-correlations between the three factors identified in the analyses. The factors showed acceptable independence to each other. PI with PSM showed higher values.
|Productive Interactions (PI)||1.00||0.20||0.47||0.78|
|New relational model (NRM)||1.00||0.31||0.61|
|Person’s self-management (PSM)||1.00||0.82|
The value of the Alpha Chronbach was 0.76 for the whole scale (0.79 in factor 1, 0.56 in factor 2 and 0.63 in factor 3).
The average punctuation in the IEXPAC-11 items was 3.1 points (SD 0.7, IC95% 3.0-3.2). The average punctuation in each factor was 4.0 points (SD 0.9) in factor one, 1.7 (SD 0.9) in factor two and 3.7 (SD 0.9) in factor three. Table 6 shows the results based on a set of variables.
|P = 0.321||P = 0.033||P = 0.079|
|P = 0.925||P = 0.001||P = 0.556|
|P = 0.696||P = 0.000||P = 0.394|
|Who they live with|
|P = 0.467||P = 0.021||P = 0.463|
|P = 0.001||P = 0.068||P = 0.707|
|P = 0.306||P = 0.001||P = 0.351|
|Number of hospitalisations in last 3 years|
|3 or more||22||6.5||4.1||1.6||3.9|
|P = 0.947||P = 0.657||P = 0.401|
|Emergency visits in the last year|
|3 or more||31||9.2||3.8||1.5||3.6|
|P = 0.179||P = 0.281||P = 0.468|
|General practitioner appointments in the last year|
|6 or more||145||42.9||4.1||1.4||3.8|
|P = 0.255||P = 0.001||P = 0.085|
|Autonomous Health Service|
|P = 0.001||P = 0.001||P = 0.001|
The new tool was named IEXPAC, Instrument for Evaluation of the Experience of Chronic Patients (available online at http://www.iemac.es/iexpac/). Additionally, an item was included for specific cases when a patient is hospitalised, to check the continuity of care during discharge and once the patient returns home. This item (number 12) is not included in the scale aggregate rating. The average score for this item was 2.5 (SD 1.7).
The developed scale is an instrument to obtain a reliable and valid measure of the experience of patients with chronic conditions during their interaction with the system of care. IEXPAC has a condensed set of measured items so that it can be used routinely and systematically in care services for assessing whether patients perceive is receiving integrated care, have a positive relationship with the set of professionals which usually interacts with, feels abler to look after their health and, are involved in new ways of non-face-to face interactions.
Specifically, IEXPAC assesses patient experience in accordance with the Triple Aim framework. Triple Aim shows the importance of the “experience of care”, an inconsistently measured dimension. Most health systems do not regularly assess the experience of care. This instrument could be used online (http://iexpac.es) paper-and-pencil or phone to assess patient experience of care in several contexts such as a health centre, health district or health service.
Patient experience represents a unique encompassing dimension that is challenging to measure. Lacking a widely accepted definition , we have rooted the development of this scale in the Chronic Care Model theoretical framework, enriched with approaches coming from patient-centred care [17, 18] and service coproduction theories . The relationship between patient experience and quality of care is not consistent in the literature. Major studies have rendered different, even opposite, results [12, 38, 39], whose likely explanation has been analysed by Manary . In many contexts, the established patient satisfaction terminology is being substituted for the rather new ‘patient experience’, as if they can be used interchangeably. Patient experience with chronic care, as captured with the IEXPAC scale, however, differs significantly from the traditional patient satisfaction with episodes of care. This is why, in developing IEXPAC, we put emphasis on clarifying and delimiting the concept we want to measure, as formulated in our definition of patient experience. In the past, the concept of satisfaction has been used in a bilateral way, capturing the interaction of a patient with a single professional or organization. New measures should be focused on gauging experience with more comprehensive and complex provision models where different organizations are working collaboratively to provide patient-centred care.
The IEXPAC scale has several strengths from an integrated care point of view. First, it assesses experience of care beyond punctual contact, episode or specific setting. It is expected to capture a continuous experience over six months. Second, it considers the health professionals as a team, not solely focused on individual or isolated interaction with physicians, nurses or other staff. In countries like Spain, care delivery is not only focused on “doctors”, but on a comprehensive team, where different primary care professionals interact with patients and different providers from hospitals, mental health networks, long term care facilities or social care organisations. Other authors, such as Walker et al have also acknowledged that patients “highly value a sense of all members of the care team being on the same page”. Third, the scale captures the relationship between the patient and a system of care, where self-management and social care are also relevant. Fourth, the scale incorporates an active patient role, having a clear orientation towards improving outcomes by means of patients and professionals working together (coproduction). Fifth, IEXPAC is aligned with new evaluative frameworks of population health management based on the Triple Aim vision.
The psychometric analysis of IEXPAC renders three independent factors with items that converge around concepts: productive interactions, new relational model and patient self-management, all with literature supporting their adequacy and soundness .
This instrument also has some limitations that should be considered. There is still no data to support whether improvements in the scale ratings are related to better clinical or health-related quality of life outcomes. Furthermore, as patients with different chronic diseases or patients in different settings have distinct experiences with chronic illness care, there may be a need for specific scales for certain chronic diseases or types of complex chronic patients, such as those in home care programmes and those who are assisted by caregivers. Finally, the way the scale is formulated does not allow to attribute responsibilities to a specific care provider at individual level, only to a team of providers or “system of care”.
To the best of our knowledge, most national health systems are not capturing the integrated care experience of patients with chronic conditions in a regular, holistic and systematic way. Most countries have a range of measures related to health outcomes and cost or utilization of services, typically included in most national or regional outcome frameworks. There is appropriate to also develop experience of care measures and incorporate them into national and regional-level integrated care models. There is a promising future for these metrics through the commissioning by health and social care authorities and through performance assessments. Relevant initiatives are expected to appear in the coming years in this field of knowledge [42, 43]. For example, the area 4 (Ensuring that people have a positive experience of care) in the English NHS Outcome Framework 2015/2016 , may include the assessment of experience of care from an integrated care perspective. Tools like IEXPAC should contribute to this aim.
IEXPAC scale measures the experience of patients with chronic conditions in their continued interaction with health professionals and services in regular practice. It can ascertain the quality of care experienced by patients, contributing to the ‘experience of care’ axis of the Triple Aim, and facilitate the adoption of patient-centred care approaches by health and social care organisations.
Measurement of patient experience may also facilitate the reorientation towards patient-centred care. Presently, with numerous processes of service integration being deployed, this might be of particular importance. It is necessary to generate results that consolidate this type of measurement, showing its correlation with other outcome indicators whose relevance and usefulness are widely accepted in the literature.
Although IEXPAC has yet to prove it can be used in regular practice, it seems that new metrics like this will be welcomed and possibly incorporated into regular performance assessments or commissioning processes of health and social care.
We thank Itziar Pérez-Irazusta (Basque Health Service), Ana Miquel (Madrid Health Service), Rafael Ruiz-Riera (Catalonian Health Service), Eduardo Zafra (Valencian Health Service), Alberto Asencio (Valencian Health Service), and Manuel Sánchez (Valencian Health Service) for facilitating the field study in their Regional Health Services; Ester Sarquella (PIAISS, Catalonian Integrated Health and Social Services Plan), Sage Show and Elena Urízar (Deusto Business School Health) for their insightful comments.
Two anonymous reviewers.
IEXPAC is provided free for non-profit organizations that want to improve chronic patient care. PF works at Merck Sharp & Dohme Spain. This study has been funded by Merck Sharp & Dohme Spain.
JJM, RN, MG, OS designed the study. MG and OS conducted qualitative techniques. MG, OS, JCC, AG, MR and the IEXPAC development group enrolled centres and patients. OS coordinated the field study. JJM and MG performed statistical analysis. JJM, PF and RN drafted this original. All authors reviewed information sources, participated in reviewing and interpreting data and read and approved the final manuscript.
Murray, CJ Vos, T Lozano, R Naghavi, M Flaxman, AD Michaud, C et al. (2012). Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990–2010: a systematic analysis for the Global Burden of Disease study 2010. Lancet 380(9859): 2197–2223, DOI: https://doi.org/10.1016/S0140-6736(12)61689-4
Tinetti, ME, Fried, TR and Boyd, CM (2012). Designing health care for the most common chronic condition-multimorbidity. The Journal of the American Medical Association 307(23): 2493–2494, DOI: https://doi.org/10.1001/jama.2012.5265
Nuño, R, Coleman, K, Bengoa, R and Sauto, R (2012). Integrated care for chronic conditions: the contribution of the ICCC Framework. Health Policy 105(1): 55–64, DOI: https://doi.org/10.1016/j.healthpol.2011.10.006
McGlynn, EA Asch, SM Adams, J Keesey, J Hicks, J DeCristofaro, A et al. (2003). The quality of health care delivered to adults in the United States. The New England Journal of Medicine 348(26): 2635–2645, DOI: https://doi.org/10.1056/NEJMsa022615
Bengoa, R (2013). Transforming health care: an approach to system-wide implementation. International Journal of Integrated Care 13(3)DOI: https://doi.org/10.5334/ijic.1206
Ham, C (2010). The ten characteristics of the high-performing chronic care system. Health Economics, Policy and Law 5(Pt 1): 71–90, DOI: https://doi.org/10.1017/S1744133109990120
Wagner, EH, Austin, BT and Von Korff, M (1996). Organizing care for patients with chronic illness. The Milbank Quarterly 74(4): 511–544, DOI: https://doi.org/10.2307/3350391
Coleman, K, Austin, BT, Brach, C and Wagner, EH (2009). Evidence on the Chronic Care Model in the new millennium. Health Affairs (Millwood) 28(1): 75–85, DOI: https://doi.org/10.1377/hlthaff.28.1.75
Martínez-González, NA, Berchtold, P, Ullman, K, Busato, A and Egger, M (2014). Integrated care programmes for adults with chronic conditions: a meta-review. International Journal for Quality in Health Care 26(5): 561–570, DOI: https://doi.org/10.1093/intqhc/mzu071
Davy, C, Bleasel, J, Liu, H, Tchan, M, Ponniah, S and Brown, A (2015). Effectiveness of chronic care models: opportunities for improving healthcare practice and health outcomes: a systematic review. BMC Health Services Research 15(15)DOI: https://doi.org/10.1186/s12913-015-0854-8
Cramm, JM and Nieboer, AP (2013). High-quality chronic care delivery improves experiences of chronically ill patients receiving care. International Journal for Quality in Health Care 25(6): 689–695, DOI: https://doi.org/10.1093/intqhc/mzt065
Doyle, C, Lennox, L and Bell, D (2013). A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open 3(1)DOI: https://doi.org/10.1136/bmjopen-2012-001570
Glasgow, RE, Wagner, EH, Schaefer, J, Mahoney, LD, Reid, RJ and Greene, SM (2005). Development and validation of the Patient Assessment of Chronic Illness Care (PACIC). Medical Care 43(5): 436–444, DOI: https://doi.org/10.1097/01.mlr.0000160375.47920.8c
Vrijhoef, HJ, Berbee, R, Wagner, EH and Steuten, LM (2009). Quality of integrated chronic care measured by patient survey: identification, selection and application of most appropriate instruments. Health Expectations 12(4): 417–429, DOI: https://doi.org/10.1111/j.1369-7625.2009.00557.x
Singer, SJ, Friedberg, MW, Kiang, MV, Dunn, T and Kuhn, DM (2012). Development and validation of the Patient Perceptions of Integrated Care Survey. Medical Care Research and Review 70(2): 143–164, DOI: https://doi.org/10.1177/1077558712465654
Singer, SJ, Burgers, J, Friedberg, M, Rosenthal, MB, Leape, L and Scheneider, E (2011). Defining and measuring integrated patient care: promoting the next frontier in health care delivery. Medical Care Research and Review 68(1): 112–127, DOI: https://doi.org/10.1177/1077558710371485
National Quality Board (2015). Improving experience of care: Our shared understanding and ambition In: Jan 2015London: NHS. [cited 2016 31 Jan]. Available from: https://www.england.nhs.uk/wp-content/uploads/2015/01/improving-experiences-of-care.pdf.
World Health Organization (2015). WHO global strategy on people-centred and integrated health services In: Mar 2015Geneva: WHO. [cited 2016 31 Jan]. Available from: http://www.who.int/servicedeliverysafety/areas/people-centred-care/global-strategy/en/.
Coulter, A (2002). After Bristol: putting patients at the centre. BMJ 324(7338): 648–651, DOI: https://doi.org/10.1136/bmj.324.7338.648
Walker, KO, Labat, A, Choi, J, Schmittdiel, J, Stewart, AL and Grumbach, K (2013). Patient perceptions of integrated care: confused by the term, clear on the concept. International Journal of Integrated Care 13(1): e004.DOI: https://doi.org/10.5334/ijic.985
Nuño-Solinís, R Fernández-Cano, P Mira-Solves, JJ Toro-Polanco, N Contel, JC Guilabert-Mora, M et al. (2013). Development of an instrument for the assessment of chronic care models. Gaceta Sanitaria 27(2): 128–134, DOI: https://doi.org/10.1016/j.gaceta.2012.05.012 [in Spanish].
Mira, JJ Nuño-Solinís, R Fernández-Cano, P Toro-Polanco, N Contel, JC Guilabert-Mora, M et al. (2015). Readiness to tackle chronicity in Spanish health care organisations: a two-year experience with the Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations instrument. International Journal of Integrated Care 15(4)DOI: https://doi.org/10.5334/ijic.1849
Berwick, DM, Nolan, TW and Whittington, J (2008). The triple aim: care, health, and cost. Health Affairs (Millwood) 27(3): 759–769, DOI: https://doi.org/10.1377/hlthaff.27.3.759
The Evidence Centre for National Voices (2014). Enhancing experience. Summarising evidence from systematic reviews In: Mar 2014London: National Voices. [cited 2016 31 Jan]. Available from: http://www.nationalvoices.org.uk/node/1335.
Batalden, M Batalden, P Margolis, P Seid, M Armstrong, G Opipari-Arrigan, L et al. (2016). Coproduction of healthcare service. BMJ Quality & Safety 25(7): 509–517, DOI: https://doi.org/10.1136/bmjqs-2015-004315
Orueta, JF, Garcia-Alvarez, A, Garcia-Goni, M, Paolucci, F and Nuno-Solinis, R (2014). Prevalence and costs of multimorbidity by deprivation levels in the Basque Country: a population based study using health administrative databases. PloS One 9(2)DOI: https://doi.org/10.1371/journal.pone.0089787
Drewes, H van Til-de Jong, J Struijs, J Baan, C Tekle, F Meijboom, B et al. (2012). Measuring chronic care management experience of patients with diabetes: PACIC and PACIC+ validation. International Journal of Integrated Care 12(8)DOI: https://doi.org/10.5334/ijic.862
Beattie, M, Murphy, DJ, Atherton, I and Lauder, W (2015). Instruments to measure patient experience of healthcare quality in hospitals: a systematic review. Systematic Reviews 4: 97.DOI: https://doi.org/10.1186/s13643-015-0089-0
Cramm, JM and Nieboer, AP (2015). The importance of productive patient–professional interaction for the well-being of chronically ill patients. Quality of Life Research 24(4): 897–903, DOI: https://doi.org/10.1007/s11136-014-0813-6
Cramm, JM, Jolani, S, van Buuren, S and Nieboer, AP (2015). Better experiences with quality of care predict well-being of patients with chronic obstructive pulmonary disease in the Netherlands. International Journal of Integrated Care 15(2)DOI: https://doi.org/10.5334/ijic.1587
Wensing, M, Vingerhoets, E and Grol, R (2003). Feedback based on patient evaluations: a tool for quality improvement?. Patient Education and Counseling 51(2): 149–153, DOI: https://doi.org/10.1016/S0738-3991(02)00199-4
McDonald, RP (1981). The dimensionality of tests and items. British Journal of Mathematical Statistical Psychology 34(1): 100–117, DOI: https://doi.org/10.1111/j.2044-8317.1981.tb00621.x
Terwee, CB Bot, SD de Boer, M van der Windt, DA Knol, DL Dekker, J et al. (2007). Quality criteria were proposed for measurement properties of health status instruments. Journal of Clinical Epidemiology 60(1): 34–42, DOI: https://doi.org/10.1016/j.jclinepi.2006.03.012
Bagozzi, RP and Yi, Y (1988). On the evaluation of structural equation models. Journal of the Academy of Marketing Science 16(1): 74–94, DOI: https://doi.org/10.1007/BF02723327
LaVela, SL and Gallan, AS (2014). Evaluation and measurement of patient experience. Patient Experience Journal 1(1): 28–36. Available from: http://pxjournal.org/journal/vol1/iss1/5.
Jha, AK, Orav, EJ, Zheng, J and Epstein, AM (2008). Patients’ Perception of Hospital Care in the United States. The New England Journal of Medicine 359: 1921–1931, DOI: https://doi.org/10.1056/NEJMsa0804116
Groene, O Arah, OA Klazinga, NS Wagner, C Bartels, PD Kristensen, S et al. (2015). Patient Experience Shows Little Relationship with Hospital Quality Management Strategies. PLoS One 10(7)DOI: https://doi.org/10.1371/journal.pone.0131805
Manary, MP, Boulding, W, Staelin, R and Glickman, S (2013). The Patient Experience and Health Outcomes. The New England Journal of Medicine 368(3): 201–203, DOI: https://doi.org/10.1056/NEJMp1211775
Nuño-Solinís, R (2016). [Development and implementation of the Chronicity Strategy for the Basque Country (Spain): lessons learned]. Gaceta Sanitaria, DOI: https://doi.org/10.1016/j.gaceta.2016.03.011 [in Spanish].
Staniszewska, S and Churchill, N (2014). Patients’ experiences in the UK: Future strategic directions. Patient Experience Journal 1(1): 140–143. Available from: http://pxjournal.org/journal/vol1/iss1/18.
Coulter, A, Locock, L, Ziebland, S and Calabrese, J (2014). Collecting data on patient experience is not enough: they must be used to improve care. BMJ 348DOI: https://doi.org/10.1136/bmj.g2225
Department of Health (2014). The NHS Outcomes Framework 2015/2016 In: Dec 2014London: NHS. [cited 2016 31 Jan]. Available from: https://www.gov.uk/government/publications/nhs-outcomes-framework-2015-to-2016.