Start Submission Become a Reviewer

Reading: Towards a taxonomy for integrated care: a mixed-methods study

Download

A- A+
Alt. Display

Research & theory

Towards a taxonomy for integrated care: a mixed-methods study

Authors:

Pim Peter Valentijn ,

Scientific Centre for Care and Welfare (Tranzo), Tilburg University, The Netherlands; and Jan van Es Institute, Netherlands Expert Centre Integrated Primary Care, NL
X close

Inge C. Boesveld,

Denise M. van der Klauw,

Dirk Ruwaard,

Jeroen N. Struijs,

Johanna J.W. Molema,

Marc A. Bruijnzeels,

Hubertus JM. Vrijhoef

Abstract

Introduction: Building integrated services in a primary care setting is considered an essential important strategy for establishing a high-quality and affordable health care system. The theoretical foundations of such integrated service models are described by the Rainbow Model of Integrated Care, which distinguishes six integration dimensions (clinical, professional, organisational, system, functional and normative integration). The aim of the present study is to refine the Rainbow Model of Integrated Care by developing a taxonomy that specifies the underlying key features of the six dimensions.


Methods: First, a literature review was conducted to identify features for achieving integrated service delivery. Second, a thematic analysis method was used to develop a taxonomy of key features organised into the dimensions of the Rainbow Model of Integrated Care. Finally, the appropriateness of the key features was tested in a Delphi study among Dutch experts.


Results: The taxonomy consists of 59 key features distributed across the six integration dimensions of the Rainbow Model of Integrated Care. Key features associated with the clinical, professional, organisational and normative dimensions were considered appropriate by the experts. Key features linked to the functional and system dimensions were considered less appropriate.


Discussion: This study contributes to the ongoing debate of defining the concept and typology of integrated care. This taxonomy provides a development agenda for establishing an accepted scientific framework of integrated care from an end-user, professional, managerial and policy perspective.

How to Cite: Valentijn PP, Boesveld IC, van der Klauw DM, Ruwaard D, Struijs JN, Molema JJW, et al.. Towards a taxonomy for integrated care: a mixed-methods study. International Journal of Integrated Care. 2015;15(1):None. DOI: http://doi.org/10.5334/ijic.1513
1632
Views
877
Downloads
35
Citations
  Published on 04 Mar 2015
 Accepted on 20 Jan 2015            Submitted on 13 Dec 2013

Introduction

Integrated care is increasingly being promoted as a means for improving accessibility, affordability and the quality of health care, especially for people with complex needs [1,2]. Essential for achieving desired health outcomes and limiting costs, primary care is considered the cornerstone of such integrated care approaches [35]. However, despite the increasing popularity of developing integrated service models in a primary care setting a solid knowledge base is lacking [6]. In particular, the knowledge base is hampered by the lack of common terminology and typology regarding integrated care [2].

In a recent article, we proposed the Rainbow Model of Integrated Care [7] as a framework to unravel the complexity of integrated care. The Rainbow Model of Integrated Care distinguishes four dimensions that play inter-connected roles on the macro- (system integration), meso- (organisational, professional) and micro-level (clinical integration) and two more dimensions (functional and normative integration) that enable the connectivity between the various integration levels (see Table 1). The Rainbow Model of Integrated Care is considered useful for understanding the complex and multidimensional nature of integrated care [8]. However, the underlying key features of these six integrated care dimensions are yet unknown. Insight into the underlying key features is essential for achieving a common operational understanding of integrated care and for contributing to programme implementation, policy formulation and research analysis.

Consequently, there is a need for a common taxonomy that can classify the broad spectrum of integrated care approaches. A taxonomy is a formal system to classify a multifaceted complex phenomena [9], and, in this study, this complex phenomena is ‘integrated care’. A taxonomy applied to integrated care would facilitate the description and comparison of different integrated care programmes which is essential for translating research findings and evidence into practical tools for policy and practical implementation. Likewise, this taxonomy is needed to support effective deployment of integrated service models in a primary care setting. The aim of the present study is to contribute to a better understanding and operational consensus regarding the concept of integrated care by addressing the following objectives:

  • Based on a literature review, define the Rainbow Model of Integrated Care by developing a taxonomy that specifies the underlying key features of the six integrated care dimensions;
  • Investigate the appropriateness of the key features to achieve integrated care in a primary care setting among a group of experts from The Netherlands.

Theory and methods

Theoretical background

Integrated care, as defined by Leutz (1999), is a broad inter-sectorial system approach that aims to align the health care system (acute, primary medical and skilled) with other human service systems (e.g. long-term care, education and vocational and housing services) [10]. Primary care, as stated in the Alma-Ata declaration of 1978 [11], describes a similar inter-sectorial system approach with a distinct community and socio-political focus. However, theoretical discourses on integrated care and primary care as a broad inter-sectorial system approach have failed to produce practical relevance for practices and policies [12]. To bridge this gap, a common taxonomy is needed to move towards a clearer operational consensus regarding integrated care as a whole.

In this article, integrated care refers to ambulatory care settings in which a network of multiple professionals and organisations across the health and social care system provide accessible, comprehensive and coordinated services to a population in a community. Based on the Rainbow Model of Integrated Care, integration of services can be achieved at a system (system integration), institutional (organisational integration), professional (professional integration) and service (clinical integration) levels. The distinctions between these different levels provide comprehensive insight into the features needed to achieve integrated care within a system. Throughout this paper, we refer to features of integrated care as entities, processes or structures which operate in particular contexts to achieve integrated care.

Methods

We applied a mixed-method approach consisting of: (1) a literature review, (2) a thematic analysis to develop a taxonomy, and (3) a Delphi study to test the relevance of the taxonomy among a group of experts from The Netherlands. Because no patients were involved in this study, ethical approval was not required under Dutch law.

Literature review

A literature review was conducted to identify the key features that could be used to organise integrated care. The databases Cochrane Library, Medline, Scopus and Business Source Premier were searched for articles published during the period from January 2002 to December 2012 and written in English. Because the present study specifically focused on the organisation of integrated care, the focus of the literature review was narrowed to system (inter-sectorial), organisational (inter-organisational) and professional (inter-professional) models of integration. The following search terms were used: ‘delivery of health care’, ‘integrated service system’, ‘integrated systems’, ‘inter-organisational collaboration’, ‘inter-organisational cooperation’, ‘inter-professional collaboration’ or ‘inter-professional work’ and ‘quality model’. The detailed search and selection strategy appears in ‘Additional File 1’.

To be included, publications had to meet the following criteria: (1) a description of a theory or model of inter-sectorial, inter-organisational or inter-professional service delivery, (2) a description of the features (underlying entities, processes or structures) used to achieve integrated service delivery. Publications were excluded that reported clinical interventions and a main focus on clinical outcome measures (e.g. HbA1c levels or hospital re-admission rates) or process indicators (e.g. percentage of patients receiving treatment).

Two researchers (PV and IB) independently reviewed the titles and abstracts. Only when both of the researchers independently found the title and abstracts relevant, the article was retrieved. Any disagreements between the researchers were resolved by consensus. For every included publication, we briefly described the theory or model, the study design and the main research theme of the article.

Thematic analysis

A three-step thematic analysis method was used [13,14] to synthesise the results of the literature review and to develop a taxonomy of key features. First, two researchers (PV and IB) generated an initial list of features from the included articles. To be initially included, features had to meet the following three criteria: (1) Relevance (related to achieving clinical, professional, organisational, system, functional and/or normative integration); (2) Theoretical foundation (presence of a theory, model or logic was described in the article); and (3) Clarity (clear definition or descriptions of the reported features). Thereafter, the initial list of features was categorised across the six dimensions of the Rainbow Model of Integrated Care according to the description of each feature as reported in the literature. Any disagreements between the researchers were resolved by consensus. Second, three researchers (PV, IB and MB) independently assessed the compiled taxonomy and combined features into overarching key features within each integrated care dimension. During three discussion rounds, overarching key features were compared for agreement among the researchers and iterative revisions were made. Also, features that were identical or nearly identical were merged and descriptions were formed during these rounds. Finally, two external researchers (DK and JM) and a research assistant independently reviewed the preliminary taxonomy and offered feedback for refining the descriptions of the key features. Feedback included suggestions for merging and/or reorganising specific key features within and between the different dimensions. PV and IB summarised the feedback and revised the taxonomy accordingly.

Delphi study

A Delphi study was conducted using the RAND UCLA appropriateness method [15]. In the first round, a self-administered questionnaire was used, and in the second round the experts revalued their first round score after a group discussion in a physical meeting. The aim of the second discussion round was to determine if ratings were different due to real disagreement or due to a misunderstanding or misinterpretation of the features [15]. A purposive sampling strategy was used to identify experts with experience in practice or science regarding the deployment of integrated service models in a primary care setting. The following selection criteria were used for the experts: a scientific (doing research) or practical (working in a professional or service organisation) background regarding the organisation of integrated primary care delivery. Based on this criteria, experts were selected to ensure that a balanced number of both were represented. We decided not to include stakeholders like patients and health insurers in order to minimalize conflict of interest in the procedure (e.g. strategic behaviour of the experts because they are dependent on these stakeholders). Thirty-three experts were approached by e-mail and/or telephone and invited to participate. We then included experts that indicated that they would be available to participate in both consensus rounds. Following the RAND UCLA appropriateness method, between 9 and 15 experts were ultimately selected [15].

During round one, the experts received written information on the research aims and details of the Delphi procedure. After they committed to participate, they received a link to an online questionnaire and were asked to rate the appropriateness of each feature for achieving integrated care in a primary care setting on a 9-point Likert-scale, ranging from 1 (completely irrelevant) to 9 (extremely relevant). The features were randomly presented to the experts to avoid order and information bias, which could potentially transpire especially if the features were presented in the order of the six Rainbow Model of Integrated Care dimensions. In addition, all experts were invited to suggest possible rephrasing of the descriptions of the features and add new features. After one week, reminders were sent by e-mail to non-responders.

In round two, a face-to-face meeting of the expert panel took place which was chaired by one of the researchers (MB) with experience in facilitating group discussions. The meeting's goal was to discuss the results of round one and revalidate the features. Based on the results of round one, a summary report was provided to the experts with the following key feedback information: (1) respondents’ own ratings in round one, (2) median agreement rating, (3) summary of qualitative comments, as well as (4) whether consensus was achieved at round one. Because of time, we decided to only discuss the features that did not reach agreement in the first round. We clustered these features by theme (e.g. leadership, strategy, value creation, external environment) and asked the highest and lowest scoring panel member to clarify his or her consideration. Next, a short discussion among all group members took place. Finally, the experts were asked to, once again, individually rate the features that were not agreed upon in the first round.

Data Analysis

The data extracted during the thematic analysis process were listed and analysed using MS Excel. The criteria of the RAND UCLA appropriateness method were used to analyse the data from the Delphi study [15]. We categorised the overall panel median as follows: 1–3 as inappropriate, 4–6 as equivocal and 7–9 as appropriate. Agreement signified that ≥70% of panellists’ ratings were within the same 3-point region (that is, 1–3, 4–6 or 7–9) as the observed median. A feature was defined as ‘appropriate’ with an overall panel median score of ≥7 and a level of agreement of ≥70% within the 3-point region 7–9. A panel median of 4–6 or median with a consensus of ≤70% within the same 3-point region was defined as ‘equivocal’. A feature with a panel median of 1–3 and a level of agreement of ≥70% within the 3-point region 1–3 was defined as ‘inappropriate’. The decision rules used in both rounds are shown in Table 2. Values were computed using SPSS version 21 for Windows (IBM Statistics).

Results

Literature review

Our literature search yielded 534 potentially relevant publications (Figure 1). After screening titles and abstracts, we retrieved 214 potentially relevant publications for their full-text. We excluded 320 publications because they were not considered relevant to the current study. Out of the 214 eligible publications, 13 duplicates were removed and another 122 publications were excluded for reasons given in Figure 1. Finally, a total of 79 publications were included in the literature review.

Most of the included publications were based on empirical studies (66%, n = 52); other publications were based on non-empirical study designs (27%, n = 27). Table 3 lists the main research topics of the included publications. Approximately one-third of the publications focused on inter-organisational collaboration (30%, n = 24); other common themes were integrated service delivery (18%, n = 14), inter-professional collaboration (11%, n = 9) and inter-organisational learning (10%, n = 8). More descriptive information can be found in ‘Additional File 2’.

Thematic analysis

Figure 2 provides a schematic overview of the thematic analyse process employed to synthesise the literature and to develop the taxonomy of key features. The reasons for removing features at each step of the thematic analysis process appear in the dashed boxes in Figure 2. First, an initial list of 1685 features was extracted from the 79 included publications of which 1680 features were categorised across the six dimensions of the Rainbow Model of Integrated Care (see Step 1 in Figure 2). Second, the compiled taxonomy of 1680 features was reviewed by three authors (PV, MB and IB) to identify the broader and overarching key features per dimension. During the first discussion round, 274 key features were identified by the three reviewers. There was little disagreement among the three authors on combining features to form over-reaching key features, and any existing disagreement was easily resolved by discussion. During these subsequent discussion phases, most features were merged within each dimension due to similar or nearly identical content. After the third discussion round, 94 potential key features were identified (see Step 2 in Figure 2). Finally, the compiled taxonomy was reviewed by two external reviewers (DK and JM) and a research assistant. Based on the feedback of the reviewers, the features were further merged and refined within and between the six dimensions based on their similar content (see Step 3 in Figure 2). The resulting taxonomy of 59 key features is shown in Table 4.

Delphi study

In total, 14 persons participated in the first round of the expert panel (response rate 40%). The main reason experts choose not to participate was their inability to be available for the second face-to-face meeting. The panel was a balanced group of experts with a scientific (50%, n = 7) or practical (50%, n = 7) background. The panellists had a mean age of 45.4 years (SD: 11.3, range: 28–68) and a mean of 11.6 years (SD: 8.8, range 4–40) of experience in integrated care initiatives. Based on round 1, 25 of the 59 key features were considered appropriate (overall panel median of 7–9 and consensus of ≥70% within the same 3-point region, see Table 5). Thirty-four features were rated as equivocal for achieving integrated care in a primary care setting (overall panel median of 4–6 or median with consensus of ≤70% within the same 3-point region). None of the key features were considered inappropriate (overall panel median of 1–3 and consensus of ≥70% within the same 3-point region), and the experts did not propose any new features.

In the second round, one expert with practical experience and three scientific experts could not attend, resulting in a 10-member panel. This had no major impact on the composition of the panel compared to round 1. The panellists in round 2 had a mean age of 47.5 years (SD: 11.5, range: 28–68) and a mean of 10.9 years (SD: 8.8, range 4–40) of experience. Discussion during the second round on the 34 equivocal features resulted in an extra nine features rated as appropriate. Within the clinical dimension, the key features interaction between professional and client (no. 6) and population needs (no. 11) and within the organisational dimension the key features interest management (no. 27) and managerial leadership (no. 32) were rated appropriate after the second round. Within functional dimension the key feature regular feedback of performance indicators (no. 48) reached consensus after the second round. Furthermore, within the normative dimension, the key features sense of urgency (no. 50), visionary leadership (no. 53), quality features of the informal collaboration (no. 55) and linking cultures (no. 56) were rated appropriate. Twenty-four key features remained equivocal after the second round, and only one key feature was rated as inappropriate, namely reputation (no. 57) within the normative dimension.

The results in Table 5 show that the appropriate key features are unevenly distributed across the six dimensions of the taxonomy. In particular, within the dimension of system integration, stakeholder management (no. 40) was the only key feature considered appropriate. Additionally, within the dimension of functional integration, half of the key features that refer to key support functions were considered equivocal by the experts; human resource management (no. 43), resource management (no. 45) and support systems and services (no. 46). Particularly noteworthy within the dimension of clinical integration is that five of its key features (nos. 3, 4, 8, 10 and 12) were considered equivocal by the experts for achieving integrated care in a primary care setting.

Corresponding features across the dimensions of the taxonomy, such as value creation and leadership, also showed an uneven pattern. For example, key features concerning value creation (nos. 21, 24 and 37) were only considered appropriate from a ‘professional’ integration perspective (no. 21) and not from an organisational or system integration perspective. Moreover, key features regarding leadership (nos. 19, 32 and 53) were only considered appropriate from an organisational perspective and normative integration perspective, but not from a professional integration perspective (no. 19).

Discussion

This study aimed to define a taxonomy to contribute to the ongoing debate of specifying the concept of integrated care using a theory-driven mixed-method approach. Based on the theoretical foundations of the Rainbow Model of Integrated Care [7] and a literature review, we developed a taxonomy of 59 key features distributed across six integration dimensions (clinical, professional, organisational, system, functional and normative integration). A Delphi study further indicated that 34 of these 59 key features were considered appropriate for achieving integrated care in a primary care setting. The majority of the key features associated with the clinical, professionals, organisational and normative dimensions of integration were considered appropriate for achieving integration in a primary care setting. Key features associated with the functional and system dimensions of integration were considered less appropriate.

The results of the Delphi study indicated that the key features associated with the professional and organisational dimensions were considered appropriate for achieving integration in a primary care context. This result is not surprising as the professional and organisational perspective regarding integrated care has been the prime focus of practice, science and policies [2,95]. Moreover, the experts considered the key features associated with the normative dimension of the taxonomy as appropriate enablers for achieving integrated service models in a primary care setting. While existing integrated care theories, models and instruments tend to have a limited focus on these ‘soft enabling features’ of integrated care [9699], it is, nevertheless, very likely that these normative or soft features play a crucial role in the development of various complex inter-sectorial, inter-organisational and inter-professional service models of integration. Although the existing academic literature also suggests that functional integration (e.g. information management systems) are important enabling mechanisms for achieving integrated care [100], fewer of these key features were considered appropriate when compared to the normative key features.

An intriguing finding was that, despite socio-political influences being frequently mentioned as essential preconditions for achieving integrated care [2,5,101,102], the experts considered most of the key features associated with the system integration perspective as equivocal for achieving integration in a primary care setting. A possible explanation for this inconsistency might be found in the composition of our expert panel, as we did not explicitly include experts with a macro-policy background (e.g. policymakers or health insurers). This might have resulted in the underexposure of the macro-system perspective in the results of our Delphi study. On the other hand, at the micro-clinical level, the experts considered the key features related to the involvement of clients and patients as equivocal for achieving integration in a primary care setting. Most of the experts considered integrated service delivery as a ‘backstage’ process for the benefit of clients and patients. This opinion does not concur with the current academic literature that highlights the key position of patients in the integration process [2,103106]. This inconsistency might be explained by the fact that patients and clients were not included in the expert panel. The lack of interest being placed at the macro- (system) and micro- (patient) levels made us aware that integrated care can be defined from multiple perspectives depending on the actors involved (e.g. patients, professionals, managers and policymakers) [2]. This indicates the need to develop assessment tools which take into account these various perspectives (e.g. a 360-degree feedback method) when evaluating the performance of an integrate care approach.

Strengths and weaknesses

The strength of this study is its theory-driven mixed-method approach. The taxonomy is theoretically grounded on the Rainbow Model of Integrated Care [7] and has a solid base in the current academic literature. The strength of the thematic analysis procedure lies in its potential to synthesise and identify common features across a heterogeneous mix of publications [13,14,107]. The Delphi study added substantially towards consensus-based terminology regarding the development of integrated service models within a primary care context.

A limitation of the study relates to the composition of our expert panel, as patients and experts with a macro-policy background were not included. As noted earlier, the lack of emphasis on key features associated with the macro- (system) perspective and patient involvement in achieving integrated care might be due to the composition of our expert panel. We are aware of the fact that this form of selection bias might be present in our Delphi study. However, it appears difficult to include all perspectives in one expert panel without introducing other serious forms of bias (e.g. conflict of interests) [15,108]. We did not explicitly included experts with a macro-policy background because their presence could influence the (strategic) behaviour of the practice experts, as they are (financially) dependent on these experts for the continuity of their practices. Besides, the results of the Delphi study also confirm that an expert opinion regarding integrated care has a more limited scope compared to a broad theoretical discourse of integrated care [2,109111]. Another limitation of this study relates to the subjective interpretation process during the thematic analyses method. Although the synthesis process was systematic and independently verifiable, subjective judgements of the researchers could have had an impact on the construction of the key features of the taxonomy [14,112].

Another challenge in the present study relates to the complex nature of integrated care, which can never be fully rationalised or standardised [113115]. However, the vast majority of research on integrated care is based on an industrial-quality improvement logic which holds that quality standardisation leads to better outcomes and allows for more systematic evaluations [115]. Researchers (ourselves included) often struggle with the delicate balance of collating, analysing and synthesising findings which are academically defensible against research methods that do not necessarily appreciate the underlying epistemological assumptions of integrated care. We have attempted to use a more pragmatic approach to address this gap. By developing a taxonomy that holds much promise, our study aimed to potentially guide the modelling and development of pioneering research approaches across traditional disciplinary boundaries in order to reveal the complex inter-relationships at a system, institutional, professional and service level [115]. We think further debate about the underlying epistemological assumptions and methodology and quality considerations of integrated care would be extremely useful. We invite other scholars to explore with us the philosophical basis of integrated care and to establish an agreed upon ‘state of the science’.

Implications for practice and research

Our study fills an important gap in the knowledge base of the concept of integrated care. The key features of the taxonomy provide a crucial differentiation to describe and analyse various types of integrated service models (ranging from comprehensive towards more selective). In this way, the taxonomy might be a valuable contribution for health care professionals, managers, patient organisations, health care service purchasers and policymakers involved in the complex organisation of integrated service delivery. The taxonomy can also serve as set of hypotheses for future empirical investigation. Moreover, our study is a vital step towards the creation of a common language and an understanding of the concept of integrated care. Future research should explore the relevance and acceptability of our taxonomy in order to establish a common terminology regarding integrated care. In addition, researchers could examine the categorisation of the key features among the dimensions of integrated care in order to further refine the current taxonomy.

Conclusion

This study established a taxonomy for integrated care based on the theoretical foundations of the Rainbow Model of Integrated Care. The taxonomy can be considered a first step towards a common typology and operational consensus regarding integrated care. More work is needed to develop research methodologies that take into account the various integration processes from an end-user, professional, managerial and policy perspective in a synergetic way. For this purpose, the taxonomy has established a further developmental agenda for both research and practice.

Acknowledgements

This project was funded by the Association of Dutch Health care Insurers (ZN), ROS Network and the Netherlands Organisation for Health Research and Development (ZonMw) [grant number 154033001], The Hague. The authors would like to thank ZN, ROS Network and ZonMw for funding this research. We would like to especially thank research assistant Ingrid Hollander for her valuable contribution during this study. We are also grateful for the helpful comments of Roos Arends on earlier versions of this work. The authors highly appreciate the experts for their time and energy spent. Finally, we would like to thank the reviewers for their valuable remarks.

Reviewers

Esther Suter, PhD MSW, Director, Workforce Research & Evaluation, Alberta Health Services, Calgary, Canada

Professor Paul Thomas, Editor-in-Chief, London Journal of Primary Care, London, UK

One anonymous reviewer.

References

  1. Gröne, O and Garcia-Barbero, M (2001). Integrated care: a position paper of the WHO European Office for Integrated Health Care Services. International Journal of Integrated Care [serial online] Jun 20011: 1.Available from: URN:NBN:NL:UI:10-1-100270.

  2. Kodner, DL (2009). All together now: a conceptual exploration of integrated care. Healthcare Quarterly 13(Special Issue): 6–15.

  3. World Health Organization. The world health report 2008: Primary health care – now more than ever. Geneva: World Health Organization. 2008.

  4. Starfield, B, Shi, L and Macinko, J (2005). Contribution of primary care to health systems and health. Milbank Quarterly. 83(3): 457–502.

  5. Berwick, DM, Nolan, TW and Whittington, J (2008). The triple aim: care, health, and cost. Health Affairs 27(3): 759–69.

  6. Plochg, T and Klazinga, N (2002). Community-based integrated care: myth or must?. International Journal for Quality in Health Care 14(2): 91–101.

  7. Valentijn, PP, Schepman, SM, Opheij, W and Bruijnzeels, MA (2013). Understanding integrated care: a comprehensive conceptual framework based on the integrative functions of primary care. International Journal of Integrated Care [serial online] Mar 201322: 13.Available from: URN:NBN:NL:UI:10-1-114415.

  8. Goodwin, N (2013). Understanding integrated care: a complex process, a fundamental principle. International Journal of Integrated Care [serial online] Mar 201322: 13.Available from: URN:NBN:NL:UI:10-1-114416.

  9. Patton, MQ , . Qualitative research and evaluation methods. 3rd ed. Thousand Oaks, CA: Sage. 2002.

  10. Leutz, WN (1999). Five laws for integrating medical and social services: lessons from the United States and the United Kingdom. Milbank Quarterly 77(1): 77–110.

  11. World Health Organization. Declaration of Alma-Ata. Geneva: World Health Organization. 1978.

  12. Vasan, A Ellner, A Lawn, SD Gove, S Anatole, M Gupta, N et al. (2014). Integrated care as a means to improve primary care delivery for adults and adolescents in the developing world: a critical analysis of Integrated Management of Adolescent and Adult Illness (IMAI). BMC Medicine 12(1): 1–11.

  13. Lucas, PJ, Baird, J, Arai, L, Law, C and Roberts, HM (2007). Worked examples of alternative methods for the synthesis of qualitative and quantitative research in systematic reviews. BMC Medical Research Methodology 7(4): 1–7.

  14. Greenhalgh, T, Wong, G, Westhorp, G and Pawson, R (2011). Protocol-realist and meta-narrative evidence synthesis: evolving standards (RAMESES). BMC Medical Research Methodology 11(115): 1–10.

  15. Fitch, K, Bernstein, SJ, Aguilar, MD, Burnand, B and LaCalle, JR , . The RAND/UCLA Appropriateness Method User's Manual. Santa Monica, CA: RAND Corporation. 2001.

  16. DeMuro, PR (2011). 7 strategies for success in governing an ACO. Healthcare Financial Management 65(5): 78–82.

  17. Shields, MC, Patel, PH, Manning, M and Sacks, L (2011). A model for integrating independent physicians into accountable care organizations. Health Affairs 30(1): 161–72.

  18. Shields, M (2011). From Clinical Integration to Accountable Care. Annals of Health Law 20: 151–64.

  19. Bainbridge, D, Brazil, K, Krueger, P, Ploeg, J and Taniguchi, A (2010). A proposed systems approach to the evaluation of integrated palliative care. BMC Palliative Care 9(8): 1–12.

  20. Biro, LA, Moreland, ME and Cowgill, DE (2003). Achieving excellence in veterans healthcare—A balanced scorecard approach. Journal for Healthcare Quality 25(3): 33–9.

  21. Fleury, M (2006). Integrated service networks: the Quebec case. Health Services Management Research 19(3): 153–65.

  22. Meijboom, B, de Haan, J and Verheyen, P (2004). Networks for integrated care provision: an economic approach based on opportunism and trust. Health Policy 69(1): 33–43.

  23. Wan, TT and Wang, BB (2003). Integrated healthcare networks’ performance: a growth curve modeling approach. Health Care Management Science 6(2): 117–24.

  24. Amiel, JM and Pincus, HA (2011). The medical home model: new opportunities for psychiatric services in the United States. Current Opinion in Psychiatry 24(6): 562–8.

  25. Béland, F and Hollander, MJ (2011). Integrated models of care delivery for the frail elderly: international perspectives. Gaceta Sanitaria 25: 138–46.

  26. Blackmore, CC, Mecklenburg, RS and Kaplan, GS (2011). At Virginia Mason, collaboration among providers, employers, and health plans to transform care cut costs and improved quality. Health Affairs 30(9): 1680–7.

  27. Cohen, E, Bruce-Barrett, C, Kingsnorth, S, Keilty, K, Cooper, A and Daub, S (2011). Integrated complex care model: lessons learned from inter-organizational partnership. Healthcare Quarterly 14(Special Issue): 64–70.

  28. Evans, JM and Baker, GR (2012). Shared mental models of integrated care: aligning multiple stakeholder perspectives. Journal of Health Organization and Management 26(6): 713–36.

  29. Fann, JR, Ell, K and Sharpe, M (2012). Integrating psychosocial care into cancer services. Journal of Clinical Oncology 30(11): 1178–86.

  30. Minkman, M, Ahaus, K, Fabbricotti, I, Nabitz, U and Huijsman, R (2009). A quality management model for integrated care: results of a Delphi and Concept Mapping study. International Journal for Quality in Health Care 21(1): 66–75.

  31. Minkman, MM, Ahaus, KT and Huijsman, R (2009). A four phase development model for integrated care services in the Netherlands. BMC Health Services Research 9(42): 1–11.

  32. Minkman, MM, Vermeulen, RP, Ahaus, KT and Huijsman, R (2011). The implementation of integrated care: the empirical validation of the Development Model for Integrated Care. BMC Health Services Research 11(177): 1–10.

  33. Reilly, S, Challis, D, Burns, A and Hughes, J (2003). Does integration really make a difference? A comparison of old age psychiatry services in England and Northern Ireland. International Journal of Geriatric Psychiatry 18(10): 887–93.

  34. Strandberg-Larsen, M Schiøtz, ML Silver, JD Frølich, A Andersen, JS Graetz, I et al. (2010). Is the Kaiser Permanente model superior in terms of clinical integration?: a comparative study of Kaiser Permanente, Northern California and the Danish healthcare system. BMC Health Services Research 10(91): 1–13.

  35. Ueoka, A (2008). A systematic approach to combat healthcare improvement: task force 62 medical brigade combat healthcare support system mode. U.S. Army Medical Department Journal. Oct–Dec: 19–24.

  36. Visschedijk, J, Engelhard, A, Lever, P, Grossi, Maria Aparecida de Faria and Feenstra, P (2003). Leprosy control strategies and the integration of health services: an international perspective. Cadernos de saude publica 19(6): 1567–81.

  37. Zou, G, Wei, X, Walley, JD, Yin, J and Sun, Q (2012). Factors influencing integration of TB services in general hospitals in two regions of China: a qualitative study. BMC Health Services Research 12(21): 1–11.

  38. Antoncic, B and Prodan, I (2008). Alliances, corporate technological entrepreneurship and firm performance: testing a model on manufacturing firms. Technovation 28(5): 257–65.

  39. Axelsson, R and Axelsson, SB (2006). Integration and collaboration in public health—a conceptual framework. The International Journal of Health Planning and Management 21(1): 75–88.

  40. Bai, Y, Wells, R and Hillemeier, MM (2009). Coordination between child welfare agencies and mental health service providers, children's service use, and outcomes. Child Abuse & Neglect 33(6): 372–81.

  41. Castelnovo, W , ; Organizing E-government for small local government organizations. In: Mazzeo, A, Bellini, R and Motta, G eds. , editors. E-government; ICT professionalism. Boston, MA: Springer, 2008. p. 1.-10.

  42. Chan, FT, Yee-Loong Chong, A and Zhou, L (2012). An empirical investigation of factors affecting e-collaboration diffusion in SMEs. International Journal of Production Economics 138(2): 329–44.

  43. Clarke, A and Fuller, M (2010). Collaborative strategic management: strategy formulation and implementation by multi-organizational cross-sector social partnerships. Journal of Business Ethics 94(1): 85–101.

  44. Dunlop, JM and Holosko, MJ (2005). The story behind the story of collaborative networks–relationships do matter!. Journal of Health & Social Policy 19(3): 1–18.

  45. Garriga, E (2009). Cooperation in stakeholder networks: firms’‘Tertius Iungens’ role. Journal of Business Ethics 90(4): 623–37.

  46. Handfield, R, Petersen, K, Cousins, P and Lawson, B (2009). An organizational entrepreneurship model of supply management integration and performance outcomes. International Journal of Operations & Production Management 29(2): 100–26.

  47. Hirsch, B and Meyer, M (2010). Integrating soft factors into the assessment of cooperative relationships between firms: accounting for reputation and ethical values. Business Ethics: A European Review 19(1): 81–94.

  48. Huerta, TR, Casebeer, A and Vanderplaat, M (2006). Using networks to enhance health services delivery: perspectives, paradoxes and propositions. Healthcare Papers 7(2): 10–26.

  49. Kowalska, K (2007). Managed care and a process of integration in health care sector: a case study from Poland. Health Policy 84(2): 308–20.

  50. McGill, JP and Santoro, MD (2004). Managing value and vulnerability in complex collaborations: allying with competitors. Advances in Interdisciplinary Studies of Work Teams 10: 263–86.

  51. Minott, J, Helms, D, Luft, H, Guterman, S and Weil, H (2010). The group employed model as a foundation for health care delivery reform. The Commonwealth Fund 83: 1–24.

  52. Ngai, EW, Jin, C and Liang, T (2008). A qualitative study of inter-organizational knowledge management in complex products and systems development. R&D Management 38(4): 421–40.

  53. Ngai, EW, Chau, DC and Chan, T (2011). Information technology, operational, and management competencies for supply chain agility: findings from case studies. The Journal of Strategic Information Systems 20(3): 232–49.

  54. Olson, CA, Balmer, JT and Mejicano, GC (2011). Factors contributing to successful interorganizational collaboration: The case of CS2day. Journal of Continuing Education in the Health Professions (31): S3–S12.

  55. Paier, M and Scherngell, T (2011). Determinants of collaboration in European R&D networks: empirical evidence from a discrete choice model. Industry and Innovation 18(1): 89–104.

  56. Pettersen, IB and Rokkan, AI (2006). Buyer tolerance of conflict in cross-national business relationships: an empirical study. Advances in International Marketing 16: 213–43.

  57. Rocha, H and Miles, R (2009). A model of collaborative entrepreneurship for a more humanistic management. Journal of Business Ethics 88(3): 445–62.

  58. Sanders, NR (2007). An empirical study of the impact of e-business technologies on organizational collaboration and performance. Journal of Operations Management 25(6): 1332–47.

  59. Speir, AM, Rich, JB, Crosby, I and Fonner, E Jr (2009). Regional collaboration as a model for fostering accountability and transforming health care. Seminars in thoracic and cardiovascular surgery 21(1): 12–9.

  60. Vaccaro, A, Parente, R and Veloso, FM (2010). Knowledge management tools, inter-organizational relationships, innovation and firm performance. Technological Forecasting and Social Change 77(7): 1076–89.

  61. Wells, R and Weiner, BJ (2007). Adapting a dynamic model of interorganizational cooperation to the health care sector. Medical Care Research and Review 64(5): 518–43.

  62. Squire, B, Cousins, PD and Brown, S (2009). Cooperation and knowledge transfer within buyer–supplier relationships: the moderating properties of trust, relationship duration and supplier performance. British Journal of Management 20(4): 461–77.

  63. Choi, S and Ko, I (2012). Leveraging electronic collaboration to promote interorganizational learning. International Journal of Information Management 32(6): 550–9.

  64. Huotari, R (2008). Development of collaboration in multiproblem cases some possibilities and challenges. Journal of Social Work 8(1): 83–98.

  65. Huxham, C and Hibbert, P (2008). Manifested attitudes: intricacies of inter-partner learning in collaboration. Journal of Management Studies 45(3): 502–29.

  66. Jarvenpaa, SL and Majchrzak, A (2008). Knowledge collaboration among professionals protecting national security: Role of transactive memories in ego-centered knowledge networks. Organization Science 19(2): 260–76.

  67. Knoben, J and Oerlemans, LA (2012). Configurations of inter-organizational knowledge links: does spatial embeddedness still matter?. Regional Studies 46(8): 1005–21.

  68. Nolan, K, Schall, MW, Erb, F and Nolan, T (2005). Using a framework for spread: the case of patient access in the veterans health administration. Joint Commission Journal on Quality and Patient Safety 31(6): 339–47.

  69. Schulz, K and Geithner, S (2010). Between exchange and development: organizational learning in schools through inter-organizational networks. Learning Organization 17(1): 69–85.

  70. Fryers, M, Young, L and Rowland, P (2012). Creating and sustaining a collaborative model of care. Healthcare Management Forum 25(1): 20–25.

  71. Gagliardi, AR, Dobrow, MJ and Wright, FC (2011). How can we improve cancer care? A review of interprofessional collaboration models and their use in clinical management. Surgical Oncology 20(3): 146–54.

  72. Hastie, C and Fahy, K (2011). Inter-professional collaboration in delivery suite: a qualitative study. Women and Birth 24(2): 72–9.

  73. Hudson, B (2007). Pessimism and optimism in inter-professional working: the Sedgefield integrated team. Journal of Interprofessional Care 21(1): 3–15.

  74. Leech, R, van Wyk, N and Uys, C (2007). The management of infant developmental needs by community nurses-Part 1: description of the responsibilities of community nurses with regard to the management of infant developmental needs. Curationis 30(2): 91–103.

  75. Légaré, F Stacey, D Gagnon, S Dunn, S Pluye, P Frosch, D et al. (2011). Validating a conceptual model for an inter-professional approach to shared decision making: a mixed methods study. Journal of Evaluation in Clinical Practice 17(4): 554–64.

  76. Lough, ME and Klevay, AM (2012). Collaborative partnerships between critical care and psychiatry. Critical Care Nursing Clinics of North America 24(1): 81–90.

  77. Sicotte, C, D'Amour, D and Moreault, M (2002). Interdisciplinary collaboration within Quebec community health care centres. Social Science & Medicine 55(6): 991–1003.

  78. Stock, RD, Reece, D and Cesario, L (2004). Developing a comprehensive interdisciplinary senior healthcare practice. Journal of the American Geriatrics Society 52(12): 2128–33.

  79. Evans, MM and Alleyne, J (2009). The concept of knowledge in KM: a knowledge domain process model applied to inter-professional care. Knowledge and Process Management 16(4): 147–61.

  80. Morgan, S Smedts, A Campbell, N Sager, R Lowe, M Strasser, S et al. (2009). From the bush to the big smoke—development of a hybrid urban community based medical education program in the Northern Territory, Australia. Rural Remote Health 9(3): 1175.

  81. Olckers, L, Gibbs, TJ and Duncan, M (2007). Developing health science students into integrated health professionals: a practical tool for learning. BMC Medical Education 7(1): 45–52.

  82. Robinson, M, Anning, A and Frost, N (2005). ‘When is a teacher not a teacher?’: knowledge creation and the professional identity of teachers within multi-agency teams. Studies in Continuing Education 27(2): 175–91.

  83. Barceló, A Cafiero, E de Boer, M Mesa, AE Lopez, MG Jiménez, RA et al. (2010). Using collaborative learning to improve diabetes care and outcomes: The VIDA project. Primary Care Diabetes 4(3): 145–53.

  84. Pinto, A, Benn, J, Burnett, S, Parand, A and Vincent, C (2011). Predictors of the perceived impact of a patient safety collaborative: an exploratory study. International Journal for Quality in Health Care 23(2): 173–81.

  85. Pomietto, M, Docter, AD, Van Borkulo, N, Alfonsi, L, Krieger, J and Liu, LL (2009). Small steps to health: building sustainable partnerships in pediatric obesity care. Pediatrics 123(Suppl. 5): 308–16.

  86. D'Amour, D, Goulet, L, Labadie, J, Martín-Rodriguez, LS and Pineault, R (2008). A model and typology of collaboration between professionals in healthcare organizations. BMC Health Services Research 8(188): 1–14.

  87. Balmer, JT, Bellande, BJ, Addleton, RL and Havens, CS (2011). The relevance of the alliance for CME competencies for planning, organizing, and sustaining an interorganizational educational collaborative. Journal of Continuing Education in the Health Professions 31(S1): S67–S75.

  88. Kümpers, S, Mur, I, Hardy, B, Maarse, H and Raak, Av (2006). The importance of knowledge transfer between specialist and generic services in improving health care: a cross-national study of dementia care in England and The Netherlands. The International Journal of Health Planning and Management 21(2): 151–67.

  89. Briner, M, Kessler, O, Pfeiffer, Y, Wehner, T and Manser, T (2010). Assessing hospitals’ clinical risk management: development of a monitoring instrument. BMC Health Services Research 10(337): 1–11.

  90. Epping-Jordan, J, Pruitt, S, Bengoa, R and Wagner, E (2004). Improving the quality of health care for chronic conditions. Quality and Safety in Health Care 13(4): 299–305.

  91. Faulkner, J and Laschinger, H (2008). The effects of structural and psychological empowerment on perceived respect in acute care nurses. Journal of Nursing Management 16(2): 214–21.

  92. Gowen, CR III, Henagan, SC and McFadden, KL (2009). Knowledge management as a mediator for the efficacy of transformational leadership and quality management initiatives in US health care. Health Care Management Review 34(2): 129–40.

  93. Phillips, CB Pearce, CM Hall, S Travaglia, J de Lusignan, S Love, T et al. (2010). Can clinical governance deliver quality improvement in Australian general practice and primary care? A systematic review of the evidence. Medical Journal of Australia 193(10): 602–7.

  94. Thompson, DN, Wolf, GA and Spear, SJ (2003). Driving improvement in patient care: lessons from Toyota. Journal of Nursing Administration 33(11): 585–95.

  95. Ahgren, B (2012). The Art of Integrating Care: Theories Revisited. The Open Public Health Journal 5: 36–9.

  96. Minkman, M, Ahaus, K, Fabbricotti, I, Nabitz, U and Huijsman, R (2009). A quality management model for integrated care: results of a Delphi and Concept Mapping study. International Journal for Quality in Health Care 21(1): 66–75.

  97. Ahgren, B and Axelsson, R (2005). Evaluating integrated health care: a model for measurement. International Journal of Integrated Care [serial online] Aug 200531: 5.Available from: URN:NBN:NL:UI:10-1-100376.

  98. Bazzoli, GJ, Shortell, SM, Dubbs, N, Chan, C and Kralovec, P (1999). A taxonomy of health networks and systems: bringing order out of chaos. Health Services Research 33(6): 1683–717.

  99. Browne, G, Roberts, J, Gafni, A, Byrne, C, Kertyzia, J and Loney, P (2004). Conceptualizing and validating the human services integration measure. International Journal of Integrated Care [serial online] May 200419: 4.Available from: URN:NBN:NL:UI:10-1-100340.

  100. Shortell, SM, Gillies, RR and Anderson, DA (1994). The new world of managed care: creating organized delivery systems. Health Affairs 13(5): 46–64.

  101. Armitage, GD, Suter, E, Oelke, ND and Adair, CE (2009). Health systems integration: state of the evidence. International Journal of Integrated Care [serial online] Jun 200917: 9.Available from: URN:NBN:NL:UI:10-1-100558.

  102. Suter, E, Oelke, ND, Adair, CE and Armitage, GD (2009). Ten key principles for successful health systems integration. Healthcare Quarterly 13(Special Issue): 16–23.

  103. Shaw, S, Rosen, R and Rumbold, B , . What is integrated care? An overview of integrated care in the NHS. London: The Nuffield Trust. 2011.

  104. Lorig, KR and Holman, HR (2003). Self-management education: history, definition, outcomes, and mechanisms. Annals of Behavioral Medicine 26(1): 1–7.

  105. Barlow, J, Wright, C, Sheasby, J, Turner, A and Hainsworth, J (2002). Self-management approaches for people with chronic conditions: a review. Patient Education and Counseling 48(2): 177–87.

  106. Nolte, E and McKee, M , ; Integration and chronic care: a review. In: Nolte, E and McKee, M eds. , editors. Caring for people with chronic conditions: A health system perspective. Maidenhead: Open University Press, 2008. p. 64.-91.

  107. Mays, N, Pope, C and Popay, J (2005). Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. Journal of Health Services Research & Policy 10(1): 6–20.

  108. Campbell, SM, Hann, M, Roland, MO, Quayle, JA and Shekelle, PG (1999). The effect of panel membership and feedback on ratings in a two-round Delphi survey: results of a randomized controlled trial. Medical Care 37(9): 964–68.

  109. Fulop, N, Mowlem, A and Edwards, N , . Building integrated care: lessons from the UK and elsewhere. London: The NHS Confederation. 2005.

  110. Contandriopoulos, AP, Denis, JL, Touati, N and Rodriguez, C , . The integration of health care: dimensions and implementation. Working Paper N04-01. 2003. Groupe de Recherche Interdisciplinaire en sante (GRIS). Canada: University of Montreal. 2003.

  111. Delnoij, D, Klazinga, N and Glasgow, IK (2002). Integrated care in an international perspective: proceedings of the workshop of the EUPHA section Health Services research, EUPHA Annual Conference. Brussels 6–8 December [feature]. International Journal of Integrated Care [serial online] Apr 20021: 2.

  112. Greenhalgh, T, Robert, G, Macfarlane, F, Bate, P and Kyriakidou, O (2004). Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Quarterly 82(4): 581–629.

  113. Miller, WL, McDaniel, RR, Crabtree, BF and Stange, KC (2001). Practice jazz: understanding variation in family practices using complexity science. Journal of Family Practice 50(10): 872–80.

  114. Miller, WL, Crabtree, BF, McDaniel, R and Stange, KC (1998). Understanding change in primary care practice using complexity theory. The Journal of Family Practice 46(5): 369–76.

  115. Begun, JW, Zimmerman, B and Dooley, K , ; Health care organizations as complex adaptive systems. In: Mick, S and Wyltenbach, M eds. , editors. Advances in health care organization theory. San Francisco, CA: Jossey-Bass, 2002. p. 253.-288.

Figures and Tables

Figure 1. 

Flowchart of the literature search

Figure 2. 

Flowchart of the thematic analysis process

comments powered by Disqus