Introduction: While integrated care for diabetes mellitus type 2 has achieved good results in terms of intermediate clinical and process outcomes, the evidence-based knowledge on its implementation is scarce, and insights generalisable to other settings therefore remain limited.
Objective: This study protocol provides a description of the design and methodology of a mixed methods study on the implementation of integrated care for type 2 diabetes. The aim of the proposed research is to investigate the mechanisms by which and the context in which integrated care for type 2 diabetes has been implemented, which outcomes have been achieved and how the context and mechanisms have affected the outcomes.
Methods: This article describes a convergent parallel mixed methods research design, including a systematic literature review on the implementation of integrated care for type 2 diabetes as well as a case study on two Dutch best practices on integrated care for type 2 diabetes.
Discussion: The implementation of integrated care for diabetes type 2 is an under-researched area. Insights from this study could be applied to other settings as well as other chronic conditions to strengthen the evidence on the implementation of integrated care.
Diabetes mellitus type 2 has become a widespread problem in many Western societies. In 2010, the global diabetes prevalence among people aged 20–79 years was estimated at 6.4%; in the European Union and the Netherlands, prevalence in similar age groups was respectively 6% and 7% in the same year [1–3]. Due to these high prevalence rates, diabetes has a major impact on society in terms of the economic costs incurred by diabetes patients. Research indicates that 12% of global health expenditure was spent on diabetes in 2010 . European Union countries spent approximately 10% of their total health expenditure on diabetes in 2010 [2, 4] and in the Netherlands, 2–9% of total health expenditure was spent on diabetes care in 2010/2011, depending on the registration of co-morbidity and the extent to which diabetes-related complications are considered in the estimations [4, 5].
Previous systematic reviews have shown that integrated approaches to diabetes care can yield improvements in care delivery process as well as intermediate clinical outcome indicators. Benefits have been found for process indicators such as screening for retinopathy [6–8], foot lesions [6–8], periphal neuropathy , proteinuria , and monitoring of lipid concentrations  and glycated haemoglobin , as well as intermediate clinical outcome indicators such as glycated haemoglobin [6, 8–10], blood pressure [8, 11] and blood lipid control [10, 11]. In addition, previous systematic reviews have demonstrated the added value of integrated chronic care in terms of economic benefits . However, other reviews have shown no (significant) impact on the above process and outcome indicators [7, 13] or have disputed the clinical relevance of statistically significant findings .
There is still a lack of evidence regarding the question which integrated care programmes are effective in which circumstances. Despite the fact that several previous studies have pointed out the importance of studying implementation [14–16], all of the above shows that there is a disproportionate emphasis on the goal-achievement and effectiveness of integrated care for type 2 diabetes rather than the intricacy of the implementation. By stripping away all confounding factors so as to be able to study the intervention's pure effect on the outcome, researchers run the risk of proclaiming programme failures prematurely as well as being blinded to the actual determinants of success or failure .
This article describes the design of a mixed methods study on the implementation of integrated diabetes care, combining a literature review of international integrated diabetes care with a case study on two Dutch best practices on integrated care for type 2 diabetes. The aim of the proposed research is to identify the different contexts in which and mechanisms by which integrated care for type 2 diabetes has been implemented, to report the outcomes achieved and to investigate how the contexts and mechanisms have affected these outcomes. This study is part of Project INTEGRATE on ‘Benchmarking Integrated Care in Chronic and Age-related Conditions in Europe’, financed by the European Commission (project reference 305821). Project INTEGRATE aims to investigate the leadership, management and delivery of integrated care to help European care systems responding to the challenges of an ageing population and the increasing number of people living with chronic conditions [18, 19].
The proposed research focuses on the following four overall research questions:
A mixed methods design will be used for this study as this is the most appropriate research design for studying the implementation process as well as the outcomes of integrated care.
As Pawson and Tilley point out, classical methodologies usually focus on observations at two specific points in time, namely before the intervention and after the intervention . In order to increase the ability to attribute the differences observed post-intervention to the intervention itself (instead of ‘third variables’), most factors expected to have a confounding effect on the causal relationship are stripped away. However, for complex interventions, which can be seen as ‘dynamic complex systems thrust amidst complex systems’ , it is often precisely those factors left out of the equation which hold the most valuable information [17, 20].
To avoid this methodological pitfall, several qualitative methodologies will be used and combined with quantitative methods, which, according to Berwick, is an approach superior to the more classical methodologies such as randomised controlled trials . We decided to use a convergent parallel mixed methods design which involves concurrent implementation of the qualitative and quantitative research strands, equal prioritisation of the quantitative and qualitative methods, independent analysis of both strands with traditional methods and merging of strands during overall interpretation .
Specifically, the design includes a systematic literature review and a case study to be qualitatively analysed with an explicit focus on context, mechanisms and outcomes. Moreover, local wisdom will be emphasised by actively involving local stakeholders instead of excluding them for fear of bias . This will enable the researchers to access the stakeholders’ insights into the details of the implementation that might otherwise remain hidden from their view. In addition, for the case study, quantitative patient outcome data will be collected and analysed. After independent analyses, the qualitative and quantitative results will be combined for overall interpretation.
In order to determine which interventions can be considered integrated care, it is important to operationalise what we mean by integrated care. Given the quasi-universal acceptance of Wagner's chronic care model and its widespread use throughout the literature [23–25], we decided to link our understanding of integrated care to the chronic care model. In line with previous research, it was decided that if an intervention targets at least two of the four core chronic care model components, the intervention is to be considered integrated care [8, 26, 27].
When assessing whether a study is indeed concerned with integrated care, it is important to ensure that all researchers apply the same understanding of the components. Hence, it was decided to operationalise the four chronic care model components to be used for the review. This operationalisation is largely based on the checklist used in the ‘Developing and Validating Disease Management Evaluation Methods for European Health Care Systems’ project  and complemented by other definitions and examples of the chronic care model components in the literature [29–32]. Table 1 depicts the operationalisation of the chronic care model to be used in the literature review.
By ‘implementation’, we mean the bringing into practice of a model for change, which is always implemented by certain mechanisms and in a certain context. The specific terminology of ‘mechanism’ and ‘context’ used in this study is derived from Pawson and Tilley‘s work on realistic evaluation . Their main claim is that it is both the context in which an intervention is implemented (including the organisational, financial, political, technological and human constraints) as well as the mechanisms by which it is implemented (including assumptions of how change can be achieved) that will affect the outcomes that can be achieved by the intervention [20, 33]. This means that instead of asking whether an intervention worked, the purpose of realist enquiry is to identify the mechanisms and context and to find out which mechanisms work in which context to achieve which outcomes [20, 21, 33].
By ‘mechanism’ we mean the different types of integrated care for type 2 diabetes distinguished into ‘programmes’ and ‘interventions’. By ‘programme’ we mean a set of at least two interventions whose combined implementation is intended to lead to the achievement of a certain goal, often an improvement in the quality of care. By ‘intervention’ we mean the tangible actions that, combined, constitute a programme.
The context of implementation consists of implementation strategies and an implementation process. By ‘implementation strategies’ we mean information and plans concerning what to do to facilitate and improve the working of the change model in practice, explicitly formulated prior to the realisation of the model for change in practice. By implementation process, we mean the process of ‘social change’ triggered by the mechanisms, which inherently, is sensitive to a multitude of context factors that impact on this process . We describe the implementation process through the description of those factors encountered during the implementation process and explicitly identified by the stakeholders as barriers or facilitators to the implementation of the integrated diabetes care programme or intervention.
By ‘outcomes’ we mean the intended and unintended consequences triggered by mechanism and context, including both process outcome measures and intermediate clinical outcome measures. Process outcome measures include (but are not limited to): frequency of measurements of HbA1c/A1C, blood pressure, and lipids, frequency of patient consultations, recommendation to take aspirin, dilated retinal examinations, urine tests, statin therapy prescription and receipt of influenza vaccination. Intermediate clinical outcome measures include (but are not limited to): HbA1c/A1C, blood pressure and LDL values.
The literature review aims to provide answers to the research questions from an international perspective.
For the first research question, the integrated care programmes and interventions identified through the systematic literature search will be described in detail and classified according to the chronic care model as operationalised by the authors (see Table 1). For the second research question, qualitative analyses will be performed to summarise the strategies for as well as barriers and facilitators to the implementation of integrated care for type 2 diabetes, as identified in the literature. For the third research question, qualitative analysis will yield an overview of the outcomes of the integrated diabetes care programmes and interventions described in the literature. Finally, it will be investigated to what extent and in what way the implementation strategies and process affected the outcomes.
In order to find relevant articles, four groups of search terms will be created: (1) search terms related to the health condition, (2) search terms describing the type of intervention, (3) search terms related to the four chronic care model components and (4) the search term ‘implementation’ (see Table 2). The four groups of search terms will be connected with Bolean operators in such a way that articles concerned with diabetes and an integrated care type intervention (or combinations of two out of the four chronic care model components) and implementation will be retrieved. The databases Pubmed/Medline and Cochrane will be searched for eligible articles.
A total of three screening rounds will be performed based on readings of titles, abstracts and full texts. In each round, articles will be included based on the following inclusion criteria: (1) published between 2003 and 2013; (2) concerns integrated care; (3) focuses on type 2 diabetes or focusses on type 2 diabetes and one or more additional condition(s) and reports results for each condition separately.
Articles written in a language other than English or one of Project INTEGRATE's case study languages (German, Dutch, Spanish and Swedish) will be excluded. Articles with a target population consisting only of children, adolescents, prisoners or homeless persons will be excluded as they do not match the target population of the two Dutch case studies. Articles not concerning empirical research analysing the implementation of interventions will be excluded. Additionally, systematic reviews and meta-analyses will be excluded because these types of studies report results on a rather abstract level of evidence which might mask insights that are relevant for this implementation-focussed type of study. In all exclusion rounds, articles can be excluded for more than one reason. When in doubt or when the title or abstract does not give enough information to base a decision on, articles remain included.
The screenings will be performed by three independent researchers. To ensure a homogeneous selection, a checklist based on the above operationalisation of the chronic care model and the previously mentioned in- and exclusion criteria will be used by all researchers. After this, the results will be discussed in pairs in order to create agreement on the interpretation of the criteria. When in doubt or disagreement, discussions between the researchers will take place until consensus is achieved.
After the article selection, the included studies will be analysed. Data extraction and quality assessment for each article will be performed independently by three researchers using a standardised data extraction form to ensure uniformity. The following information will be extracted from the articles: general information (including author, year of publication and title), methodological information (including data collection methods, type of data collected, setting or context of data collection, follow-up period, population and participants, researcher's influence, data analysis, research questions and/or article objective, study limitations), information on the integrated care programme or intervention (including the name of the programme or intervention, its purpose and the specific interventions of which the programme consists), implementation strategies, barriers, facilitators and outcomes of the integrated care programme or intervention. Based on this information, the articles' quality will be assessed by using the 2011 version of mixed methods appraisal tool [34, 35]. The mixed methods appraisal tool is a unified tool that can be used for the simultaneous quality assessment of qualitative, quantitative and mixed methods studies . Despite its relative novelty, the mixed methods appraisal tool has already been used as a comprehensive quality assessment tool in various systematic reviews in the health sciences [36–38]. See Table 3 for a tabular overview of the quality aspects to be assessed per type of study.
After the extraction and assessment, the researchers will compare and discuss the forms until disagreements can be resolved by consensus.
Additionally, the implementation model by Grol and Wensing will be used for the categorisation of the context factors identified in the literature review . According to this model, barriers to and incentives for change occur at six different levels of health care, namely innovation, individual professional, patient, social context, organisational context, and economic and political context . Grol and Wensing's model has been used for the categorisation of barriers and facilitators to integrated care for diabetes type 2 in several previous studies [16, 40, 41].
The results from the literature review will be used as a context for the insights gained from the case study and will enable the identification of differences and commonalities between the international literature and the Dutch case.
In order to answer the research questions from the Dutch perspective, a case study on Dutch integrated diabetes care will be conducted at two separate case sites.
Two care groups will be invited to participate as best practice case sites in the case study research.
Care groups are legal entities with their own managerial and administrative staff, often (co-) owned by general practitioners, that cooperate with a variety of health care providers involved in the provision of chronic care.
The decision to focus on national best practices is based on the assumption that identifying success factors encountered by the frontrunners of diabetes care innovation will generate meaningful lessons for those that are now encountering or will still have to encounter similar barriers in the future. Moreover, focusing on best practices will generate an important potential for learning by other Dutch care groups, and given the Netherlands’ long experience in integrated care and status as a pioneer [42, 43], also for other European and non-European countries.
Despite the popularity and wide-spread use of best practices research, its use in scientific research is controversial, most notably due to the limited external validity of this case-based approach [44, 45]. Therefore, it should be noted that the authors define best practices as ‘best practices for the process of planning for most appropriate interventions for the setting and population’ . This definition entails that the envisaged outcome of best practices is not a generalisable plan but a generalisable process for planning .
The following criteria will be pivotal in the selection of the care groups: nomination as national best practices by leading health research institutions, participation in previous (diabetes) research; involvement in care innovation pilots such as those recently selected by the Dutch Minister of Health; and Welfare and Sport to be closely followed in the upcoming years .
Data from the two case sites will be collected by means of a document review, semi-structured interviews and routine health care data.
The documents will be provided by the two case sites' respective contact persons. Initially, the interviewers will request documents that cover the whole cycle of implementation, from the initial idea via planning, implementation, evaluation and adaptations to the current state of affairs. At a later stage, additional documents will be requested for those phases not adequately covered by the initial set of documents. The documents to be collected include regional policy documents, performance evaluation reports, annual reports, focus group reports, improvement plans, educational programmes and other documentation. The main purpose of the document review is as preparation for the interviews, to serve as illustration and for the triangulation of the interview results.
In addition to the document study and the collection of routine health care data, 25 interviews will be conducted for each case site. Interviews will be chosen as main method of data collection because their purpose is to gain an overview of the variations in perspectives and opinions and the circumstances that play a role . In addition, interviews are the preferred method of data collection when the research question refers to opinions and experiences (as opposed to actions) which only the interviewee can access , which is applicable to this case, especially regarding the barriers and facilitators encountered during the implementation process.
Of the 25 interviews to be conducted per care group (50 in total), 10 will be held with diabetes patients and the other 15 with care group directors, managers and staff as well as health care providers involved in the organisation and delivery of integrated diabetes care, including general practitioners, internists, diabetes nurse specialists, practice nurses, dieticians, pharmacists, optometrists, podiatrists and pedicurists. Precisely which persons and professions will be approached, will be decided in consultation with the care group contact persons. We expect that a heterogeneous sample including patients as well as all relevant health professions and care group staff involved in diabetes care will create as complete a picture as possible, consisting of many diverse perspectives, experiences and opinions.
Interviewees will be requested to sign an informed consent form, indicating that he or she has read the information leaflet and had the opportunity to ask questions, that he or she understands that the participation in the research is on a voluntary basis and can be revoked at any time, that he or she agrees to participate in the research and with the interview being audio-taped. All interviews will be audio-recorded and transcribed.
During the interviews, the interviewers will use a topic list to help the interviewer steer the conversation via predefined topics and initial questions . The topic list for the health professionals will focus on the areas of integrated care in general and in the interviewee's institution, implementation of integrated care, information technology, finance and sustainability of integrated care.
As previous research with patients suffering from chronic disease has shown the importance of giving patients the opportunity to tell their illness narratives [49–51], the patients’ topic list will focus on the patients’ personal experiences with their disease, their knowledge and experiences about integrated care and the care group they are a part of, the barriers and facilitators they encountered to their care as well as the health outcomes they achieved and how the former may have affected the latter. While establishing rapport between the interviewer and interviewee is important in all individual interviews, it is especially so for the more vulnerable target groups such as (elderly) patients. Therefore, the four stages of building rapport, namely apprehension, exploration, co-operation and participation, will be given special emphasis in the patient interviews .
In both cases, the number and nature of the sub-questions can vary, as can the pre-defined topics if considered necessary during the research process . Additional and follow-up interviews will be conducted until saturation is achieved regarding the scope and the detail of the research.
To assure the quality of the interviews conducted, a member check will be performed by sending a one page summary of each interview to the interviewees who will then be asked whether this summary reflects their point of view and statements made during the interview. In case of negative feedback by the interviewee, a follow-up interview will be scheduled for clarification.
To measure health outcomes, diabetes type 2 patients’ routine health care data will be collected. These will be provided by the care groups participating in the case study. They have access to the data from all diabetes type 2 patients in treatment by general practitioners who are members of the care group as the collection of these data in a common information technology system is a requirement for membership of the care group. Data will be collected for the period from 2008 (start of systematic data collection by the care groups via the electronic medical record) to 2014 (start of data collection by the researchers). The collected data include intermediate clinical outcome measures (e.g. glycated haemoglobin, low-density lipoprotein, systolic blood pressure and body mass index) as well as process outcome measures (measurements of glycated haemoglobin, low-density lipoprotein, systolic blood pressure and body mass index) [31, 53].
For the analysis of the interviews, the audio-recordings will be transcribed verbatim and coded independently by two researchers. Given the inherently iterative nature of qualitative research , the coding of the interview transcripts will be performed in three phases, namely open coding, axial coding and selective coding [54, 55].
In the open coding phase, which is characterised by its exploratory nature , two researchers will label fragments of the text material with descriptive as well as interpretive codes based on the interviewees’ own wording (in vivo codes) and prominent concepts from the literature study described above (constructed codes) [56, 57]. The second phase, axial coding, involves finding and describing important concepts and making a distinction between the more or less relevant codes so as to reduce the amount of material [55, 57]. In the selective coding phase, the researchers will start searching for explanations of the phenomena that were found as well as the relationships between different categories [55, 58].
All coding activities described above will be performed independently by two researchers. This will help to limit bias and assure the quality of the analysis as well as enable the development of a well-structured coding system . In addition, it helps to improve the validity and objectivity of the results . Disagreement will be resolved by consensus through bilateral discussions. All coding and analysis activities will be performed in Atlas.ti 6. Furthermore, as for the literature review, also for the case study, the implementation model by Grol and Wensing will be used for the categorisation of the context factors identified .
For the quantitative data, statistical analyses will be performed in SPSS 19. Multi-level analyses will be performed to describe the development of process and intermediate patient outcomes over time at baseline (t0) and yearly intervals until 2014 (t6). Moreover, the intermediate and process outcomes for each care group will be compared using analysis of variance. Sex, age, diabetes type and diabetes duration will be included as potential confounders.
As mentioned above, special emphasis will be put on the integration of qualitative and quantitative data, by comparing quantitative clinical data to qualitative patient stories and explaining how they relate to each other. Moreover, the results from the analysis of the interviews and document study will be triangulated with the results from the literature review. This entails that the results from the literature review will provide a context for interpretation of the case study results by providing the basis for the coding process of the interviews. This will enable us to give a combined answer to the same research questions, based on different sources of knowledge.
This paper presents the design of a mixed methods study to be conducted on the implementation of integrated care for type 2 diabetes. The chosen combination of methods of data collection and analysis will enable a thorough study of the mechanisms by which and contexts in which integrated care for type 2 diabetes has been implemented, which outcomes have been achieved and how the former affected the latter. Especially the combination of the international literature review and the national case study will provide added value through the triangulation of results and the provision of an international embedding of national research.
An important strength of this article is its grounding in different conceptual models, including Pawson and Tilley's realistic evaluation framework, the chronic care model and the implementation model, which all adopt a holistic approach to implementation analysis. While realistic evaluation makes it possible to study the links between the intervention, its implementation and outcomes achieved, the six chronic care model components and implementation model levels, respectively, make it possible to capture the whole range of inner local/organisational factors as well as outer national/regulatory factors. This is especially important given the Netherlands’ national set-up of integrated care via care groups and bundled-payment contracts which are implemented differently per local context. The authors believe that the interviewees to be selected for this study will be able to identify and elaborate on the links between the national/regulatory and local/organisational factors and connect them to the likelihood of a successful implementation in practice.
There are also some limitations to this prospective study which need to be taken into consideration. First, the decision to link the definition of integrated care to the chronic care model might blind the researchers to aspects of care integration that are not described by the chronic care model. The choice of the chronic care model, however, is based on its acceptance and use in the international literature as well as national practice, assuming that this indicates the model's scientific and societal relevance and applicability.
The second limitation concerns the decision to focus the literature search only on the four core elements of the chronic care model. By not actively searching for health system and community interventions, the search might miss publications of potential added value to the research. However, given the study's explicit focus on the implementation of programmes and interventions, the researchers feel the necessity to limit the search to the most tangible of interventions. It is likely that the programmes identified through the literature search will often also include aspects of the health system and community components even if they are not actively searched for.
The third limitation lies in the study's focus on best practices. Despite the many advantages this entails, focusing on best practices only means that the results from the prospective study will not provide any information about average Dutch diabetes care. By not including other care groups in the research, it will also not be possible to report the exact aspects in which the two selected case sites differ from other Dutch care groups and whether these differences might limit the external validity as well as applicability of the results to other care groups. The literature review, however, applies an international perspective and balances the focused perspective of the case study.
Systematic investigation of the implementation of integrated care is insufficiently highlighted. This research fills the gap in knowledge on how to best implement integrated care for type 2 diabetes, taking into account the specific mechanisms and contexts that affect the outcomes to be achieved. In doing so, this study will form the basis of tangible recommendations to health practitioners, managers and policy makers as to what can or should be implemented in which circumstances and what the expected results can be. Insights from this study could be applied to other settings as well as other chronic conditions to strengthen the evidence on the implementation of integrated care.
Katharina Viktoria Stein, Ph.D., Health Services Delivery Programme, Division of Health Systems and Public Health, WHO Regional Office for Europe, Copenhagen, Denmark.
One anonymous reviewer.
Shaw, JE, Sicree, RA and Zimmet, PZ (2010). Global estimates of the prevalence of diabetes for 2010 and 2030. Diabetes Research and Clinical Practice 87(1): 4–14.
Organisation for Economic Cooperation and Development , . Health at a Glance: Europe 2010. OECD Publishing. 2010. [cited 2013 Nov 29]. Available from: http://dx.doi.org/10.1787/health_glance-2010-en
Baan, C, Poos, M, Uiters, E and Savelkoul, M , . Hoe vaak komt diabetes mellitus voor en hoeveel mensen sterven eraan? [How often does diabetes mellitus occur and how many people die of it?]. Bilthoven: RIVM. 2013.
Zhang, P Zhang, X Brown, J Vistisen, D Sicree, R Shaw, J et al. (2010). Global healthcare expenditure on diabetes for 2010 and 2030. Diabetes Research and Clinical Practice 87(3): 293–301.
Nederlandse Diabetes Federatie , . NDF Dossier Diabetes en cijfers [Webpage on the internet]. [cited 2013 Nov 8]; updated 2013]. Available from: http://www.diabetesfederatie.nl/ndf-dossiers/ndf-dossier-diabetes-en-cijfers. [in Dutch]
Knight, K Badamgarav, E Henning, JM Hasselblad, V Gano, AD Ofman, JJ et al. (2005). A Systematic Review of Diabetes Disease Management Programs. The American Journal of Managed Care 11(4): 242–50.
Norris, SL Nichols, PJ Caspersen, CJ Glasgow, RE Engelgau, MM Jack, L Jr et al. (2013). The effectiveness of disease and case management for people with diabetes: a systematic review. American Journal of Preventive Medicine 22 4 Suppl: 15–38.
Elissen, AMJ Steuten, LMG Lemmens, LC Drewes, HW Lemmens, KMM Meeuwissen, JAC et al. (2012). Meta-analysis of the effectiveness of chronic care management for diabetes: investigating heterogeneity in outcomes. Journal of Evaluation in Clinical Practice 19(5): 753–62.
Pimouguet, C, Goff, ML, Thiébaut, R, Dartigues, JF and Helmer, C (2011). Effectiveness of disease-management programs for improving diabetes care: a meta-analysis. Canadian Medical Association Journal 183(2): E115–27.
Egginton, JS Ridgeway, JL Shah, ND Balasubramaniam, S Emmanuel, JR Prokop, LJ et al. (2012). Care management for Type 2 diabetes in the United States: a systematic review and meta-analysis. BMC Health Services Research 12(72)
Si, D, Bailie, R and Weeramanthri, T (2008). Effectiveness of chronic care model-oriented interventions to improve quality of diabetes care: a systematic review. Primary Health Care Research & Development 9(1): 25–40.
De Bruin, SR, Heijink, R, Lemmens, LC, Struijs, JN and Baan, CA (2011). Impact of disease management programs on healthcare expenditures for patients with diabetes, depression, heart failure or chronic obstructive pulmonary disease: a systematic review of the literature. Health Policy 101: 105–21.
Renders, CM, Valk, GD, Griffin, SJ, Wagner, E, Eijk, JTv and Assendelft, WJ (2001). Interventions to improve the management of diabetes mellitus in primary care, outpatient and community settings (Review). The Cochrane Database of Systematic Reviews 1
Mc Hugh, S, O'Mullane, M, Perry, IJ and Bradley, C (2013). Barriers to, and facilitators in, introducing integrated diabetes care in Ireland: a qualitative study of views in general practice. BMJ Open 3: 1–9.
Ling, T, Brereton, L, Conklin, A, Newbould, J and Roland, M (2012). Barriers and facilitators to integrating care: experiences from the English Integrated Care Pilots. International Journal of Integrated Care 12(129): 1–12. Available from: URN:NBN:NL:UI:10-1-113730
Goderis, G Borgermans, L Mathieu, C Van Den Broeke, C Hannes, K Heyrman, J et al. (2009). Barriers and facilitators to evidence based care of type 2 diabetes patients: experiences of general practitioners participating to a quality improvement program. Implementation Science 4(41)
Berwick, DM (2008). The Science of Improvement. Journal of the American Medical Association 299(10): 1182–4.
Goodwin, N (2013). How do you build programmes of integrated care? The need to broaden our conceptual and empirical understanding. International Journal of Integrated Care 13(July–September)Available from: URN:NBN:NL:UI:10-1-114748
Project Integrate , . Introduction. [webpage on the internet]. [cited 2013 Dec 11]; updated 2013]. Available from: http://www.projectintegrate.eu/
Pawson, R and Tilley, N , . Realistic Evaluation. London: SAGE Publications. 1997.
Pawson, R, Greenhalgh, T, Harvey, G and Walshe, K (2005). Realist review-a new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy 10 Suppl 1: 21–34.
Creswell, JW and Plano Clark, VL , . Designing and conducting mixed methods research. Thousand Oaks, California: SAGE Publications. 2011. Choosing a mixed methods design.
Wagner, EH, Austin, BT and Von Korff, M (1996). Organizing care for patients with chronic illness. The Milbank Quarterly 74(4): 551–44.
World Health Organization , . Global Report. 2002. Innovative care for chronic conditions: building blocks for action. Report No. 92 4 159 017 3. Contract No. WHO/MNC/CCH/02.01
Pan American Health Organization , . The Chronic Care Model. [Webpage on the internet]. [cited 2013 Dec 16]; updated 2013. Available from: http://www.paho.org/hq/index.php?option=com_content&view=article&id=8502&Itemid=39959
Drewes, HW Steuten, LM Lemmens, LC Baan, CA Boshuizen, HC Elissen, AM et al. (2012). The effectiveness of chronic care management for heart failure: meta-regression analyses to explain the heterogeneity in outcomes. Health Services Research 47(5): 1926–59.
Lemmens, KM Lemmens, LC Boom, JH Drewes, HW Meeuwissen, JA Steuten, LM et al. (2013). Chronic care management for patients with COPD: a critical review of available evidence. Journal of Evaluation in Clinical Practice 19(5): 734–52.
RAND (2012). DISMEVAL Developing and validating disease management evaluation methods for European healthcare systems: final report. RAND Cooperation. [cited 2013 Dec 20]. Available from: http://www.rand.org/content/dam/rand/pubs/technical_reports/2012/RAND_TR1226.pdf
Adams, SG, Smith, PK, Allan, PF, Anzueto, A, Pugh, JA and Cornell, JE (2007). Systematic Review of the Chronic Care Model in Chronic Obstructive Pulmonary Disease Prevention and Management. Archives of Internal Medicine 167(6): 551–61.
Improving Chronic Illness Care , . The Chronic Care Model. [webpage on the internet]. [cited 2013 Nov 8]; updated 2013]. Available from: http://improvingchroniccare.org/index.php?p=The_Chronic_Care_Model&s=2
Elissen, AMJ , . Going beyond the ‘grand mean’: advancing disease management science and evidence. Dissertation. Maastricht: Universitaire Pers Maastricht. 2013.
Stellefson, M, Dipnarine, K and Stopka, C (2013). The Chronic Care Model and diabetes management in US primary care settings: a systematic review. Preventing Chronic Disease 10: 120180.Available from: http://dx.doi.org/10.5888/pcd10.120180
Greenhalgh, T, Humphrey, C, Hughes, J, MacFarlane, F, Butler, C and Pawson, R (2009). How do you modernize a health service? A realist evaluation of whole-scale transformation in London. The Milbank Quarterly 87(2): 391–416.
Pace, R Pluye, P Bartlett, G Macaulay, AC Salsberg, J Jagosh, J et al. (2012). Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review. International Journal of Nursing Studies 49(1): 47–53.
Pluye, P, Gagnon, M-P, Griffiths, F and Johnson-Lafleur, J (2009). A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews. International Journal of Nursing Studies 46(4): 529–46.
Bluebond-Langner, M, Beecham, E, Candy, B, Langner, R and Jones, L (2013). Preferred place of death for children and young people with life-limiting and life-threatening conditions: a systematic review of the literature and recommendations for future inquiry and policy. Palliative Medicine 27(8): 705–13.
Langston, B, Armes, J, Levy, A, Tidey, E and Ream, E (2013). The prevalence and severity of fatigue in men with prostate cancer: a systematic review of the literature. Support Care Cancer 21(6): 1761–71.
Pedersen, VH, Armes, J and Ream, E (2012). Perceptions of prostate cancer in Black African and Black Caribbean men: a systematic review of the literature. Psycho-Oncology 21(5): 457–68.
Grol, R and Wensing, M (2004). What drives change? Barriers to and incentives for achieving evidence-based practice. Medical Journal of Australia 180 6 Suppl: S57–S60.
Jansink, R, Braspenning, J, van der Weijden, T, Elwyn, G and Grol, R (2010). Primary care nurses struggle with lifestyle counseling in diabetes care: a qualitative analysis. BMC Family Practice 11(41)
Vermunt, PW von Milder, E Wielaard, F Baan, CA Schelfhout, JD Westert, GP et al. (2013). Behavior change in a lifestyle intervention for type 2 diabetes prevention in Dutch primary care: opportunities for intervention content. BMC Family Practice 14: 78.
Antunes, V and Moreira, JP (2011). Approaches to developing integrated care in Europe: a systematic literature review. Journal of Management & Marketing in Healthcare 4(2): 129–35.
Nolte, E Knai, C Hofmarcher, M Conklin, A Erler, A Elissen, A et al. (2012). Overcoming fragmentation in health care: chronic care in Austria, Germany and the Netherlands. Health Economics, Policy and Law 7(1): 125–46.
Green, WG (2011). From Research to ‘Best Practices’ in Other Settings and Populations. American Journal of Health Behavior 25(3): 164.
Bretschneider, S, Marc-Aurele, FJ Jr and Wu, J (2005). ‘Best Practices’ research: a methodological guide for the perplexed. Journal of Public Administration Research and Theory 15(2): 307–23.
Minister of Health Welfare and Sport (2013). Brief van de Minister van Volksgezondheid, Welzijn en Sport aan de Voorzitter van de Tweede Kamer der Staten-Generaal. . [Letter from the Minister of Public Health, Welfare and Sport to the Chairperson of the Second Chamber]. Ministry of Health Welfare and Sport, Report No. 32 620, nr. 85 [in Dutch]
Hijmans, E and Kuyper, M , ; Het halfopen interview als onderzoeksmethode. In: Lucassen, PLBJ and Hartman, TCo eds. , editors. Kwalitatief onderzoek: Praktische methoden voor de medische praktijk [Qualitative research: practical methods for medical practice]. Houten: Bohn Stafleu van Loghum, 2007. p. 43.-51.[in Dutch]
Hak, T , ; Waarnemingsmethoden in kwalitatief onderzoek. In: Lucassen, PLBJ and Hartman, TCo eds. , editors. Kwalitatief onderzoek: Praktische methoden voor de medische praktijk [Qualitative research: Practical methods for medical practice]. Houten: Bohn Stafleu van Loghum, 2007. p. 13.-25.[in Dutch]
Werner, A, Widding Isaksen, L and Malterud, K (2004). ‘I am not the kind of woman who complains of everything’: Illness stories on self and shame in women with chronic pain. Social Science & Medicine 59: 1035–45.
Hunt, LM, Valenzuela, MA and Pugh, JA (1998). Porque me toco a mi? Mexican American diabetes patients’ causal stories and their relationship to treatment behaviors. Social Science & Medicine 48(8): 959–69.
Allegretti, A, Borkan, J, Reis, S and Griffiths, F (2010). Paired interviews of shared experiences around chronic low back pain: classic mismatch between patients and their doctors. Family practice 27: 676–83.
DiCicco-Bloom, B and Crabtree, BF (2006). The qualitative research interview. Medical Education 40: 314–21.
De Bruin, SR, van Oostrom, SH, Drewes, HW, de Jong-van Til, JT, Baan, CA and Struijs, JN (2013). Quality of diabetes care in Dutch care groups: no differences between diabetes patients with and without co-morbidity. International Journal of Integrated Care 13Available from: URN:NBN:NL:UI:10-1-114765
Wester, F , ; Analyse van kwalitatief onderzoeksmateriaal. In: Lucassen, PLBJ and Hartman, TCo eds. , editors. Kwalitatief onderzoek: Praktische methoden voor de medische praktijk [Qualitative research: practical methods for medical practice]. Houten: Bohn Stafleu van Loghum, 2007. p. 85.-95.[in Dutch]
Boeije, H , . Analyseren in kwalitatief onderzoek: Denken en doen [Analysis in qualitative research: thinking and doing]. Den Haag Boom Lemma uitgevers. 2012. [in Dutch]
Blokstra, A Vissink, P Venmans, L Holleman, P van der Schouw, Y Smit, H et al. , . Measuring the Netherlands: a monitoring study of risk factors in the general population, 2009–2010. Bilthoven: RIVM. 2011. [cited 2013 Dec 20]. Available from: http://www.rivm.nl/Documenten_en_publicaties/Wetenschappelijk/Rapporten/2012/januari/Nederland_de_Maat_Genomen_2009_2010_Monitoring_van_risicofactoren_in_de_algemene_bevolking
Charmaz, K , . Constructing grounded theory: a practical guide through qualitative analysis. London: SAGE Publications. 2006.
De Blok, SA , . Modular care provision: a qualitative study to advance theory and practice [Dissertation]. Tilburg: Tilburg University. 2010.