Co-production is seen as a promising tool for dealing with challenges in the health sector [1, 2, 3]. The rates of chronic diseases are growing, as well as the expectations of patients regarding the quality of services . This puts the healthcare systems under pressure to contain costs without detracting from the high quality of care. To this end, policy makers (e.g. ) have promoted the development of a more personalised care based on new relational models, in which patients, their informal carers, and local communities share responsibilities with care providers, thus enabling them to feel part of the team and more willing to continue self-care after discharge. In the last months, this need has appeared even more crucial due to the COVID-19 outbreak and the consequent risks [6, 7, 8].
“the processes through which inputs, used to provide a good or a service, are contributed by individuals who are not in the same organization” [11, p. 1073].
At that point, the attention to co-production had declined until the arrival of the global financial crisis (i.e. 2008 and 2009), when pluralistic models of governance and the sense of community found favour as a concept again . Theoretical and empirical contributions on the topic have increased significantly in the past decade, and co-production has been investigated in different disciplines and applied in numerous policy sectors [2, 13]. Nonetheless, there is still a lack of consensus on many aspects, such as: the actors involved (only service users or any external organisations), the phases of the process (many or few steps of the service cycle: co-commissioning, co-design, co-delivery, and co-assessment), the nature of the involvement (only voluntary or also involuntary) [13, 14]. The consequence is that the concept lacks a unique definition .
In public service literature, co-production is broadly understood as the active involvement of lay actors (individual users, groups of users, or communities) partnering with professionals in any phase of the public service cycle (e.g. [12, 15, 16]) or just during the implementation phase (e.g. [13, 17]).
In service management literature, co-production is assumed to be one of the most important elements of value co-creation, and, specifically, it concerns the customer participation, involvement, and engagement in the production (i.e. co-design or shared delivery) of goods and services [18, 19, 20].
Despite this vagueness of boundaries, scholars agree in considering healthcare to be one of the most theoretical and empirically promising application fields for co-production [2, 20]. Batalden [21, p. 2] describes co-production of health as:
“the interdependent work of users and professionals who are creating, designing, producing, delivering, assessing, and evaluating the relationships and actions that contribute to the health of individuals and populations”.
Thus, according to this definition and the broad understanding of the concept in public and service management literature, health co-production is considered as a wide variety of activities in which health providers (public or private) and health consumers (patients and/or carers or communities) voluntarily work together to produce some benefits in any phase of the service cycle (i.e. commissioning, design, delivery, and assessment). In this variety of activities, health co-production includes for instance, the shared work of clinicians and health consumers working together to improve healthcare processes and systems (e.g. [22, 23]) such as: the co-delivery of learning/training activities by professionals and experts by experience (e.g. [24, 25]) and patients’ councils in health organisations collaborating in strategic decisions (e.g. [26, 27]). Our preference for the term ‘health provider’ in the definition rather than ‘professionals’ allows us to go beyond the dyadic dimension (i.e. the ‘doctor–patient relationship’) and to move into a system dimension able to consider the managerial and organisational implications of co-production [28, 29].
Health co-production can be affected by the healthcare general context, that includes variables belonging to the environment which can create opportunities or constrains, affecting how the co-produced initiative unfolds . Moreover, the type of co-produced service (e.g. acute vs chronic care) and the service delivery channel (e.g. community-based primary care vs hospital/specialist care) can influence the variation in propensity to co-produce of health care provider and health consumers . If the process has been largely standardized by the service provider and the exchanges between providers and patients are limited in terms of number and time (e.g. acute care in hospital setting), the patient has limited opportunities to provide useful resources for improving the existing understanding of the illness and treatment procedures. Instead, if a service required an extended involvement of patients during time and the effectiveness of treatment can benefit from their experience and knowledge about the disease (e.g. ongoing and chronic illnesses), the provider and patient would be more willing and able to co-produce, exerting a greater impact on care process’s results . In this direction, a recent bibliometric analysis on co-production studies in health  highlights that the elderly is the most investigated target, as it is the most critical segment of the population in terms of chronicity and comorbidity and with greater health and social care needs.
There is an increasing interest in the potential benefits of co-production on the healthcare system. So far, research reports positive impacts on providers, in terms of services’ effectiveness, efficiency, innovativeness, and personalisation [26, 33, 34]; on users, in terms of increasing wellbeing, quality of life, satisfaction, self-esteem, self-confidence, and empowerment (e.g. [23, 24, 34]); and on clinicians, in terms of learning, increased empathy, better relationships with patients and job satisfaction (e.g. [24, 33, 35]). However, co-production is not a panacea . The collaboration among actors may be partially or totally unsuccessful, producing negative or inconsistent results on the users, providers, and professionals involved (e.g. [33, 37, 38]). The literature has also highlighted that a successful co-production could be affected by manifold lay actors’ and providers’ determinants, such as patients’ and clinicians’ skills, competences, and personal motivations or the organisational ability to manage the co-produced activity (e.g. [3, 35, 39, 40]).
Despite the growing number of publications, there is a need to further investigate the effects of co-production in healthcare [20, 32, 41]. First, the large majority of existing studies are single exploratory or narrative case or qualitative studies where the impacts are assessed only using in-depth or semi-structured interviews, with limitations in terms of internal and external validity  and in terms of risk of common method bias when data are gathered from a single stakeholder. Moreover, many studies have adopted self-reported questionnaires, but very few with validated scales and large samples [43, 44]. These methodological choices make the results hardly generalisable. Second, the majority of studies have assumed a mono-dimensional and a mono-stakeholder approach and lack a comprehensive evaluation of the co-production. Third, despite the fact that co-production in the co-design phase or in learning/training activities has been widely investigated, very few studies have been carried out on the co-delivery of care .
With the aim of filling these gaps, this paper presents a research protocol aimed at evaluating the determinants and the overall impacts of a co-produced service, by analysing a co-delivered chronic care treatment (i.e. outpatient parenteral antimicrobial therapy, hereafter OPAT) in the primary Adult Cystic Fibrosis (CF) Centre of a large academic hospital in Italy. To this end, a generalisable evaluation framework has been developed, including dimensions usually neglected in existing literature (i.e. managerial and organisational).
OPAT is a potentially useful method for delivering intravenous antimicrobials in the outpatient setting . First adopted in the USA in the mid-1970s, the need for OPAT has been progressively recognized in Canada, UK, Australia, New Zealand, and European countries. Currently, OPAT is used to treat a wide range of infections, including soft tissue infections, osteomyelitis, endocarditis, and pulmonary exacerbations of cystic fibrosis (CF). CF has proven to be one the most suitable settings where OPAT can be applied and studied . CF is a genetic disease, dominated by pulmonary symptoms and the establishment of chronic pulmonary infections with bacteria . A large increase in the adult CF population is expected in the next decade . To date, the therapeutic goal in CF is to slow down the progression of the disease, in order to safeguard the patients’ survival into adulthood. According to Burgel and colleagues, western European countries’ forecasts indicate that the 50% increase in the overall number of CF patients by 2025 corresponds to an increase by 75% in the adult population . Acute exacerbations of chronic respiratory infection are fought through an antibiotic treatment, that can be delivered by three routes: oral, inhaled aerosol, or intravenous. In the presence of severe exacerbations, intravenous therapy can be required on average for 10–14 days but, especially in the more advanced stages of the disease, longer times may be necessary . Hence, the option of OPAT offers CF patients the opportunity to undergo the needed antibiotic treatment at home, with less of an impact on daily life in comparison to the inpatient option. There are several service models for administering OPAT, but typically long-term patients carry out at least a portion of needed therapy at home, after hospital discharge and having received specific training . OPAT requires multiple steps of coordination and integration of care between patients/caregivers and several professionals/healthcare providers . During the home treatment period, home care assistance, general practitioners and/or hospitals collaborate with patients at different levels. They can monitor patients’ care progress, provide medications, draw blood, and provide catheter care. In this regard, existing literature stresses the importance of delivering OPAT programmes through coordinated and multidisciplinary professionals and organisations [51, 52].
Thus, from a managerial point of view, OPAT can be considered an example of co-produced treatment that specifically involves users in the co-delivery of the service . Patients are asked to participate actively and act as co-producers of their care, assuming the tasks of delivering the antibiotic treatment at home, recognising and promptly communicating adverse reactions, and contributing to effective interactions with clinicians at various levels . Co-production in chronic patients, such as CF adult patients, involves learning some skills and self-management strategies (see Schulman et al. (2013) ), but it goes far beyond self-management. OPAT is not simply a standard daily routine, but requires a transformation of the service delivery model, in order to ensure on the one hand, the integration of care, and on the other, the active participation of patients/co-producers and their caregivers.
Evidence claims that OPAT, when compared to inpatient treatment, allows a decrease of hospital admission costs and length of stay, and turns out to be safe and clinically effective, offering also benefits in terms of reduced hospital-acquired infections [45, 55, 56]. Some qualitative studies found a generally high satisfaction of patients’ with OPAT. At the same time, they raised some critical issues on safety and the need to improve patient-centeredness in OPAT care, taking into account more the patients’ personal and material resources to effectively support self-management at home [49, 57].
The enthusiasm for OPAT must then be cautioned; it is a complex practice to manage both from a clinical and organisational point of view. Antibiotic administration carries some risks; it is potentially toxic. Successful co-production of OPAT requires frequent and attentive involvement from healthcare providers deeply and at multiple levels (multidisciplinary health professionals, different care settings, etc.) and requires a strong patient committed effort in the co-production of the treatment. Consequently, health providers and staff are dealing with two important managerial challenges: (i) setting and running the delivery processes, coordinating the interdependency between both organisational, professional, and patient’s tasks; and (ii) getting the patient to be engaged in the healthcare plan .
The main research question is ‘what are the determinants and the overall impacts of the OPAT co-produced treatment for CF patients in comparison to traditional treatment?’ To answer this research question, the study that will be performed will address two main objectives:
The evaluation of the determinants and the impacts/outcomes of co-produced OPAT treatment compared to those of traditional inpatient treatment will be the primary aim of the study.
The COM-B model framework will be adopted for the analysis. This model proposes that the change of behaviour is affected by capability, opportunity, and motivation . It has been effectively used in health research to categorise the determinants of co-production (e.g. [40, 59]). In this study, the model will be adjusted (i) adding the performance according to the three main relevant dimensions which emerged from literature on co-production (clinical, economic, and organisational) and (ii) considering the three main stakeholders involved in a co-produced health service (hospital/providers, professionals, and patients and their caregivers) (Figure 1).
The study will also aim to evaluate the longitudinal impacts/outcomes of a new OPAT procedure, which will be introduced shortly in the investigated hospital and which is intended to formalise eligibility criteria and the pathway for the treatment of CF patients in order to increase the accessibility to this promising treatment. The same operationalisation described in Aim 1 will be used.
The research is a single case study. Given the two aims, the study will be designed according to two research approaches:
The study will be conducted at the Respiratory Unit and Adult Cystic Fibrosis Centre Fondazione IRCCS Ca’ Granda Ospedale Maggiore Policlinico (subsequently referred to as ‘the Centre’ or ‘CF Centre’). This is a regional reference centre for CF in Lombardy and holds a high number of clinical records compared to the national average. The Centre cares for approximately 320 patients with CF and is home to a wide array of experimental research and clinical trials. It started to adopt the OPAT approach in 1995. The CF Centre is staffed with a multidisciplinary team that includes five physicians, three nurses, three physiotherapists, two dieticians, one social worker, and one psychologist. Patients will be invited to participate in the study during their routine clinical journey, hospitalisation, and in day-hospital or outpatient settings. The staff will be involved during working hours, in a way that is compatible with their working requirements.
Specifically, the co-production process in OPAT at the CF Centre always starts during hospitalisation, then it can continue at home if patients meet a number of predefined criteria (which involve clinical and non-clinical personal and social aspects of the patient’s life, and the presence of adequate local health units). These criteria, as well as the patient’s willingness to carry out therapy at home, are also assessed through a productive dialogue and information exchange between a multidisciplinary physicians’ team and patients. If patients are enrolled, during the hospitalisation, specialist nurses carry out training sessions in which patients and caregivers are provided with the knowledge and skills needed to self-deliver an intravenous antimicrobial in the outpatient setting and to identify/manage any adverse reactions. Vascular access devices are inserted by specialists of another hospital unit (PICC-TEAM). Before and after the discharge, the coordination and the integration between CF Centre and local health is essential. Before the discharge, the CF centre (i) contacts the local health unit in order to supply patients with the devices needed and drugs for the therapy; (ii) activates home care assistance that guarantees a visit by a district nurse every day and informs the general practitioner of the patient’s situation; (iii) schedules with the patient the date for a periodic follow-up at the CF Centre or in a local walk-in centre. The OPAT process may be interrupted due to adverse drug reactions or malfunctions of intravenous access, and patients may be forced to be hospitalised (Figure 2).
The target population will include adult patients who need the intravenous antibiotic therapy at least once, and their caregivers and staff, both clinical and managerial (Figure 3). In consideration of the critical issues of the transition process from paediatric care (where OPAT is a parents-directed care) to adult care (where OPAT can be considered a co-produced treatment), we have decided to exclude patients under transition process from paediatric to the adult unit or who have been actively followed up in the adult unit for less than two years. Moreover, we exclude patients who never required intravenous antibiotic therapy or refuse to participate in the study.
The expected patients sample size is estimated according to 2018 data and amounts to 110 patients hospitalised for intravenous therapy. Approximately 35 adults will be assigned to OPAT and 75 to inpatient intravenous therapy. One caregiver per patient will be invited to participate. We will ask to the patient to indicate at least one informal (family member, friends) or formal caregiver who provides the stable assistance during OPAT.
Patients eligible for inclusion in the study will receive a copy of the patient information sheet, which will provide details on the purpose of the study and the type of clinical information collected. Once patients have had the opportunity to consider and understand the significance of their participation, they will be asked to provide their written informed consent. The participation will be voluntary, refusal to participate will involve no penalty or loss of benefits, and the subject may discontinue participation at any time without penalty or loss of benefits to which the subject is otherwise entitled. The study will be performed in accordance with the Helsinki Declaration, the version adopted by the 18th World Medical Assembly in June 1964 and its subsequent amendments, as well as the International GCP and applicable regulatory requirements.
The study will include all the CF Centre clinician staff and the hospital managerial staff (i.e. the Chief Executive Officer, the Director of Clinical Practice, the Chief Administrative Officer, the Chief Information Officer, the Chief Operating Officer, the Chief Nursing Officer, and the Director of Medicine). Inclusion and exclusion criteria are summarised in Table 1.
|SAMPLE||INCLUSION CRITERIA||EXCLUSION CRITERIA|
(and their caregivers)
|Professionals (clinicians and hospital manager)||
According to co-production literature, the specific context of cystic fibrosis, and the research aims, the adapted COM-B model has been operationalised as follows:
Determinants include patients/caregivers, staff, providers, and system factors that can foster or hinder OPAT adoption. Specifically:
Performance concerns the impacts of OPAT on patients/caregivers, staff, and providers, from a:
The specific measures will be identified through literature review. The appropriateness of questions to the target population and the comprehensibility of the instructions will be tested with a preliminary pilot study with a small sample of eight patients and three staff members.
The study will adopt a mixed methods approach , that will increase the breadth and range of study findings, capturing relevant information that might be missed by relying on only one research method and which will in general, enhance and strengthen the research results [62, 63].
Specifically, data will be collected through (a) interviews with patients, caregivers, and clinical/managerial staff; (b) a survey administered to patients, caregivers, and clinical/managerial staff; (c) biological samples of patients (sputum); and (d) archival sources. Then, the following qualitative and quantitative analyses will be performed:
Specifically, to accomplish Aim 1 – The evaluation of the determinants and the impacts/outcomes of co-produced OPAT treatment compared to those of the traditional inpatient treatment, a cross-sectional study comparing OPAT with inpatient therapy will be developed using content analysis and descriptive and inferential statistics to evaluate the determinants (capability, motivation and opportunity); while, content analysis, descriptive and inferential statistics, cost evaluation analysis, microbiome analysis and desk analysis on archival data to evaluate the performance. To address Aim 2 – The evaluation whether and how new procedure impacts on the dimensions and stakeholders of the model a longitudinal study comparing OPAT before and after new procedure will be performed, using content analysis and descriptive and inferential statistics referring to the determinants, while content analysis, descriptive and inferential statistics, cost evaluation analysis and desk analysis on archival data to evaluate the performance.
Table 2 summarises objectives, variables, and methods of analysis.
|AIMS||STUDY DESIGN||VARIABLES (COM-B MODEL)||METHODS|
||Cross-sectional study, comparing OPAT with inpatient therapy||
||Longitudinal study, comparing OPAT before and after new procedure||
The study will aim to analyse and evaluate a co-production practice (home antibiotic therapy— OPAT) in an Italian primary centre for cystic fibrosis.
Findings are expected to show co-production is beneficial for both provider and patients/caregivers, in terms of a perceived increase of patients’ quality of life and well-being, patient satisfaction, efficiency (cost-savings), and effectiveness of care. Moreover, some challenges will be expected to be found in organisational dimensions for staff and provider.
The research is innovative at different levels. At a conceptual level, (i) OPAT is interpreted as a co-produced process involving healthcare providers and consumers. To the best of our knowledge, this issue appears as a novelty; (ii) the study develops a comprehensive framework for the overall assessment of co-production in health. The evaluation framework assumes a multi-dimensional (clinical, economic, organisational) and multi-stakeholder (provider, staff, patients/caregivers) approach, overcoming literature limitations on the analysis of impacts of co-production in health service delivery mainly focussed on specific stakeholders (e.g. impacts on patients) or dimensions (e.g. economic) or phases other than the co-delivery of care (e.g. learning/training).
At methodological level, the case study goes beyond widely used narrative single perspective qualitative research, since it proposes several multi-stakeholder’s data collection methods (interviews and surveys to patients, staff, caregivers; biological samples and archival sources) that will allow rival explanation, triangulation and logic model, thus strengthening the validity and generalizability of the study . Furthermore, the study combines qualitative evidence, with quantitative descriptive and inferential statistics on questionnaires administered to patients, caregivers, and professionals.
At an empirical level, looking at the literature on OPAT, the study presents some elements of originality:
Accordingly, the findings can offer new insights both on the role of co-production in the health sector and on the OPAT management of CF patients. Moreover, the evaluation model could be applied to other co-produced health practice.
Despite these contributions, the study presents some limitations concerning the chosen design and sample size. First, the data will be drawn from a single centre. Moreover, although the centre is one of the largest in Italy and despite broad inclusion criteria, the target population (patients and staff) is quite limited. So, the generalisability of the findings should take place with some prudence. For this reason, future research directions will have to replicate the model in different centres and clinical contexts (e.g. other pathologies already using OPAT).
The study combines a typically managerial perspective (co-production) with a clinical perspective (OPAT therapy). It is expected to make a useful contribution both in academic and practical knowledge. It represents the first attempt to develop and empirically adopt a systematic analytical framework for the overall evaluation of the co-production of healthcare. Moreover, it will provide policy makers and healthcare managers with a practical assessment tool for supporting decision-making processes and the management of the co-delivery of healthcare service with patients, caregivers, and other stakeholders of the healthcare service network, by improving the understanding of impacts of co-produced practices.
The authors acknowledge support from the University of Milan through the APC initiative.
Denita Cepiku, Associate professor, University of Rome Tor Vergata, Italy.
One anonymous reviewer.
The authors have no competing interests to declare.
Dunston R, Lee A, Boud D, Brodie P, Chiarella M. Co-production and health system reform – From re-imagining to re-making. Aust J Public Adm. 2009; 68(1): 39–52. DOI: https://doi.org/10.1111/j.1467-8500.2008.00608.x
Voorberg WH, Bekkers VJJM, Tummers LG. A Systematic Review of Co-Creation and Co-Production: Embarking on the social innovation journey. Public Manag Rev. 2015; 17(9): 1333–57. DOI: https://doi.org/10.1080/14719037.2014.930505
McMullin C, Needham C. Co-production in Healthcare. In: Brandsen T, Steen TPS, Verschuere B (eds.), Co-Production and Co-Creation: Engaging Citizens in Public Services. New York: Routledge; 2018. p. 151–9. DOI: https://doi.org/10.4324/9781315204956-22
OECD. Government at a Glance 2019. Paris: OECD Publishing; 2019. DOI: https://doi.org/10.1787/8ccf5c38-en
Hollander JE, Brendan G, Carr MD. Virtually Perfect? Telemedicine for Covid-19. New Engl J Med. 2020; 382(18): 1679–81. DOI: https://doi.org/10.1056/NEJMp2003539
Colombo C, Burgel G, Gartner S, van Koningsbruggen-Rietschel S, Naehrlich L, Sermet-Gaudelus I, et al. Impact of COVID-19 on people with cystic fibrosis. Lancet Respir. 2020; 8: 35–6. DOI: https://doi.org/10.1016/S2213-2600(20)30177-6
Cepiku D, Giordano F, Bovaird T, Loeffler E. New development: Managing the Covid-19 pandemic—from a hospital-centred model of care to a community co-production approach. Public Money Manag. 2021; 41(1): 77–80. DOI: https://doi.org/10.1080/09540962.2020.1821445
Whitaker GP. Coproduction: Citizen Participation in Service Delivery. Public Adm Rev. 1980; 40(3): 240. DOI: https://doi.org/10.2307/975377
Parks RB, Baker PC, Kiser L, Oakerson R, Ostrom E, Ostrom V, et al. Consumers as coproducers of public services: some economic and institutional considerations. Policy Stud J. 1981; 9(7): 1001–11. DOI: https://doi.org/10.1111/j.1541-0072.1981.tb01208.x
Ostrom E. Crossing the great divide: Coproduction, synergy, and development. World Dev. 1996; 24(6): 1073–87. DOI: https://doi.org/10.1016/0305-750X(96)00023-X
Nabatchi T, Sancino A, Sicilia M. Varieties of Participation in Public Services: The Who, When, and What of Coproduction. Public Adm Rev. 2017; 77(5): 766–76. DOI: https://doi.org/10.1111/puar.12765
Brandsen T, Honingh M. Definitions of Co-Production and Co-Creation. In: Brandsen T, Steen TPS, Verschuere B (eds.), Co-Production and Co-Creation: Engaging Citizens in Public Services. New York: Routledge; 2018. DOI: https://doi.org/10.4324/9781315204956
Brandsen T, Honingh M. Distinguishing Different Types of Coproduction: A Conceptual Analysis Based on the Classical Definitions. Public Adm Rev. 2016; 76(3): 427–35. DOI: https://doi.org/10.1111/puar.12465
Bovaird T, Loeffler E. From Engagement to Co-production: The Contribution of Users and Communities to Outcomes and Public Value. Voluntas. 2012; 23(4): 1119–38. DOI: https://doi.org/10.1007/s11266-012-9309-6
Osborne SP, Radnor Z, Strokosch K. Co-Production and the Co-Creation of Value in Public Services: A suitable case for treatment? Public Manag Rev. 2016; 18(5): 639–53. DOI: https://doi.org/10.1080/14719037.2015.1111927
Alford J. Engaging Public Sector Clients: From service-delivery to co-production. London, UK: Palgrave Macmillan; 2009. DOI: https://doi.org/10.1057/9780230235816
Ballantyne D, Richard JV. Introducing a Dialogical Orientation to the Service-Dominant Logic of Marketing. In: Lusch RF, Stephen LV (eds.), The Service-Dominant Logic of Marketing: Dialog, Debate, and Directions. New York: Routledge; 2006. p. 224–35. DOI: https://doi.org/10.4324/9781315699035
Bharti K, Agrawal R, Sharma V. Value co-creation: Literature review and proposed conceptual framework. Int J Mark Res. 2015; 57(4): 571–604. DOI: https://doi.org/10.2501/IJMR-2015-012
McColl-Kennedy JR, Snyder H, Elg M, Witell L, Helkkula A, Hogan, SJ, Anderson, L. The changing role of the health care customer: review, synthesis and research agenda. J. Serv. Manag. 2017; 28: 2–33. DOI: https://doi.org/10.1108/JOSM-01-2016-0018
Batalden P. Getting more health from healthcare: quality improvement must acknowledge patient coproduction-an essay by Paul Batalden. BMJ. 2018. DOI: https://doi.org/10.1136/bmj.k3617
Derges J, Clow A, Lynch R, Jain S, Phillips G, Petticrew M, et al. ‘Well London’ and the benefits of participation: results of a qualitative study nested in a cluster randomised trial. BMJ Open. 2014; 4: 1–8. DOI: https://doi.org/10.1136/bmjopen-2013-003596
Jo S, Nabatchi T. Coproducing healthcare: individual-level impacts of engaging citizens to develop recommendations for reducing diagnostic error. Public Manag Rev. 2019; 21(3): 354–75. DOI: https://doi.org/10.1080/14719037.2018.1487577
Sharma S, Wallace LM, Kosmala-Anderson J, Realpe A, Turner A. Perceptions and experiences of co-delivery model for self-management training for clinicians working with patients with long-term conditions at three healthcare economies in U.K. World Hosp Health Serv. 2011; 47(2): 22–4.
Bourne P, Meddings S, Whittington A. An evaluation of service use outcomes in a Recovery College. J. Ment. Heal. 2018; 27: 359–366. DOI: https://doi.org/10.1080/09638237.2017.1417557
Morton M, Paice E. Co-production at the strategic level: Co-designing an integrated care system with lay partners in north west London, England. Int J Integr Care. 2016; 16(2): 1–4. DOI: https://doi.org/10.5334/ijic.2470
van Eijk C, Steen T, Torenvlied R. Public Professionals’ Engagement in Coproduction: The Impact of the Work Environment on Elderly Care Managers’ Perceptions on Collaboration With Client Councils. Am Rev Public Adm. 2019; 49(6): 733–48. DOI: https://doi.org/10.1177/0275074019840759
Batalden M, Batalden P, Margolis P, Seid M, Armstrong G, Opipari-Arrigan L, et al. Coproduction of healthcare service. BMJ Qual Saf. 2016; 25: 509–517. DOI: https://doi.org/10.1136/bmjqs-2015-004315
Gilardi S, Guglielmetti C, Marsilio M, Sorrentino M. Co-production in the Public Co-production in Healthcare: Moving Patient Engagement Towards a Managerial Approach. In: Fugini M, Sicilia M, Bracci E (eds.), Co-production in the Public Sector. Milan; 2016. p. 77–95. DOI: https://doi.org/10.1007/978-3-319-30558-5_6
Cepiku D, Marsilio M, Sicilia M, Vainieri M. The Co-production of Public Services Management and Evaluation. Cham: Palgrave Macmillan; 2020. p. 1–145. ISBN: 9783030607098. DOI: https://doi.org/10.1007/978-3-030-60710-4_1
Spanjol J, Cui AS, Nakata C, Sharp LK, Crawford SY, Xiao Y, et al. Co-Production of Prolonged, Complex, and Negative Services: An Examination of Medication Adherence in Chronically Ill Individuals. J Serv Res. 2015; 18(3): 284–302. DOI: https://doi.org/10.1177/1094670515583824
Fusco F, Marsilio M, Guglielmetti C. Co-production in health policy and management: a comprehensive bibliometric review. BMC Health Serv Res. 2020; 20(504): 1–16. DOI: https://doi.org/10.1186/s12913-020-05241-2
Farr M, Banks J, Edwards HB, Northstone K, Bernard E, Salisbury C, et al. Implementing online consultations in primary care: a mixed-method evaluation extending normalisation process theory through service co-production. BMJ Open. 2018; 8: 1–11. DOI: https://doi.org/10.1136/bmjopen-2017-019966
Flemig, S, Osborne S. The Dynamics of Co-Production in the Context of Social Care Personalisation: Testing Theory and Practice in a Scottish Context. J Soc Policy. 2019; 48(4): 1–27. DOI: https://doi.org/10.1017/S0047279418000776
Van Damme, J, Caluwaerts D, Brans M. Coproduction in Health Planning: Challenging the Need for “Open” Policy-Making Processes Policy-Making Processes. Int J Public Adm. 2016; 39(13). DOI: https://doi.org/10.1080/01900692.2016.1186180
Bovaird T, Flemig S, Loeffler E, Osborne SP. How far have we come with co-production—and what’s next? Public Money Manag. 2019; 39(4): 229–32. DOI: https://doi.org/10.1080/09540962.2019.1592903
Farr M. Power dynamics and collaborative mechanisms in co-production and co-design processes. Crit Soc Policy. 2018; 38(4): 623–44. DOI: https://doi.org/10.1177/0261018317747444
Wilberforce M, Glendinning C, Challis D, Fernandez J-L, Jacobs S, Jones K, et al. Implementing Consumer Choice in Long-term Care: The Impact of Individual Budgets on Social Care Providers in England. Soc Policy Adm. 2011; 45(5). DOI: https://doi.org/10.1111/j.1467-9515.2011.00788.x
Vennik FD, van de Bovenkamp HM, Putters K, Grit KJ. Co-production in healthcare: rhetoric and practice. Int Rev Adm Sci. 2016. DOI: https://doi.org/10.1177/002085231557055340
Holland-Hart DM, Addis SM, Edwards A, Kenkre JE, Wood F. Coproduction and health: Public and clinicians’ perceptions of the barriers and facilitators. Heal Expect. 2019; 22(1): 93–101. DOI: https://doi.org/10.1111/hex.12834
Amorim Lopes TS, Alves H. Coproduction and cocreation in public care services: a systematic review. Int J Public Sect Manag. 2020; 33(5): 561–78. DOI: https://doi.org/10.1108/IJPSM-10-2019-0259
Yin RK. Validity and generalization in future case study evaluations. Evaluation. 2013; 19(3): 321–32. DOI: https://doi.org/10.1177/1356389013497081
Adinolfi P, Starace F, Palumbo R. Health Outcomes and Patient Empowerment: The Case of Health Budgets in Italy. J Health Manag. 2016; 18(1): 117–33. DOI: https://doi.org/10.1177/0972063415625524
Sweeney JC, Danaher TS, McColl-Kennedy JR. Customer Effort in Value Cocreation Activities: Improving Quality of Life and Behavioral Intentions of Health Care Customers. J Serv Res. 2015; 18(3): 318–35. DOI: https://doi.org/10.1177/1094670515572128
Durojaiye OC, Cartwright K, Ntziora F. Outpatient parenteral antimicrobial therapy (OPAT) in the UK: a cross-sectional survey of acute hospital trusts and health boards. Diagn Microbiol Infect Dis. 2018; 93: 58–62. DOI: https://doi.org/10.1016/j.diagmicrobio.2018.07.013
Pedersen MG, Jensen-Fangel S, Vebert Olesen H, Deep S, Tambe P, Petersen E. Outpatient parenteral antimicrobial therapy (OPAT) in patients with cystic fibrosis. BMC Infect Dis. 2015; 15(290). DOI: https://doi.org/10.1186/s12879-015-1019-4
Burgel PR, Bellis G, Olesen HV, Viviani L, Zolin A, Blasi F, et al. Future trends in cystic fibrosis demography in 34 European countries. Eur Respir J. 2015; 46(1): 133–41. DOI: https://doi.org/10.1183/09031936.00196314
Döring G, Flume P, Heijerman H, Elborn JS. Treatment of lung infection in patients with cystic fibrosis: Current and future strategies. J Cyst Fibros. 2012; 11(6): 461–79. DOI: https://doi.org/10.1016/j.jcf.2012.10.004
Twiddy M, Czoski Murray CJ, Mason SJ, Meads D, Wright JM, Mitchell ED, et al. A qualitative study of patients’ feedback about Outpatient Parenteral Antimicrobial Therapy (OPAT) services in Northern England: implications for service improvement. BMJ Open. 2018; 8: 19099. DOI: https://doi.org/10.1136/bmjopen-2017-019099
Paladino JA, Poretz D. Outpatient parenteral antimicrobial therapy today. Clin Infect Dis. 2010; 51. DOI: https://doi.org/10.1086/653520
Keller SC, Ciuffetelli D, Bilker W, Norris A, Timko D, Rosen A, et al. The impact of an infectious diseases transition service on the care of outpatients on parenteral antimicrobial therapy. J Pharm Technol. 2013; 29(5): 205–14. DOI: https://doi.org/10.1177/8755122513500922
Mansour O, Heslin J, Townsend JL. Impact of the implementation of a nurse-managed outpatient parenteral antibiotic therapy (OPAT) system in Baltimore: A case study demonstrating cost savings and reduction in re-admission rates. J Antimicrob Chemother. 2018; 73(11): 3181–8. DOI: https://doi.org/10.1093/jac/dky294
Sorrentino M, Guglielmetti C, Gilardi S, Marsilio M. Health care services and the coproduction puzzle: filling in the blanks. Admin & Soc. 2017; 49(10): 1424–1449. DOI: https://doi.org/10.1177/0095399715593317
Schulman-Green D, Martin F, Alonzo A, Grey M, McCorkle R, Redeker NS, et al. Process of Self-management in Chronic Illness. J Nurs Scholarsh. 2012; 44(2): 136–44. DOI: https://doi.org/10.1111/j.1547-5069.2012.01444.x
Chapman ALN, Dixon S, Andrews D, Lillie PJ, Bazaz R, Patchett JD. Clinical Efficacy and Cost-Effectiveness of Outpatient Parenteral Antibiotic Therapy (OPAT): A UK Perspective. J Antimicrob Chemother. 2009; 64(6): 1316–24. DOI: https://doi.org/10.1093/jac/dkp343
González-Ramallo VJ, Mirón-Rubio M, Mujal A, Estrada O, Forné C, Aragón B, Rivera AJ. Costs of outpatient parenteral antimicrobial therapy (OPAT) administered by Hospital at Home units in Spain. Int. J. Antimicrob. Agents. 2017; 50(1): 114–118. DOI: https://doi.org/10.1016/j.ijantimicag.2017.02.017
Berrevoets MAH, Oerlemans AJM, Tromp M, Kullberg BJ, Ten Oever J, Schouten JA, et al. Quality of outpatient parenteral antimicrobial therapy (OPAT) care from the patient’s perspective: a qualitative study. BMJ Open. 2018; 8: 24564. DOI: https://doi.org/10.1136/bmjopen-2018-024564
Michie S, van Stralen MM, West R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implement Sci. 2011; 6(42). DOI: https://doi.org/10.1186/1748-5908-6-42
Addis S, Holland-Hart D, Edwards A, Neal RD, Wood F. Implementing Prudent Healthcare in the NHS in Wales; what are the barriers and enablers for clinicians? J Eval Clin Pract. 2019; 25(1): 104–10. DOI: https://doi.org/10.1111/jep.13023
Kozak A. The effectiveness of the public service co-production process- results of a systematic literature review. Entrep Manag. 2019; 76(2). DOI: https://doi.org/10.23939/eem2019.02.076
Tariq S, Woodman J. Using mixed methods in health research. Methodol Rev. 2013; 1–8. DOI: https://doi.org/10.1177/2042533313479197
Caruth GD. Demystifying Mixed Methods Research Design: A Review of the Literature. Mevlana Int J Educ. 2013; 3(2): 112–22. DOI: https://doi.org/10.13054/mije.220.127.116.11