Introduction: The reorganisation of the structure of a Gastro-Intestinal Oncology Multidisciplinary Team Meeting (GIO-MDTM) in a tertiary centre with three care pathways is evaluated on added value.
Methods: In a mixed method investigation, process indicators such as throughput times were analysed and stakeholders were interviewed regarding benefits and drawbacks of the reorganisation and current MDTM functioning.
Results: For the hepatobiliary care pathway, the time to treatment plan increased, but the time to start treatment reduced significantly. The percentage of patients treated within the Dutch standard of 63 days increased for the three care pathways. From the interviews, three themes emerged: added value of MDTMs, focus on planning integrated care and awareness of possible improvements.
Discussion: The importance of evaluating interventions in oncology care pathways is shown, including detecting unexpected drawbacks. The evaluation provides insight into complex dynamics of the care pathways and contributes with recommendations on functioning of an MDTM.
Conclusions: Throughput times are only partly determined by oncology care pathway management, but have influence on the functioning of MDTMs. Process indicator information can help to reflect on integration of care in the region, resulting in an increase of patients treated within the Dutch standard.
Care pathways are accepted as a means to manage oncology care . The management team of an oncological care pathway, tumour board, generally consists of a group of specialists that focus on 1) communication between different specialists on managing evidence-based treatment for oncology patients, 2) decision making in multidisciplinary team meetings (MDTMs) for oncology patients who need complex treatment plans and 3) multidisciplinary coordination of integrated care with timely start of treatment within the region [2, 3, 4]. MDTMs use digital medical records and clinical decision support systems in different ways [5, 6]. MDTMs make a valuable contribution to the choice and planning of treatment [7, 8, 9] and lead to a better survival rate [10, 11, 12, 13]. Consequently, MDTMs are considered the gold standard in oncology care pathway management [14, 15, 16, 17, 18, 19, 20, 21] and the platform to accomplish clinical integration . For optimal coordination and clear communication with patients, uniformity in working methods with standardised formats for MDTMs are advocated by European [23, 24], Canadian  and American cancer treatment associations . Additionally, MDTMs are also used for coordinating research, education, promoting and for diffusing best practices and new developments, so called ‘functional integration’ .
The Gastro-Intestinal Oncology (GIO) tumour board of our University Medical Centre (UMC) is a tertiary centre that organises oncology care together with partners in the northern region of the Netherlands and shares responsibility for optimising quality and improving the integration of care. This GIO tumour board manages care pathways for three groups of malignancies: colorectal, hepatobiliary and esophagus-stomach. In the Netherlands, the number of gastrointestinal cancer cases rose from 12,877 in 1989 to 23,985 in 2018, an increase of 86%. Especially the increase in fragile, elderly patients with gastrointestinal cancer led to a need for more complex care. This complexity led to lengthier discussions, longer MDTMs and longer throughput times for the patient to get a treatment plan. Given these trends, the UMC-GIO tumour board decided to reorganise the care pathways according to a previous developed model . The aim of that reorganization was to make the care pathways more patient-centred, enabling shared decision making and to reduce throughput times to comply with the standards set by the Dutch Healthcare Inspectorate, formulated in the SONCOS standards (Stichting Oncologische Samenwerking: Council for Oncological Collaboration) . The main interventions were: 1) immediate triage with direct ordering of missing diagnostics upon receival of the referral, 2) assessment of the patient before the MDTM in the outpatient clinic on the same day as the MDTM, 3) presence of the right specialisms during each MDTM to formulate an optimal multidisciplinary treatment plan and 4) seeing the patient shortly after the MDTM, on the same day, to share the proposal for treatment and decide together with the patient (shared decision making).
The care pathways start with referral to the UMC by a general practitioner or a specialist (tertiary or quaternary; Supplement 1). Before the reorganisation, patients following the colorectal and esophagus-stomach care pathways were seen at the oncology outpatient clinic before their treatment plan was discussed in an MDTM . In several cases the diagnostic work-up was not yet complete. In the hepatobiliary care pathway usually images with a treatment plan were discussed at the MDTM before patients were invited to the oncology outpatient clinic. Due to the quaternary function, consultation ‘on paper’ is requested regularly and not all patients require to visit the UMC (e.g. a non-resectable tumour eligible for palliative chemotherapy can be handled by their local physician). As of April 2015, the triage with direct ordering of missing diagnostics was implemented. The first assessment of the patient in the outpatient clinic, GIO-intake, was on the same day as the MDTM in which their treatment plan was formulated (Figure 1). Decisions in the MDTMs are made by dedicated specialists involved in diagnostics and treatment for that GIO pathway. Directly after the MDTM, on the same day, the treatment options and consequences are explained to the patient. Specialisms involved in the treatment have the opportunity to speak with the patient. The reorganization did not change the role of the case managers, they plan the activities for diagnostic procedures and treatment in the same way.
When throughput times started to increase again, the GIO tumour board felt the need to evaluate the reorganisation by comparing its throughput times and the number of MDTMs per patient. In this study, we evaluated quantitatively the throughput times, number of hospital visits and number of MDTMs [11, 30], and qualitatively the benefits and drawbacks of the reorganisation by interviewing specialists and case managers. This mixed methods approach sought to answer two questions:
In a previous study on the effects of reorganising a care pathway for patients with head-and-neck cancers, data retrieved from 25 medical records before and 25 after a reorganisational intervention were sufficient to show a significant reduction in throughput times and hospital visits .
We therefore choose to analyse, for each care pathway, two sets of medical records, 25 before and 25 after the reorganisation. The first set included data on 25 consecutive patients referred at least four months before the start of the GIO-MDTM reorganisation, working back from December 31st 2014. The other set included data who were referred four months after the reorganisation, i.e. from August 1st 2015 onwards. Data were included on patients who were at least 18 years old and who had been discussed in a GIO-MDTM in our UMC. The following tumours were selected (ICD-O-03 ed1/ed3 ): esophagus C15, stomach C16, colon C18, rectum C209, pancreas C250, liver C220 and gall bladder C239. Data on patients treated for benign or neuroendocrine tumours were not included.
For process evaluation of the reorganization of GIO-MDTM, throughput times, the number of MDTMs per patient and the number of hospital visits were used as process indicators (i.e. quantitative outcome variables for this study). Throughput times were measured as the times from triage to the moment the treatment plan was available and to start treatment (Figure 1).
In assessing the added value, or efficiency, of the reorganisation we used modified SONCOS standards. The tertiary centre’s responsibility starts the moment the referral request is received and the centre obviously has no direct influence on the part of the care pathway before this referral. The standards state that, for patients with a GIO tumour, the throughput time for diagnostic procedures should be no more than 21 days; and that the throughput time from oncology intake, if referred to a tertiary treatment facility, to the start of primary treatment no more than 63 days. As the starting point for these throughput times, the standards take the day that the results of the biopsy, taken in the referring hospital, are known. Instead, we took timing of triage in our institution as starting day for throughput times. Thus, in this study, we set targets of 21 days for the time to get the treatment plan and 63 days for the time to start treatment (Figure 1).
Sometimes, tumour size was missing in the treatment plan. In these instances, we used Netherlands Cancer Registry data to retrieve missing tumour size data and to confirm dates we extracted from medical records.
To analyse whether the GIO-MDTM reorganisation had different effects for the different care pathways, a univariate general linear model analysis was performed. However, the assumptions for this type of analysis were not satisfied. Subsequently, several attempts were made to transform the data to meet the assumptions, but these failed because our data were too skewed. Instead we analysed effects of the reorganisation within each care pathway non-parametrically and report medians and interquartile ranges (IQR). Differences in age, gender, tumour localisation (ICD-O), tumour size, diagnostic type, treatment type and compliance with the 21-days standard and the 63-days standard, before and after the reorganisation of the GIO-MDTM, were analysed using Chi-Squared tests or Chi-Squared test exact if requirements were not met. Mann-Whitney-U tests were used to analyse throughput time differences. Statistical analyses were performed using SPSS 23.0 for Windows software. Statistical significance was set at 5%.
Semi-structured interviews were held with gate-keeping specialists and case managers from the three care pathways. The interviews focussed on perceived benefits and drawbacks, and the value of the reorganisation, the current functioning of the GIO-MDTM and how MDTMs could be further improved.
During October and November 2019, three surgeons, three gastroenterologists and three case managers were interviewed. After receiving their verbal informed consent, semi-structured interviews started with providing information on the quantitative results of this study. The interview continued with the question: ‘What do you think is the role of the gate-keeping specialist / case manager in a GIO-MDTM?’. The interviewer used a topic list as interview guide (Supplement 2). Interviews lasted 25 to 40 minutes, were audio recorded and transcribed.
Quotes were extracted from the transcripts. The participants were asked to review and confirm their personal transcripts and extracted quotes. Quotes were then anonymised. In the first stage of the inductive analysis [31, 32], codes were given to quotes related to the reorganisation of the GIO-MDTM and its current functioning [30, 33, 34, 35]. The codes were placed in a coding tree in relation to the research question with three main themes: planning for integrated care, added value of the MDTM and the management of the care pathway (Supplement 3) [36, 37]. Thereafter a second coder gave quotes codes from the coding tree. Codes were judged as either being a benefit or a drawback that could be improved. Disagreements in coding between the coders and the researcher were discussed. After the preliminary results were collated, a member check was performed to ensure credibility .
In total, data from 194 medical records were included in this study; 96 before and 98 after the reorganisation (Supplement 4: Tables a-c). All groups had at least 25 patients that started treatment. A data check revealed that 3% of the data were not in accordance with the Netherlands Cancer Registry and were changed accordingly. The throughput times based on the Netherlands Cancer Registry database were shorter than those based on medical records (mean difference 0.5 days). Staging verification showed no differences for the tumour sizes. Mean (sd) age of patients before and after the reorganisation was 66.2 (9.3) respectively 65.4 (12.5) years. In all the pathways, tumours were somewhat larger after the reorganisation. Outliers were explored and, in most cases, comorbidity induced extended throughput times.
In the colorectal care pathway, after the reorganisation, the number of hospital visits in the period from triage to start of treatment tended to increase (p = .092) (Table 1 and Figure 3a). Nevertheless, the standards for throughput times from triage to get the treatment plan and from triage to start treatment were met for a higher proportion of patients after the reorganisation (85 vs 93%).
|Number of patients diagnosed*||2014 (n = 32)||2015 (n = 34)||p||2014 (n = 36)||2015 (n = 32)||p||2014 (n = 28)||2015 (n = 32)||p|
|Median (IQR)||Median (IQR)||Median (IQR)||Median (IQR)||Median (IQR)||Median (IQR)|
|Throughput time (days)|
|TTP triage – treatment plan||8.0 (4.3;26.8)||13.0 (6.0;22.5)||.653||5.5 (1.0;12.0)||9.0 (5.0;22.0)||.035||15.0 (7.0;23.0)||13.0 (5.3;19.0)||.292|
|treatment plan within 21 days**||66%||74%||.485||89%||72%||.075||71%||87%||.370|
|TST triage – start treatment||37.5 (24.3;55.8)||34.0 (24.0;46.0)||.663||58.0 (46.5;68.5)||47.0 (37.0;54.0)||.026||31.0 (22.5;41.5)||28.0 (20.5;39.5)||.521|
|start treatment within 63 days**||85%||93%||.420||60%||88%||.024||96%||100%||1.000|
|Number of MDTMs||1.0 (1.0;2.0)||1.0 (1.0;2.0)||.307||1.0 (1.0;1.0)||1.0 (1.0;2.0)||.026||2.0 (1.0;2.0)||1.0 (1.0;2.0)||.079|
|Number of patients treated***||2014 (n = 26)||2015 (n = 27)||2014 (n = 25)||2015 (n = 25)||2014 (n = 25)||2015 (n = 25)|
|Number of hospital visits|
|triage – treatment plan||2.0 (1.0;3.0)||3.0 (2.0;4.0)||.092||1.0 (0.0;3.0)||1.0 (1.0;3.0)||.027||4.0 (2.0;5.8)||3.0 (2.0;4.0)||.037|
|triage – start treatment||3.5 (3.0;5.0)||5.0 (3.0;6.0)||.157||3.0 (2.0;4.0)||3.0 (2.0;4.0)||.933||5.5 (4.0;7.0)||5.0 (3.0;6.0)||.238|
In the hepatobiliary care pathway, more primary tumours were treated after the reorganisation (p = .039) (Supplement 4: Table b), the time to get the treatment plan increased (p =.035) but the time to start treatment decreased (p = .029) (Table 1 and Figure 2a). The number of hospital visits between triage and treatment plan increased (p = .027), and more MDTMs were needed to come to a treatment plan (p = .026) after the reorganisation. After the reorganisation fewer patients got their treatment plan within 21 days. The percentage of patients that started their treatment within 63 days increased to 88% (p = .024).
In the esophagus-stomach care pathway, patients in our post-reorganisation sample were older than those in the pre-reorganisation sample (p = .050) and the number of hospital visits needed to come to a treatment plan was less after the reorganisation (p = .037). The number of MDTMs per patient tended to decrease (p = .079; Table 1). The percentage of patients that started their treatment within 63 days increased and in 2015 the standard of 63 days was met for all.
From the transcripts, 251 quotes were extracted. In total 50 codes (Supplement 3) were identified related to the reorganisation of the GIO-MDTM and its current functioning. These codes were given 630 times (Supplement 3). Inter-coder agreement was 62.5%. Codes representing a benefit (30 codes identified, 418 times) were given twice as often than those representing a drawback (20 codes, 212 times). The 10 most frequently given codes were given to 56 % of the 251 quotes.
During a thematic synthesis, three main themes emerged from the data; 1) increase of the added value of the MDTMs, for example availability of expert specialisms had increased, 2) greater focus in the planning on continuity and integration of care, for example planning in cooperation with other regional hospitals had improved, 3) greater awareness that improvements could be made in the management of GIO care pathways, such as using a dashboard to monitor ‘real time’ relevant throughput times for GIO patients on the hospital’s MDTM registration list.
Most interviewees regarded a GIO-MDTM as the moment where all expertise comes together to decide an optimal multidisciplinary treatment plan. A gastroenterologist explained:
“The value of the MDTM is twofold: 1) for the patient who visits the GIO outpatient clinic, you have thought carefully about the possible diagnosis and multidisciplinary treatment (code 24) 2) it is good for the cohesion within the team, to know your colleagues with whom you work well, which means that you can also find each other easily in other circumstances.” (code 18).
During a GIO-MDTM, the gate-keeping specialism for each patient is responsible for the quality of the intake and presents their patients. That specialism thus plays a key role for patients and also for colleagues. In addition, the chair of the GIO-MDTM also fills an important role. The chair has to monitor and guide the meeting process, summarise discussions and formulate the conclusions. The chair needs to distinguish non-complex cases, or ‘formalities’, from complex cases to ensure an efficient discussion. A surgeon said:
“As chair, I prepare for a meeting thoroughly. I review the patients to estimate the time needed for each one: a ‘formality’ or an extended discussion.” (code 26).
Each care pathway had different dynamics reflecting differences in the biology of the tumours. Although participants noted that it is important to prepare for the MDTM, most specialisms did not schedule time for this. A surgeon said:
“It is both time consuming and important for a chair to prepare well for the MDTM, but no time is scheduled for this the day before our MDTM.” (code 23).
The participants stated that good preparation makes the MDTM more efficient for all persons present and it is good for patient care. A case manager said:
“Everybody wants time to reflect on their own preparation for the MDTM, because it is their patient being presented who needs an optimal treatment plan.” (code 32).
The case managers played a distinct role in the care pathway. They focused on all patients’ needs, including psychosocial aspects. They aim to speed up the diagnostic process by getting information from the referrer where possible and, during that process, they stay in contact with the patient, the referring hospital and the treating specialist, signalling problems in throughput times and acting to prevent delays when possible. A case manager said:
“The role of the case manager is to prepare the agenda for the MDTM and to act upon decisions of the MDTM.” (code 8).
A surgeon member of a tumour board put it like this:
“We steer tightly, using the case manager to acquire diagnostic results from the periphery on time. A few times, the results had not arrived on time, but we decided to discuss the patient at the MDTM with the information at hand.” (code 11).
The latter part of this quote reflects a dilemma we heard several times: helping the patient is more important than a perfect process in the hospital. Another aspect of the case manager’s focus on the patient and on integrated care was that they implemented an improvement shortly after the reorganisation of the GIO-MDTM. Patients had commented that they understood the diagnosis and the treatment plan, but that the explanation of the different treatment options and consequences was too much for them to digest in a single hospital visit.
Most interviewees stated that further improvements could be made, but that finding time to reflect and gain support to implement improvements was difficult. Throughput times cannot always be influenced by a physician or care pathway management. The available time in the operating theatre is in part determined by the capacity of the anaesthesiology department. A gastroenterologist said:
“The throughput time of 6–8 weeks for an Endoscopic Retrograde Cholangiopancreatography is determined by the sedation capacity of [the department of] anaesthesiology.”. A dashboard with indicators was seen as potentially helpful. A surgeon member of a tumour board said:
“We should have a dashboard to monitor our registration list for the GIO-MDTM in relation to relevant throughput times.” (code 46).
Another aspect highlighted was that not all parties involved in the GIO-MDTM were invited to meetings where policy and improvement opportunities were discussed. A case manager said:
“A tumour board manages our care pathway. As a case manager or nursing consultant, you are not invited to the policy meetings.” (code 45).
After the reorganisation, throughput times to start treatment decreased significantly but throughput times to get the treatment plan increased in the hepatobiliary pathway. In the two other pathways, the percentages of cases meeting the 21-day standard set for the treatment plan increased somewhat but not significantly. In all the pathways, a higher percentage of cases met the standard to start treatment within 63 days, but only significantly in the hepatobiliary pathway. The number of MDTMs increased significantly in the hepatobiliary pathway. The number of hospital visits from triage to treatment plan increased significantly in the hepatobiliary pathway but decreased significantly in the oesophagus-stomach pathway.
The reorganisation aimed to reduce throughput times by standardising the work for the majority of non-complex patients and thereby gaining time to discuss the more complex cases. In the UMC, as a tertiary and quaternary centre, an increasing number of older patients with more comorbidities are seen, which explains an increase in larger tumours. Generally complex patients with advanced diseases benefit most from MDTM discussions, also described as the ‘Flying Dutchman phenomenon’ blown from one site-specific MDTM to another until finally reaching safe haven : patients getting the best possible treatment plan through a multidisciplinary approach in a tertiary centre [12, 29, 39, 40]. Developments required more intensive discussion and coordination between professionals and this is reflected in increased throughput times and number of hospital visits from triage to treatment plan in the hepatobiliary pathway. During the reorganization there were no task shifts from doctors to nurses or to general practitioners. An explanation for the decrease in throughput time from triage to start treatment in the hepatobiliary pathway (a 9-day difference in median times), despite a longer throughput time from triage to treatment plan, could be improved case coordination as a result of the reorganisation of the MDTM. Given the increasing percentage of complex cases, we argue that the SONCOS standards are too strict in expecting throughput times to be met for all patients. Indeed, for head-and-neck cancer patients in the Netherlands [41, 42], there has been a modification, now expecting 80% of patients to meet the time to start treatment. Therefore, we would recommend healthcare policymakers to set throughput time standards but expect hospitals to only meet these for about 75% [43, 44].
In the hepatobiliary pathway, before the reorganisation, patients were not seen in the outpatient clinic before the MDTM and decisions were taken based on imaging and documents. After the reorganisation, patients were seen before the MDTM, and additional hospital visits were scheduled to prepare for the treatment. This change resulted in longer throughput times and an increase in the number of MDTMs. Recently a re-evaluation project was started with the region to optimize the care pathway including the development of a dashboard.
In the colorectal care pathway, the number of hospital visits also tended to increase after the reorganisation. Intake and assessment by different specialties on the same day as the GIO-intake resulted in an overwhelming amount of information being presented to the patient. It was therefore decided to arrange an additional visit to explain the medical situation and the alternative treatments to the patient and their supporters. For such patients, efficiency has its limits: they need time for explanation and reflection in order to make a ‘well-weighted, shared decision’ with their treating specialist e.g. in an elderly MDTM .
Conversely, for the esophagus-stomach care pathway, the number of MDTMs tended to decrease as well as the number of hospital visits needed to come to a treatment plan. Another improvement was seen in the integration of surgical capacity. Here, since January 2019, a secondary hospital in the region shares its surgical capacity with the UMC’s GIO centre for stomach surgery. The MDTMs held by UMC and by the secondary hospital have been merged and using video-conferencing to reduce the number of MDTMs and decrease throughput times. Research on care pathway management in Scotland has shown that throughput time measurements on several levels should be taken into account to improve coordination in a region , and this is reflected in our recommendations below.
Twice as many codes were annotated as benefits than as drawbacks for the functioning of the GIO-MDTM. However, some of the benefits were already experienced as an advantage of having MDTMs before the reorganisation. From the interviews, it became clear that, following the reorganisation, the value of the MDTMs had increased. The different treatment modalities were better discussed between the appropriate specialisms with more attention to patient wishes. This was largely caused by availability of all expertise at the meeting to discuss complex cases and to cooperate in a multidisciplinary way in formulating an optimal treatment plan for individual patients. In this way, the reorganisation enhanced quality and integration of care for the three patient groups and, what is more, the interviewees said that the reorganised MDTMs also improved interpersonal relations between participants. These improvement contributed positively to discussions and resulted in better treatment plans. These findings are in line with previous study findings [47, 48]. Another observation was the improvement in case coordination due to the more complete presence of required disciplines during the MDTM and the better relationships. Although the importance of improved case coordination between healthcare professionals with better interpersonal relationships has also been found previously [49, 50, 51, 52], more research is needed to understand the underlying processes and the way it adds value to a care pathway.
Case managers believed that throughput times to get the treatment plan and throughput times to start treatment could be further reduced through stricter monitoring of the completeness of the diagnostic information needed to start treatment. The importance of strict monitoring has been identified elsewhere [53, 54] but we noticed that the ‘circle of influence’ of a care coordinator or case manager is limited. The case manager has no control over or mandate for discipline-bounded capacities such as slots for diagnostic procedures. Such a mandate depends on the leadership and style of communication in the tumour board and the MDTM.
From the interviews, it became clear that the GIO-MDTMs would benefit from participants being better prepared. Specialists within the same department could discuss treatment possibilities from their perspective before the MDTM, and prepare questions to discuss with other specialists to optimise the proposed treatment. In general, there is no preparation time scheduled for the MDTM participants. The chair should be well prepared, and should earmark time for the different disciplines, so that discussions within a discipline during an MDTM would then take less time and the MDTM would be more efficient. Surgical oncologists elsewhere have reported that MDTM members have good insight into their own multidisciplinary team performance and state that all MDTMs would benefit from good leadership, good preparation of MDTMs and appropriate presentation of information by the gate-keeping specialists [55, 56, 57, 58].
All participants of the GIO-MDTMs were highly motivated to improve efficiency of the meetings but they experienced a lack of time to prepare the meetings. Although the UMC, as a tertiary centre, treats mainly the more complex cases, there are sufficient surgical treatments to meet the SONCOS indicator for the ‘number of surgical cases’, which is an indicator for being a ‘competent’ surgeon . However, this indicator should not be seen as justification for adversely affecting the time available for participants to prepare for an MDTM. Additionally, there remains a dilemma for the hepatobiliary pathway. The efficiency of the care pathway in terms of diagnostic procedures against the importance of meeting the patient before making a treatment plan at the MDTM so that the patient’s wishes concerning treatment can get more attention and can be optimally included .
The interviews provided an insight into the complex dynamics of oncology care pathways and the functioning of their MDTMs. Collaboration in an MDTM is not only about efficiency and indicators like throughput times, but also about cooperation, respect for other team members and the commitment of all team members, and good leadership [12, 48, 60].
The importance of evaluating interventions in oncology care pathways is shown, including detecting unexpected drawbacks. This study showed the importance of evaluating adjustments or interventions in internal and regional care pathways in order to detect any unexpected drawbacks, to structure continuous improvement [43, 61] and to organize care pathways in an integrated way. This mixed method approach, provides insight into how an oncology care pathway operates, the contribution of the individual members, their appreciation and assessment of the cooperation .
A limitation of this study is the lack of generally accepted indicators for care pathway management and definitions of those indicators that do exist [46, 57, 63]. We modified Dutch SONCOS standardised indicators to evaluate the reorganisation of the care pathways in order to be comparable to the indicators used in earlier research on the care pathway of head-and-neck cancer patients . Contrary to our expectations, we did not find a significant decrease in throughput times for the different GIO care pathways. We saw that the clinical presentation, the biological behaviour of tumours, types of treatment and treatment combinations differed considerably from the care pathway of head-and-neck cancers. Further, we noted that the UMC’s focus increasingly on the care of complex patients with larger tumours, that the incidence of tumours in the elderly is increasing, and that these factors may be important confounders in not finding a significant change following reorganisation.
Based on the results of our study, we formulated the following recommendations
The results and recommendations show that improving performance requires an improved functioning of MDTMs (clinical integration), participation of all specialists with clear roles (professional integration), resources such as time, sufficient performance information and quality improvement efforts (functional integration), a regional policy (organizational integration) and shared commitment and mutual trust to improve the performance of the pathway (normative integration) .
However ‘real time’-dashboard implementation is complicated for functional integration in a care pathway, but is currently under development.
To justify the existence of time-consuming events such as MDTMs in oncological care pathways, it is important to measure their added value. Further research could be directed at investigating the value of real time dashboard information, and consider the waiting times and the status of diagnostic procedures in reaching a personalised treatment plan in an MDTM. On the tumour board level, further research could focus on what indicators enable effective care pathway management. For example, indicators that 1) present real time throughput time information on diagnostic procedures and treatment steps, 2) enable informed decision-making on diagnostic and therapeutic capacity and 3) increase efficiency by reducing non-value adding diagnostic procedures or treatments.
Reorganising the GIO-MDTM and outpatient clinic had different effects on each care pathway. For the hepatobiliary pathway, the throughput time from triage to treatment plan increased, but the throughput time from triage to start treatment reduced. No other significant changes were identified. Overall, the percentage of patients treated within the Dutch standard of 63 days increased.
The efficacy of an integrated multidisciplinary care pathway needs constant attention. It can be assessed with a mixed method approach. Beside results of quantitative evaluation like throughput times, a qualitative approach is recommended for assessment of the human factor in cooperation between different disciplines.
Datasets will be available from the corresponding author on reasonable request.
The additional files for this article can be found as follows:Supplementary File 1
Illustration GIO care pathway before the reorganization. DOI: https://doi.org/10.5334/ijic.5526.s1Supplementary File 2
Interview Guide. DOI: https://doi.org/10.5334/ijic.5526.s2Supplementary File 3
Coding tree reorganization GIO-MDTM. DOI: https://doi.org/10.5334/ijic.5526.s3Supplementary File 4
Patient and tumour characteristics of the care pathways. DOI: https://doi.org/10.5334/ijic.5526.s4
This study was approved by and performed according to standards of our UMC Ethics Committee (2016, ref. M16.195849). The committee concluded that the study was not a ‘clinical research study with human subjects’ under the Dutch Medical Research Involving Human Subject Act (WMO).
Patients did not participate in the study design because the main purpose of the study was to evaluate the reorganization of the GIO-MDTM on efficiency in the care pathways for healthcare professionals.
This research was sponsored by the University Medical Center Groningen.
We would like to thank all the interviewees for their time and inspiration. For support on data retrieval and explanations of the working methods of case managers we thank Marian Beernink, Margrieta van der Molen and Thea Dijkstra-Jansma. We also thank the registration team of the Netherlands Comprehensive Cancer Organisation (IKNL) for their role in collecting data from the hospitals in the Netherlands for the Netherlands Cancer Registry.
Guus Schrijvers, former-professor of Public Health and health economist, the Netherlands.
One anonymous reviewer.
The authors have no competing interests to declare.
The first author was involved in the study concept and design; carried out the study; performed the statistical analysis and the analysis and interpretation of the data; and drafted the manuscript. The second, the eighth and last author, the supervisor, were involved in the study design and concept, analysis and interpretation of the data, and revision of the manuscript. The supervisor and the second author were involved in the coding of the interview quotations and, together with the other authors were involved in the acquisition of the data and the revision of the manuscript.
All authors read and approved the final manuscript.
The University Medical Center Groningen (UMCG) is developing patient-centred, integrated care pathways for various patient groups. In addition to medical and logistic aspects, laws and regulations for quality and patient safety are included. The UMCG has an institutional ISO 9001 for Healthcare certificate and ISO 27001 Information Security certificate for their care, research and educational processes. The Quality and Patient Safety research group evaluates the implementation of care pathways and MDTMs to develop indicators for the management level of care pathways led by healthcare professionals. The four leading researchers for this paper are LvH, PUD, KA and JR. Of these, LvH works as a consultant for quality and patient safety for different care pathways seeking to implement improvements and is involved in certification of these care pathways at the regional level. PUD works as a researcher in the field of rehabilitation and is an epidemiologist. KA chaired the Quality and Patient Safety research group of the UMCG and now chairs the Health Services Management & Organisation Department of the Erasmus School of Health Policy & Management. His research interest is quality improvement and value-based healthcare. JR was chair of the multidisciplinary Head and Neck Oncology Group of the UMCG for 30 years and chair of the Dutch Multidisciplinary Head and Neck Oncology Group for 8 years. The centralisation of head and neck cancer care in eight centres was achieved under his leadership in 1993.
van Hoeve JC, Vernooij RWM, Fiander M, et al. Effects of oncological care pathways in primary and secondary care on patient, professional and health systems outcomes: a systematic review and meta-analysis. Systematic reviews 2020; 9(1): 246. DOI: https://doi.org/10.1186/s13643-020-01498-0
Patkar V, Acosta D, Davidson T, et al. Cancer multidisciplinary team meetings: evidence, challenges, and the role of clinical decision support technology. International journal of breast cancer 2011; 2011. DOI: https://doi.org/10.4061/2011/831605
Kodner DL, Spreeuwenberg C. Integrated care: meaning, logic, applications, and implications – a discussion paper. International journal of integrated care 2002; 2: e12. DOI: https://doi.org/10.5334/ijic.67
Minkman MMN. The current state of integrated care: an overview. Journal of Integrated Care Pathways 2012; 6: 346–58. DOI: https://doi.org/10.1108/14769011211285147
Berlin A, Sorani M, Sim I. A taxonomic description of computer-based clinical decision support systems. Journal of Biomedical Informatics 2006; 39(6): 656–67. DOI: https://doi.org/10.1016/j.jbi.2005.12.003
Patkar V, Acosta D, Davidson T, et al. Using computerised decision support to improve compliance of cancer multidisciplinary meetings with evidence-based guidance. BMJ open 2012; 2(3). Print 2012. DOI: https://doi.org/10.1136/bmjopen-2011-000439
Davies AR, Deans DA, Penman I, et al. The multidisciplinary team meeting improves staging accuracy and treatment selection for gastro-esophageal cancer. Diseases of the esophagus: official journal of the International Society for Diseases of the Esophagus 2006; 19(6): 496–503. DOI: https://doi.org/10.1111/j.1442-2050.2006.00629.x
Riedel RF, Wang X, McCormack M, et al. Impact of a multidisciplinary thoracic oncology clinic on the timeliness of care. Journal of thoracic oncology: official publication of the International Association for the Study of Lung Cancer 2006; 1(7): 692–6. DOI: https://doi.org/10.1016/S1556-0864(15)30383-X
Basta YL, Bolle S, Fockens P, et al. The Value of Multidisciplinary Team Meetings for Patients with Gastrointestinal Malignancies: A Systematic Review. Annals of surgical oncology 2017; 24(9): 2669–78. DOI: https://doi.org/10.1245/s10434-017-5833-3
Bydder S, Nowak A, Marion K, et al. The impact of case discussion at a multidisciplinary team meeting on the treatment and survival of patients with inoperable non-small cell lung cancer. Internal Medicine Journal 2009; 39(12): 838–41. DOI: https://doi.org/10.1111/j.1445-5994.2009.02019.x
Munro A, Brown M, Niblock P, et al. Do Multidisciplinary Team (MDT) processes influence survival in patients with colorectal cancer? A population-based experience. BMC cancer 2015; 15. DOI: https://doi.org/10.1186/s12885-015-1683-1
Prades J, Remue E, van Hoof E, et al. Is it worth reorganising cancer services on the basis of multidisciplinary teams (MDTs)? A systematic review of the objectives and organisation of MDTs and their impact on patient outcomes. Health policy (Amsterdam, Netherlands) 2015; 119(4): 464–74. DOI: https://doi.org/10.1016/j.healthpol.2014.09.006
van Drielen E, de Vries AW, Ottevanger PB, et al. Beter multidiscplinair overleg past bij betere zorg. [Better multidisciplinary team meetings are linked to better care]. Nederlands tijdschrift voor Geneeskunde 2012; 156(45): A4856 [in Dutch].
Homs MY, van Oijen MG, Wijnhoven BP, et al. Changes in diagnostic and treatment strategies of oesophageal cancer in the period from 2001 to 2009: a survey in the Netherlands. European journal of gastroenterology & hepatology 2012; 24(2): 126–33. DOI: https://doi.org/10.1097/MEG.0b013e32834e7f29
Kolfschoten NE, Gooiker GA, Bastiaannet E, et al. Combining process indicators to evaluate quality of care for surgical patients with colorectal cancer: are scores consistent with short-term outcome? BMJ quality & safety 2012; 21(6): 481–9. DOI: https://doi.org/10.1136/bmjqs-2011-000439
Swellengrebel HA, Peters EG, Cats A, et al. Multidisciplinary discussion and management of rectal cancer: a population-based study. World journal of surgery 2011; 35(9): 2125–33. DOI: https://doi.org/10.1007/s00268-011-1181-9
van Steenbergen LN, Lemmens VE, Rutten HJ, et al. Was there shortening of the interval between diagnosis and treatment of colorectal cancer in southern Netherlands between 2005 and 2008? World journal of surgery 2010; 34(5): 1071–9. DOI: https://doi.org/10.1007/s00268-010-0480-x
Taylor C, Munro AJ, Glynne-Jones R, et al. Multidisciplinary team working in cancer: what is the evidence? BMJ (Clinical research ed.) 2010; 340: c951. DOI: https://doi.org/10.1136/bmj.c951
Lamb B, Green JS, Vincent C, et al. Decision making in surgical oncology. Surgical oncology 2011; 20(3): 163–8. DOI: https://doi.org/10.1016/j.suronc.2010.07.007
Slavova-Azmanova NS, Johnson CE, Platell C, et al. Peer review of cancer multidisciplinary teams: is it acceptable in Australia? The Medical journal of Australia 2015; 202(3): 144–7. DOI: https://doi.org/10.5694/mja14.00768
Valentijn PP, Schepman SM, Opheij W, et al. Understanding integrated care: a comprehensive conceptual framework based on the integrative functions of primary care. International journal of integrated care 2013; 13: e010. DOI: https://doi.org/10.5334/ijic.886
European Partnership Action Against Cancer consensus group, Borras JM, Albreht T, et al. Policy statement on multidisciplinary cancer care. European journal of cancer (Oxford, England: 1990) 2014; 50(3): 475–80.
van Zelm R, Coeckelberghs E, Sermeus W, et al. Effects of implementing a care pathway for colorectal cancer surgery in ten European hospitals: an international multicenter pre-post-test study. Updates in surgery 2020; 72(1): 61–71. DOI: https://doi.org/10.1007/s13304-020-00706-9
Sanmartin C, Berthelot JM, McIntosh CN. Determinants of unacceptable waiting times for specialized services in Canada. Healthcare policy = Politiques de sante 2007; 2(3): e140–54. DOI: https://doi.org/10.12927/hcpol.2007.18679
Brady JT, Xu Z, Scarberry KB, et al. Evaluating the Current Status of Rectal Cancer Care in the US: Where We Stand at the Start of the Commission on Cancer’s National Accreditation Program for Rectal Cancer. Journal of the American College of Surgeons 2018; 226(5): 881–90. DOI: https://doi.org/10.1016/j.jamcollsurg.2018.01.057
Basta YL, Tytgat KMAJ, Greuter HH, et al. Organizing and implementing a multidisciplinary fast track oncology clinic. International journal for quality in health care: journal of the International Society for Quality in Health Care 2017; 29(7): 966–71. DOI: https://doi.org/10.1093/intqhc/mzx143
SONCOS Normeringsrapport 7, pagina’s 22–26 [Standardization report 7, pages 22–26]. https://www.soncos.org/kwaliteit/normeringsrapport2019(07/11):[in Dutch].
Munro AJ. Multidisciplinary Team Meetings in Cancer Care: An Idea Whose Time has Gone? Clinical oncology (Royal College of Radiologists (Great Britain)) 2015; 27(12): 728–31. DOI: https://doi.org/10.1016/j.clon.2015.08.008
van Huizen LS, Dijkstra PU, van der Laan BFAM, et al. Multidisciplinary first-day consultation accelerates diagnostic procedures and throughput times of patients in a head-and-neck cancer care pathway, a mixed method study. BMC health services research 2018; 18(1). DOI: https://doi.org/10.1186/s12913-018-3637-1
Vlaams Kankerregistratienetwerk. Vlaams Kankerregistratienetwerk [International Classification of Diseases for Oncology, third edition, updates]. https://www.rivm.nl/media/WHO-FIC/ICS-O-3.pdf 2011; 2019:[240 [in Dutch]].
Gioia DA, Gorley KG, Hamilton AL. Seeking Quality Rigor in Inductive Research: Notes on the Gioia Methodology. Organizational Research Methods 2012; 16(I): 15, 16–31. DOI: https://doi.org/10.1177/1094428112452151
O’Brien BC, Harris IB, Beckman TJ, et al. Standards for reporting qualitative research: a synthesis of recommendations. Academic medicine: journal of the Association of American Medical Colleges 2014; 89(9): 1245–51. DOI: https://doi.org/10.1097/ACM.0000000000000388
Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. International journal for quality in health care: journal of the International Society for Quality in Health Care 2007; 19(6): 349–57. DOI: https://doi.org/10.1093/intqhc/mzm042
Birt L, Scott S, Cavers D, et al. Member Checking: A Tool to Enhance Trustworthiness or Merely a Nod to Validation? Qualitative health research, 2016. DOI: https://doi.org/10.1177/1049732316654870
Segelman J, Singnomklao T, Hellborg H, et al. Differences in multidisciplinary team assessment and treatment between patients with stage IV colon and rectal cancer. Colorectal disease: the official journal of the Association of Coloproctology of Great Britain and Ireland 2009; 11(7): 768–74. DOI: https://doi.org/10.1111/j.1463-1318.2008.01648.x
Chinai N, Bintcliffe F, Armstrong EM, et al. Does every patient need to be discussed at a multidisciplinary team meeting? Clinical radiology 2013; 68(8): 780–4. DOI: https://doi.org/10.1016/j.crad.2013.02.011
de Ridder M, Balm AJM, Baatenburg de Jong RJ, et al. Variation in head and neck cancer care in the Netherlands: A retrospective cohort evaluation of incidence, treatment and outcome. European journal of surgical oncology: the journal of the European Society of Surgical Oncology and the British Association of Surgical Oncology 2017; 43(8): 1494–502. DOI: https://doi.org/10.1016/j.ejso.2017.02.017
Guy JB, Benna M, Xia Y, et al. Quality insurance in head and neck cancer multidisciplinary team meetings: A watchful eye on real-life experience. Oral oncology 2019; 91: 35–8. DOI: https://doi.org/10.1016/j.oraloncology.2019.02.020
Markar SR, Schmidt H, Kunz S, et al. Evolution of standardized clinical pathways: refining multidisciplinary care and process to improve outcomes of the surgical treatment of esophageal cancer. Journal of gastrointestinal surgery: official journal of the Society for Surgery of the Alimentary Tract 2014; 18(7): 1238–46. DOI: https://doi.org/10.1007/s11605-014-2520-6
Festen S, Kok M, Hopstaken JS, et al. How to incorporate geriatric assessment in clinical decision-making for older patients with cancer. An implementation study. Journal of geriatric oncology 2019; 10(6): 951–9. DOI: https://doi.org/10.1016/j.jgo.2019.04.006
Gagliardi AR, Simunovic M, Langer B, et al. Development of quality indicators for colorectal cancer surgery, using a 3-step modified Delphi approach. Canadian journal of surgery. Journal canadien de chirurgie 2005; 48(6): 441–52.
Vinod SK, Sidhom MA, Delaney GP. Do multidisciplinary meetings follow guideline-based care? Journal of oncology practice 2010; 6(6): 276–81. DOI: https://doi.org/10.1200/JOP.2010.000019
Gittell JH, Hajjar L. Strengthening Patient-Centered Care in the VHA: A Relational Model of Change. Journal of general internal medicine 2019; 34(Suppl 1): 7–10. DOI: https://doi.org/10.1007/s11606-019-04996-7
Noyes K, Monson JR, Rizvi I, et al. Regional Multiteam Systems in Cancer Care Delivery. Journal of oncology practice 2016; 12(11): 1059–66. DOI: https://doi.org/10.1200/JOP.2016.013896
Middenveldt I, Regts G. De ontwikkeling van oncologie netwerken in Nederland. [The development of Oncology Networks in the Netherlands.] Aanbevelingen rond organisatie en financiering. [Recommendations regarding organization and financing]. https://www.oncologienetwerken.nl/sites/default/files/2018-09/Oncologienetwerken%20en%20financiering%20-%20rapport.pdf 2018; [1,54 [in Dutch]].
van Huizen LS, Dijkstra P, Halmos GB, et al. Does multidisciplinary videoconferencing between a head-and-neck cancer centre and its partner hospital add value to their patient care and decision-making? A mixed-method evaluation. BMJ open 2019; 9(11): e028609. DOI: https://doi.org/10.1136/bmjopen-2018-028609
Gittell JH, Logan C, Cronenwett J, et al. Impact of relational coordination on staff and patient outcomes in outpatient surgical clinics. Health care management review 2020; 45(1): 12–20. DOI: https://doi.org/10.1097/HMR.0000000000000192
Fleissig A, Jenkins V, Catt S, et al. Multidisciplinary teams in cancer care: are they effective in the UK? The Lancet. Oncology 2006; 7(11): 935–43. DOI: https://doi.org/10.1016/S1470-2045(06)70940-8
Delilovic S, Hasson H, Ahstrom M, et al. Implementing standardized cancer patient pathways (CPPs) - a qualitative study exploring the perspectives of health care professionals. BMC health services research 2019; 19(1): 577. DOI: https://doi.org/10.1186/s12913-019-4413-6
Lamb BW, Sevdalis N, Mostafid H, et al. Quality improvement in multidisciplinary cancer teams: an investigation of teamwork and clinical decision-making and cross-validation of assessments. Annals of surgical oncology 2011; 18(13): 3535–43. DOI: https://doi.org/10.1245/s10434-011-1773-5
Ottevanger N, Hilbink M, Weenk M, et al. Oncologic multidisciplinary team meetings: evaluation of quality criteria. Journal of evaluation in clinical practice 2013; 19(6): 1035–43. DOI: https://doi.org/10.1111/jep.12022
Gort M, Broekhuis M, Regts G. How teams use indicators for quality improvement – a multiple-case study on the use of multiple indicators in multidisciplinary breast cancer teams. Social science & medicine (1982) 2013; 96: 69–77. DOI: https://doi.org/10.1016/j.socscimed.2013.06.001
Jalil R, Soukup T, Akhter W, et al. Quality of leadership in multidisciplinary cancer tumor boards: development and evaluation of a leadership assessment instrument (ATLAS). World journal of urology 2018; 36(7): 1031–8. DOI: https://doi.org/10.1007/s00345-018-2255-1
van der Werf LR, Kok NFM, Buis CI, et al. Implementation and first results of a mandatory, nationwide audit on liver surgery. HPB: the official journal of the International Hepato Pancreato Biliary Association 2019.
Deneckere S, Robyns N, Vanhaecht K, et al. Indicators for follow-up of multidisciplinary teamwork in care processes: results of an international expert panel. Evaluation & the health professions 2011; 34(3): 258–77. DOI: https://doi.org/10.1177/0163278710393736
Jalil R, Ahmed M, Green JS, et al. Factors that can make an impact on decision-making and decision implementation in cancer multidisciplinary teams: an interview study of the provider perspective. International journal of surgery (London, England) 2013; 11(5): 389–94. DOI: https://doi.org/10.1016/j.ijsu.2013.02.026
Lemieux-Charles L, McGuire WL. What do we know about health care team effectiveness? A review of the literature. Medical care research and review: MCRR 2006; 63(3): 263–300. DOI: https://doi.org/10.1177/1077558706287003
Dikken JL, Stiekema J, van de Velde CJ, et al. Quality of care indicators for the surgical treatment of gastric cancer: a systematic review. Annals of surgical oncology 2013; 20(2): 381–98. DOI: https://doi.org/10.1245/s10434-012-2574-1