Objective: The Perception of Interprofessional Collaboration-Model Questionnaire (PINCOM-Q) measures professionals’ perceptions of interprofessional collaboration in the field of child and youth mental health. The aim of this study was to validate the PINCOM-Q in a sample of German child welfare and child and youth mental health professionals.
Methods: The PINCOM-Q was translated into German and its underlying factor structure was examined using exploratory and confirmatory factor analysis.
Results and discussion: Findings from this study suggest four factors (Interprofessional Climate, Conflict, Role Expectancy and Shared Goals, and Motivation) capture the concept of perceptions of interprofessional collaboration between child welfare and child and adolescent psychiatry.
Conclusion: The use of PINCOM-Q (German) can be recommended as a research tool, investigating professional groups working with children and young people with multiple and complex needs.
Interprofessional collaboration (IPC), defined as ‘‘the process in which different professional groups work together to positively impact health care” , is a common and promising approach in the field of child and youth mental health . Studies show that the beneficial effects of psychotherapy on youth mental health are moderate in magnitude and only relatively durable . Other services geared to addressing the multitude of risk factors that contribute to mental health problems  are often also needed in the treatment process, including child and youth welfare services. It is estimated that about 50% of children and young people in the child welfare system and 75% of children living in residential care have complex mental health issues . Gaps in mental health care provision have been reported in particular for the residential care population, who tend to exhibit even more severe emotional and behavioural problems [6, 7]. Interagency collaboration between child welfare and mental health services has been shown to reduce care fragmentation, improve mental health outcomes, and increase service user engagement and satisfaction [8, 9]. Increasing attention is therefore placed on forging interprofessional collaboration between the different professional groups working with children and young people with complex mental health needs who also receive support from welfare services. However, as research on IPC is in a relatively early stage of development, there is a need for measurement tools that can generate empirical evidence on a larger scale to inform the international practice and policy debate about integrated care for children with multiple and complex needs [10, 11, 12].
The Perception of Interprofessional Collaboration Model-Questionnaire (PINCOM-Q) is a self-measurement tool developed by Ødegård [13, 14] with the purpose of measuring professionals’ perceptions of IPC in the field of child and youth mental health. The underlying assumption of the instrument is that professionals are attuned to key aspects of IPC most salient to them based on their experiences. It is suggested that PINCOM-Q can contribute to exploring shared perceptions or differences in perceptions among professionals in interprofessional groups and/or changes of perceptions over time [14, 15]. The scale consists of three dimensions, related to the individual, the group, and the organization. Each of these dimensions is respectively associated with four constructs (see Figure 1). The PINCOM-Q conceptualizes IPC as a broad concept and measures antecedents and processes. Two studies have examined the construct validity of the PINCOM-Q. Ødegård  used the scale with a sample of 134 professionals working in primary care, specialist mental health services and elementary schools and arrived at a revised 28-item scale with a six-factor structure. Strype et al.  used only items related to perceptions at the individual and at the group level with a sample of 157 members of local youth crime prevention committees and developed an 18-item scale with a three-factor structure. In both studies, the largest subscale (Interprofessional Climate/Group Climate) was composed of items describing social support and communication, which have both been shown to be central aspects of teamwork .
The main aim of the current study was to assess the underlying factor structure of the PINCOM-Q in a sample of professionals working in child welfare and child and adolescent psychiatry (CAP) in Germany. To our knowledge, no German version of the PINCOM-Q exists to this date. The specific aims were to a) translate the instrument into German and b) examine psychometric properties of the German version of the PINCOM-Q, using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). A culturally validated version of the PINCOM-Q could serve as a valuable contribution to the research field.
The development of PINCOM-Q was partly based on the results of a qualitative research study examining professionals’ perceptions of IPC in the child and youth mental health field in Western Norway [13, 14]. The scale further builds theoretically on the basic tenants of attribution theory and organisational psychology and measures perceptions of individual, group, and organisational aspects of IPC. At the individual level items represent the constructs personal motivation, role expectations, personality style, and professional power. The constructs at the group level are leadership, communication, coping and social support. At the organizational level the constructs are organizational culture, organizational aims, organizational domain, and organizational environment. Each construct consists of four items, in the following referred to as a, b, c, d. The questionnaire consists of 48 items and statements are rated on a seven-point Likert scale, ranging from strongly agree to strongly disagree. PINCOM-Q has been employed in different settings with a number of different professions and shows high external validity [15, 18, 19]. A recent systematic review of IPC measurement tools for interprofessional health and social care teams demonstrated the usefulness of the PINCOM-Q with regard to its psychometric properties and usefulness in the field of children’s services .
Data for the present study were collected within a larger mixed-methods study , examining the impact of a practice-based intervention on collaboration between child welfare and CAP in Northern Germany. A subsection of demographic questions inquiring about the participant’s professional background and years of work experience was included, along with a 12-item perception of interprofessional collaboration scale for children with complex mental health and social care needs, which we developed based on PINCOM-Q. This scale has not been validated yet.
Permission to use the PINCOM-Q was obtained from the originator. The cultural adaption process followed established guidelines . Two independent forward translations of the original English version of PINCOM-Q into German were carried out by a native-English speaking professional translator with no relevant knowledge about IPC and a first language German speaker with bilingual proficiency and experience in the mental health and social care field. Issues arising in the translation process were discussed and resolved with the first and second author. A German native speaker professionally translated the final German version back into English. All translations were subsequently submitted to a panel consisting of senior faculty members specialized in child welfare, experienced child mental health practitioners, and the first and second author. Conceptual equivalence of each item was again examined and discussed.
It was agreed between the translation and expert panel to retain all the 48 items of the original PINCOM-Q. One item was rephrased: “Some professionals supply the premises in interprofessional groups” on the subscale Professional Power was slightly modified to “Some professionals determine the underlying assumptions in interprofessional groups” to avoid ambiguity in the meaning of the word “premises”. The word “plan” used in two of the four items describing the construct Organizational Aims (“Interprofessional collaboration is well described in their plans” and “I am familiar with the plans of the other organizations”) was not translated literally (Plan), but we used the word “Leitbild” to refer to the overall concept underlying collaborative care planning, which is semantically closer to “mission statement”. Thirteen items were reverse coded, and all items were placed in random order on the questionnaire.
Paper and pencil version of the PINCOM-Q were distributed at project meetings and sent by post to two youth welfare offices, two public child and youth welfare agencies, and to one child and adolescent psychiatric hospital. The study employed a semi-experimental design and therefore a second convenience sample of participant data was collected in equivalent institutions in a neighbouring municipality. The purpose of the study was explained on the first page of the questionnaire and participants were asked to evaluate the interprofessional collaboration between child welfare and CAP based on their experiences. Participation was voluntary and all study participants gave written consent. Ethical approval was attained from all partaking institutions.
Items with the highest percentage of missing values were “Interprofessional collaboration is well described in their plans” (16.1%, n = 56), “Interprofessional work is an area of priority in the other organizations” (10.8%, n = 39), and “The other services have definite and clear aims regarding interprofessional collaboration” (7.5%, n = 27). Missing data for these three items was equally distributed between both cohorts and across professional backgrounds. All three items belonged to the construct Organizational Aims, which was excluded for further analysis. The average percentage of missing values for the remaining 44 items was 1.14% and the responses appeared to be missing completely at random.
The Statistical Package for Social Sciences  software was used to calculate descriptive statistics, internal consistency, and to carry out exploratory factor analysis. We used Cronbach’s alpha coefficients > .70 as a cut-off for an acceptable level of reliability  and excluded subscales with scores < .50 from factor analysis. The alpha coefficients of the subscales Motivation, Role Expectancy, Personal Style, Professional Power, Coping, Communication, Social Support, Organizational Culture, and Organizational Domain ranged between .55 and .72, indicating modest to good reliability. The subscales Group Leadership (α = .22) and Organizational Environment (α = .20) showed low reliability and were excluded. The relevance of the construct Group Leadership may have suffered due to the lack of a proximal work group  in the collaborative practice between CAP and child welfare services in our sample, where IPC is rather consultative in nature. We retained 36 parameters for analysis and therefore fulfilled the suggested 5 observations per item, and the minimum of 100 observations in total .
To determine if our material was appropriate for factor analysis, we used the Kaiser-Meyer-Olkin Measure of Sampling Adequacy  with a cut off of ≥ 0.5. Our method of extracting factors was principal axis factoring (PAF), as our aim was to explore the underlying structure of the PINCOM-Q in a German sample . Factor retention decisions were based on Kaiser’s criterion that eigenvalues be >1.0 (Nunnally, 1978), and an examination of the scree plot . We retained only factors with no less than three items . Items with loadings weaker than .40 and items that loaded ≥ .40 simultaneously on more than one factor were removed one by one. Confirmatory factor analysis was carried out using lavaan version 0.6–6  in R version 4.0.2 . We used maximum likelihood estimation with robust standard errors and a Satorra-Bentler scaled test statistic (MLM). Model fit was determined with the Comparative Fit Index (CFI), the Tucker Lewis Index (TLI), the Root Mean Square Error of Approximation (RMSEA), the Akaike’s information criterion (AIC), the Bayesian information criterion (BIC), and the Standardized Root Mean Residual (SRMR). For the CFI and TLI, 0.90 is considered the cut off for an adequate and ≥ 0.95 for a close fit of the model . In comparison, a model with a lower score for the AIC and BIC is the preferred model. For the RSMEA a value of ≤ 0.05 was considered a close fit and for the SRMR a value of ≤ 0.08 indicated an acceptable model .
Of the 360 respondents, 64.1% were social workers or child welfare workers, of which around 90% were employed in the child welfare sector. Mental health professionals (nurses, psychologists, psychotherapists, and psychiatrists) made up 27.5% of the entire sample and all of them were employed in the child and adolescent psychiatric hospital. Sixty-three percent of all participants had more than 10 years of experience, and 28% more than 20 years of relevant professional experience. Table 1 shows detailed characteristics of the two study samples.
|COHORT 1 (N = 201)||COHORT 2 (N = 159)|
|Child and adolescent psychiatry||84||42.2||68||43.0|
|Child and youth welfare office||82||41.2||48||30.4|
|Child and youth welfare services||21||10.6||26||16.5|
|Child welfare worker||31||16.0||33||20.9|
|under 5 years||41||21.1||31||19.7|
Thirty-six of the original 48 items of PINCOM-Q were subjected to an exploratory factor analysis. The adequacy of our sample was verified (KMO = .849) and a significant Bartlett’s test of sphericity X2 (630) = 2369.56, p < .01 indicated that data were suitable for factor analysis. The initial examination of the eigenvalues and the scree test indicated a four, five or six factor solution. A clean six-factor structure emerged after the removal of eleven items with loadings weaker than .40 and one cross-loaded item (“Everybody knows the area of responsibility of the other professionals”). Factor 6 consisted only of two items “Some professionals lack openness and do not participate much in interprofessional groups” and “Interprofessional collaboration calls for an openness of mind and not all professionals are able to live up to that” of the PINCOM-Q subscale personality style. Both items had high loadings (.81 and 83.), and factor six showed a low but acceptable level of reliability (α = .61). We extracted a five-factor model to see if these two items would group to one of the other five components and the requirement of at least three items loading above .40 would be fulfilled. This model explained 58.48% of the variance in the data and is shown in Table 2.
|CRONBACH’S ALPHA COEFFICIENT||.81||.79||.74||.60||.53||CRONBACH’S ALPHA IF ITEM DELETED|
|SUBSCALE/ITEM||FACTOR 1||FACTOR 2||FACTOR 3||FACTOR 4||FACTOR 5|
|1||Social Support a||.71||.78|
|2||Social support b||.67||.78|
|3||Social support c||.75||.77|
|4||Social support d||.60||.80|
|8||Professional power a||.81||.73|
|9||Professional power b||.68||74|
|10||Professional power c||.59||80|
|11||Professional power d||.76||.76|
|12||Personality style a||.76||.75|
|13||Personality style d||.64||.78|
|14||Role expectancy c||.82||68|
|15||Role expectancy d||.73||.63|
|16||Organization domain b||.72||.62|
|19||Organizational culture a||.82||.57|
|21||Organization domain a||.61||.40|
|22||Organization domain d||–59||.51|
|26||Role expectancy a||.55||.51|
|(Cumulative Contribution (%)||27.38%||40.31%||47.60%||53.48%||58.48%|
Factor 1 explained 27.38% percent of the variance and was composed of seven items with loadings ranging between .60 and .75. It was composed of the original subscale Social Support, with two items related to Communication and one item to Coping. The item with the highest loading was “I find that I am appreciated by other professionals in the interprofessional groups I participate in”. Factor 2 explained 12.93% of the variance and item loadings ranged between .64 and .81. Three items derived from the subscales Professional Power and two from Personality Style, with the highest loading item being “Some professionals act in ways that make interprofessional collaboration difficult”.
Factor 3 explained 7.29% of the variance and loadings ranged between .59 to .82. Factor 3 was composed of five items, of which three pertained to Role Expectation, one to Organizational Domain, and one to the construct Communication. The item with the highest loading was “In most of the interprofessional groups I participate in, we agree about priorities” (Coping). Factor 4 consisted of four items and explained a variance of 5.88%, with item loadings ranging between .59 and .81. The two items with the highest loadings were “The organizations are characterized by the wish to work interprofessionally” (Organisation Culture) and “We (employees) are encouraged to promote new ways of working in interprofessional groups” (Organizational Culture). Two items related to the importance of knowing relevant laws, regulations, and responsibilities (Organizational Domain). The smallest factor explained a variance of 5.0% and contained three items of the subscale Motivation and one item of the subscale Role Expectancy (“I always have clear goals when I work interprofessionally”). Item loadings ranged between .55 and .75 and the highest loaded item was “I find working in interprofessional groups valuable”.
After conducting exploratory factor analysis, we calculated Cronbach’s alpha for each of the five subscales of the PINCOM-Q (German). The cut off for good reliability (≥0.70) was met by three factors. Factor 1 Interprofessional Climate had a Cronbach’s alpha coefficient of 0.81, and factor 3 Role expectancy and Shared Goals had a value of 0.76. Deleting the item “Sometimes I am not able to present my perspectives because other high status professionals talk all the time” increased the value for factor 2 to .80. Cronbach’s alphas for factor 4 Organizational Culture (α = .60) and factor 5 Motivation (α = .53) indicated modest reliability.
We subjected the final 25-item five-factor model to a strict confirmatory factor analysis, without allowing any correlated errors in our modelling. The model fit indices nearly fulfilled all criteria for good model fit: χ2 (300) = 760.200, p < .01; RMSEA = 0.032 (90% CI, 0.032; 0.058); CFI = 0.95; TLI = 0.95; SRMR = 0.085; AIC = 6366.016; BIC = 6323.287. As shown in Figure 2, loadings ranged between .36 and .84, which is acceptably high. Factor 4 Organizational Culture showed a very high covariance with Factor 1 Interprofessional Climate (r = .87, p < .0001) and Factor 5 Motivation (r = .94, p < .0001), indicating that the constructs exhibited insufficient discriminant validity .
Modification indices suggested moving item 19 “The organizations are characterized by the wish to work interprofessionally”, and item 20 “We (the employees) are encouraged to promote new ways of working in interprofessional groups” from factor 5 Organizational Culture to factor 1 Interprofessional Climate. We deemed merging factor 5 and factor 1 theoretically justifiable and tested an alternative four-factor model. As shown in Figure 3, factor 1 Interprofessional Climate consisted in this model of ten items. We added item 19, 20 and 21 (“Laws and regulations are relatively well known by all the professionals in interprofessional groups”) but dropped item 43 (“We need to inform each other about our area of responsibility”), as this increased Cronbach’s alpha to .81. The final overall Cronbach alpha was .85, showing good internal consistency of the PINCOM-Q (G).
In this study, we present psychometric properties of the first German translation of the Perception of Interprofessional Collaboration-Questionnaire (PINCOM-Q). We arrived at our version of the PINCOM-Q (German), as shown in Table 3, following EFA and CFA using a sample of professionals collaborating at the intersection of child welfare and CAP. Our initial results suggested a five-factor structure, but due to high covariance between factors we merged factor 4 and factor 1 to yield a four-factor structure, which was eventually confirmed to be the best fit for our data. The PINCOM-Q (G) therefore shows very promising results in regard to measuring perceptions of interprofessional collaboration in a German-speaking sample.
|Subscale 1||Interprofessional climate||α = .81|
|1||I experience that I can get help and social support from the other professionals in the interprofessional groups I participate in|
|2||I find that other professionals in the interprofessional collaboration groups I participate in, arc willing to listen to me if I have problems|
|3||I find that I am appreciated by other professionals in the interprofessional groups I participate in|
|4||I have almost never found that other professionals do not understand what I am trying to express and/or report|
|5||I get relevant feedback on my contributions in the interprofessional groups I participate in|
|6||Professionals arc good at exchanging information with each other about how they work|
|7||We almost always solve the defined problems in the interprofessional group|
|8||The organizations are characterized by the wish to work interprofessionally|
|9||We (the employees) are encouraged to promote new ways of working in interprofessional groups|
|10||Laws and regulations arc relatively well known by all the professionals in interprofessional groups|
|Subsacle 2||Conflict||α = .80|
|1||Some professionals dominate the interprofessional meetings with their professional viewpoints*|
|2||Some professionals determine the underlying assumptions in interprofessional groups|
|3||Occasionally interprofessional groups do not work because some professionals dominate the meetings*|
|4||Some professionals act in ways that make interprofessional collaboration difficult*|
|5||Interprofessional collaboration calls for openness of mind and not all professionals are able to live up to that*|
|Subscale 3||Role expectancy and Shared Goals||α = .76|
|1||My experience is that our roles are always clearly defined|
|2||I experience that my area of responsibility is clearly defined when I work in interprofessional groups|
|3||Everybody knows their area of responsibility|
|4||In most of the interprofessional groups I participate in, we agree about priorities|
|5||In the interprofessional groups I participate in, exchange of information is never a problem|
|Subscale 4||Motivation||α = .53|
|1||I find working in interprofessional groups valuable|
|2||I get to use my creativity and imagination when I work in interprofessional groups|
|3||I experience personal growth when I work in interprofessional groups|
|4||I always have clear goals when I work interprofessionally|
|Total: 24 items||α = .85|
However, a few limitations apply. Discriminant and convergent validity are core elements of construct validation and should be investigated in future studies. Furthermore, in our analysis we reduced the original 48 items of the PINCOM-Q quite drastically to 24 items. This may have had a negative effect on content validity. Prior validation studies of the PINCOM-Q [14, 16] arrived at similarly trimmed versions and we therefore consider this acceptable, in terms of parsimony. This is the first attempt of a German translation of PINCOM-Q and we recommend that future studies undertake further steps of cross-cultural validation, such as conducting individual cognitive interviews with professionals that focus on evaluating each item thoroughly in regard to comprehensibility, conceptual equivalence, and practical usefulness.
The PINCOM-Q (G) showed overall satisfying internal consistency with a Cronbach’s alpha coefficient of .85. Coefficient scores for the subscales were above the recommended .70 cut off  for factor 1 (𝛼 = .81), factor 2 (𝛼 = .80) and factor 3 (𝛼 = .76), while factor 4 showed rather low reliability (𝛼 = .53). The results of our study are further indication that PINCOM-Q (G) is a reasonably valid and reliable tool to measure perceptions of IPC in the field of child and youth mental health. However, it is worth noting that reliability is dependent on context and not an inherent quality of the measurement . We used a small and possibly not entirely representative convenience sample, however, it was justified for use with an exploratory and confirmatory analysis.
Our largest subscale replicates the social support/communication items of the Interprofessional/Group Climate dimension reported in previous validation studies [14, 16]. In our study four additional items describing perceived effectiveness, organizational support and mutual awareness of systemic determinants of the specific IPC context also loaded on factor 1. This finding is unique as it captures organizational and group dimensional aspects in the construct underlying the dimension Interprofessional Climate. A strong correlation between the organizational dimension and the group dimension of the PINCOM-Q has been reported before in a sample of youth mental health professionals in Canada  and organisational support has been found to be associated with specialized mental health teams . From a conceptual point of view, it is reasonable to think that organizational support is critical for the interprofessional climate in working with children and young people with complex needs. IPC between child welfare and CAP frequently occurs in extreme situations, for example, if a child experiences serious family conflicts involving child protection and mental health services or a young person living in a residential group home is in a severe crisis that requires safety monitoring and psychiatric assessment. Professionals therefore often have to make decisions on the fly due to a high degree of urgency, complexity and unpredictability  of problems and need a strong organisational back up.
We labelled our second subscale “Conflict” as it describes the lack of openness and professional power as two different causes for contention in IPC. There is substantial evidence in the literature that IPC between social workers and medical professionals can be perceived as conflictual due to the fact that social work has traditionally been assigned the role of an ancillary profession to psychiatry [11, 37]. Unrelated to professional power, conflict may arise if professionals have negative perceptions about each other due to mistrust, stereotypes or low expectations as shown by Widmark et al.  in their study of social representations of IPC in the welfare sector. Results of our initial EFA indicated that a lack of openness resonated strongly with professionals in our sample and it may therefore be worth generating more items describing openness to different perspectives or openness to change, which have been shown to be relevant for IPC in general , and in particular with regard to young people in residential care .
The third subscale is unique to our validation study and we labelled it “Role Expectation and Shared Goals”. Interprofessional working relationships benefit from a clear distribution of roles and responsibilities among professionals with strong professional identities . However, the items of this subscale relate to both, professional identification (“My experience is our roles are always clearly defined”) and team identification (“In most of the interprofessional groups I participate in, we agree about the priorities”). Kebe et al. (2020) refer to this as multifocal identification, which they found to be a factor associated with IPC in specialized mental health care teams and primary mental health care teams in their study . Furthermore, professionals considered the successful exchange of information important in the division of responsibilities, suggesting that knowledge integration, a concept that “involves the development of a relational dynamic in which professionals influence each other in analysing the situations encountered, and in articulating a shared vision and plan of action”  is a relevant component of developing shared goals.
The fourth factor labelled “Motivation” was reported in both prior validation studies [14, 16] and replicates items of the original construct, and one additional item “I always have clear goals when I work interprofessionally”. This makes conceptual sense as it has been shown that IPC can have negative impacts, such as an increased workload  or putting professionals under additional stress . A clear vision of the potential benefits can increase motivation, commitment, and willingness to collaborate.
Our goal was to provide a useful tool to German speakers investigating perceptions of IPC at the intersection of the child welfare and child mental health system. Given that previous research has shown that professionals working at the intersection of child welfare and child mental health face similar challenges across cultures , we assume that our study also has merit for the international community. The psychometric properties of the German version of the PINCOM-Q are comparable to the English language version of the scale. As the original version of the scale has only been validated in a Norwegian context, future validation studies of the PINCOM-Q should use English-speaking samples to add to the conceptualization of IPC as a construct.
Our data suggests that professionals perceived the relational quality of IPC to be the central element of their collaborative practice. This finding is in line with recent international qualitative research showing that professionals working with children with complex needs across settings and disciplinary background emphasize the importance of mutual understanding, shared thinking, and familiarity with other professionals [2, 10, 43]. Further studies should therefore build on our results and use the scale to measure changes of perceptions of IPC over time that may indicate effects of longer-term practice-based IPC interventions, such as interprofessional education or joint care planning.
To further the conceptual clarity of the Interprofessional Climate dimension of the PINCOM-Q (G), we suggest that future studies examine the relationship between the PINCOM-Q and the Team Climate Inventory developed by Anderson and West  to see if there is an underlying connection with the construct “Participative Safety”. The emphasis on a positive work environment as a necessary condition for shared decision-making seems relevant as Rousseau et al.  reported a moderate correlation between the PINCOM-Q and an adapted version of the Decisional Conflict Scale. This may indicate that creating an atmosphere that allows shared-decision making is an aspect of the construct Interprofessional Climate and a component of the nomological network surrounding the PINCOM-Q .
This study contributes to the interprofessional measurement literature by adding to the construct validation process of a tool that has already been established. Findings from this study suggest a four-factor structure of the PINCOM-Q (G) and the translation into German was successful. The tool can therefore be considered a valid and reliable instrument for assessing professionals’ perceptions of IPC with children and young people with complex needs.
Tonelle Handley, Centre for Rural and Remote Mental Health, University of Newcastle, Australia.
Dr Helena Van den Steene, UKJA, afdeling Jonge Kind en Gezin, Ziekenhuisnetwerk Antwerpen and Universiteit Antwerpen, Vakgroep CAPRI – Jeugd, Belgium.
The authors have no competing interests to declare.
Reeves S, Pelone F, Harrison R, Goldman J, Zwarenstein M. Interprofessional collaboration to improve professional practice and healthcare outcomes. Cochrane Database Syst Rev [Internet]. 2017 Jun 22 [cited 2020 Jul 27]; 2017(6). Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6481564/.
Cooper M, Evans Y, Pybis J. Interagency collaboration in children and young people’s mental health: a systematic review of outcomes, facilitating factors and inhibiting factors. Child: Care, Health and Development. 2016 May; 42(3): 325–42. DOI: https://doi.org/10.1111/cch.12322
Weisz JR, Kuppens S, Ng MY, Vaughn-Coaxum RA, Ugueto AM, Eckshtain D, et al. Are Psychotherapies for Young People Growing Stronger? Tracking Trends Over Time for Youth Anxiety, Depression, Attention-Deficit/Hyperactivity Disorder, and Conduct Problems. Perspectives on Psychological Science: A Journal of the Association for Psychological Science. 2019; 14(2): 216–37. DOI: https://doi.org/10.1177/1745691618805436
Patel V, Flisher AJ, Hetrick S, McGorry P. Mental health of young people: a global public-health challenge. Lancet (London, England). 2007 Apr 14; 369(9569): 1302–13. DOI: https://doi.org/10.1016/S0140-6736(07)60368-7
Bronsard G, Alessandrini M, Fond G, Loundou A, Auquier P, Tordjman S, et al. The Prevalence of Mental Disorders Among Children and Adolescents in the Child Welfare System: A Systematic Review and Meta-Analysis. Medicine. 2016 Feb; 95(7): e2622. DOI: https://doi.org/10.1097/MD.0000000000002622
Burns BJ, Phillips SD, Wagner HR, Barth RP, Kolko DJ, Campbell Y, et al. Mental health need and access to mental health services by youths involved with child welfare: a national survey. Journal of the American Academy of Child and Adolescent Psychiatry. 2004 Aug; 43(8): 960–70. DOI: https://doi.org/10.1097/01.chi.0000127590.95585.65
Stanley N, Riordan D, Alaszewski H. The mental health of looked after children: matching response to need. Health & Social Care in the Community. 2005 May; 13(3): 239–48. DOI: https://doi.org/10.1111/j.1365-2524.2005.00556.x
Bai Y, Wells R, Hillemeier MM. Coordination between child welfare agencies and mental health providers, children’s service use, and outcomes. Child abuse & neglect [Internet]. 2009 Jun [cited 2020 Nov 23]; 33(6): 372–81. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2694225/. DOI: https://doi.org/10.1016/j.chiabu.2008.10.004
Hurlburt MS, Leslie LK, Landsverk J, Barth RP, Burns BJ, Gibbons RD, et al. Contextual Predictors of Mental Health Service Use Among Children Open to Child Welfare. Archives of General Psychiatry. 2004; 61(12): 1217–24. DOI: https://doi.org/10.1001/archpsyc.61.12.1217
Nooteboom LA, Mulder EA, Kuiper CHZ, Colins OF, Vermeiren RRJM. Towards Integrated Youth Care: A Systematic Review of Facilitators and Barriers for Professionals. Administration and Policy in Mental Health and Mental Health Services Research [Internet]. 2020 May 18 [cited 2020 Nov 21]. DOI: https://doi.org/10.1007/s10488-020-01049-8
Timonen-Kallio E. Interprofessional collaboration between residential child care and mental care practitioners: a cross-country study in six European countries. European Journal of Social Work [Internet]. 2019 Nov 2 [cited 2020 Nov 22]; 22(6): 947–60. DOI: https://doi.org/10.1080/13691457.2018.1441135
Van den Steene H, van West D, Peeraer G, Glazemakers I. Professionals’ views on the development process of a structural collaboration between child and adolescent psychiatry and child welfare: an exploration through the lens of the life cycle model. European Child & Adolescent Psychiatry. 2018 Dec; 27(12): 1539–49. DOI: https://doi.org/10.1007/s00787-018-1147-7
Ødegård A. Perceptions of interprofessional collaboration in relation to children with mental health problems. A pilot study. Journal of Interprofessional Care. 2005 Aug; 19(4): 347–57. DOI: https://doi.org/10.1080/13561820500148437
Ødegård A. Exploring perceptions of interprofessional collaboration in child mental health care. International Journal of Integrated Care [Internet]. 2006 Dec 18 [cited 2015 May 2]; 6. Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1762090/. DOI: https://doi.org/10.5334/ijic.165
Ødegård A, Strype J. Perceptions of interprofessional collaboration within child mental health care in Norway. Journal of Interprofessional Care. 2009 May; 23(3): 286–96. DOI: https://doi.org/10.1080/13561820902739981
Strype J, Gundhus H, Egge M, Ødegård A. Perceptions of Interprofessional Collaboration. Professions and Professionalism. 2014 Oct 21; 4. DOI: https://doi.org/10.7577/pp.806
Hewitt G, Sims S, Harris R. Using realist synthesis to understand the mechanisms of interprofessional teamwork in health and social care. J Interprof Care. 2014 Nov; 28(6): 501–6. DOI: https://doi.org/10.3109/13561820.2014.939744
Rousseau C, Laurin-Lamothe A, Nadeau L, Deshaies S, Measham T. Measuring the quality of interprofessional collaboration in child mental health collaborative care. International Journal of Integrated Care [Internet]. 2012 Feb 10 [cited 2020 Feb 7]; 12. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3287319/. DOI: https://doi.org/10.5334/ijic.676
Hynek KA, Malmberg-Heimonen I, Tøge AG. Improving interprofessional collaboration in Norwegian primary schools: A cluster-randomized study evaluating effects of the LOG model on teachers’ perceptions of interprofessional collaboration. Journal of Interprofessional Care [Internet]. 2020 Jan 13 [cited 2020 Nov 23]; 0(0): 1–10. DOI: https://doi.org/10.1080/13561820.2019.1708281
Jacob J, Boshoff K, Stanley R, Stewart H, Wiles L. Interprofessional collaboration within teams comprised of health and other professionals: a systematic review of measurement tools and their psychometric properties. 2017; 14.
Groen G, Jörns-Presentati A. Grenzgänger kooperative Abstimmung von Hilfen für Kinder und Jugendliche zwischen Kinder- und Jugendhilfe und Kinder- und Jugendpsychiatrie. Köln: Psychiatrie Verlag; 2018.
Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. Journal of Clinical Epidemiology. 1993 Dec; 46(12): 1417–32. DOI: https://doi.org/10.1016/0895-4356(93)90142-N
IBM Corp. Released 2019. IBM SPSS Statistics for Windows, Version 26.0. Armonk, NY: IBM Corp [Internet]. [cited 2020 Nov 23]. Available from: https://www.scirp.org/(S(i43dyn45teexjx455qlt3d2q))/reference/ReferencesPapers.aspx?ReferenceID=1914050.
Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ [Internet]. 2011 Jun 27 [cited 2020 Nov 23]; 2: 53–5. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4205511/. DOI: https://doi.org/10.5116/ijme.4dfb.8dfd
Anderson NR, West MA. Measuring climate for work group innovation: development and validation of the team climate inventory. Journal of Organizational Behavior [Internet]. 1998 [cited 2020 Nov 24]; 19(3): 235–58. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1002/%28SICI%291099-1379%28199805%2919%3A3%3C235%3A%3AAID-JOB837%3E3.0.CO%3B2-C.
Bryant FB, Yarnold PR. Principal-components analysis and exploratory and confirmatory factor analysis. In: Reading and understanding multivariate statistics. Washington, DC, US: American Psychological Association. 1995; 99–136.
Kaiser HF. An index of factorial simplicity. Psychometrika [Internet]. 1974 Mar 1 [cited 2020 Nov 23]; 39(1): 31–6. DOI: https://doi.org/10.1007/BF02291575
Costello AB, Osborne J. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. [cited 2020 Nov 23]. Available from: https://scholarworks.umass.edu/pare/vol10/iss1/7/.
Cattell RB. The scientific use of factor analysis in behavioral and life sciences [Internet]. New York: Plenum Press; 1978 [cited 2020 Nov 23]. Available from: https://www.worldcat.org/title/scientific-use-of-factor-analysis-in-behavioral-and-life-sciences/oclc/3204221. DOI: https://doi.org/10.1007/978-1-4684-2262-7
Rosseel Y. lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software [Internet]. 2012 [cited 2020 Nov 23]; 048(i02). Available from: https://ideas.repec.org/a/jss/jstsof/v048i02.html.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal [Internet]. 1999 Jan 1 [cited 2020 Nov 23]; 6(1): 1–55. DOI: https://doi.org/10.1080/10705519909540118
Kebe, NNMK, Chiocchio F, Bamvita J-M, Fleury M-J. Variables associated with interprofessional collaboration: a comparison between primary healthcare and specialized mental health teams. BMC Family Practice [Internet]. 2020 Jan 8 [cited 2020 Nov 24]; 21(1): 4. DOI: https://doi.org/10.1186/s12875-019-1076-7
Reeves S, Xyrichis A, Zwarenstein M. Teamwork, collaboration, coordination, and networking: Why we need to distinguish between different types of interprofessional practice. Journal of Interprofessional Care [Internet]. 2018 Jan 2 [cited 2020 Feb 7]; 32(1): 1–3. Available from: https://www.tandfonline.com/doi/full/10.1080/13561820.2017.1400150. DOI: https://doi.org/10.1080/13561820.2017.1400150
Ambrose-Miller W, Ashcroft R. Challenges Faced by Social Workers as Members of Interprofessional Collaborative Health Care Teams: Table 1. Health & Social Work [Internet]. 2016 May [cited 2018 May 8]; 41(2): 101–9. Available from: https://academic.oup.com/hsw/article-lookup/doi/10.1093/hsw/hlw006. DOI: https://doi.org/10.1093/hsw/hlw006
Widmark C, Sandahl C, Piuva K, Bergman D. What do we think about them and what do they think about us? Social representations of interprofessional and interorganizational collaboration in the welfare sector. J Interprof Care. 2016; 30(1): 50–5. DOI: https://doi.org/10.3109/13561820.2015.1055716
Mitchell R, Nicholas S, Boyle B. The Role of Openness to Cognitive Diversity and Group Processes in Knowledge Creation. Small Group Research [Internet]. 2009 Oct 1 [cited 2020 Feb 10]; 40(5): 535–54. DOI: https://doi.org/10.1177/1046496409338302
Willumsen E, Hallberg L. Interprofessional collaboration with young people in residential care: some professional perspectives. Journal of Interprofessional Care [Internet]. 2003 Jan 1 [cited 2015 May 8]; 17(4): 389–400. Available from: http://informahealthcare.com/doi/abs/10.1080/13561820310001608212. DOI: https://doi.org/10.1080/13561820310001608212
D’Amour D, Oandasan I. Interprofessionality as the field of interprofessional practice and interprofessional education: an emerging concept. Journal of Interprofessional Care. 2005 May; 19 Suppl 1: 8–20. DOI: https://doi.org/10.1080/13561820500081604
Ndibu Muntu Keba Kebe N, Chiocchio F, Bamvita J-M, Fleury M-J. Profiling mental health professionals in relation to perceived interprofessional collaboration on teams. SAGE Open Med [Internet]. 2019 Mar 29 [cited 2020 Nov 16]; 7. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6444404/. DOI: https://doi.org/10.1177/2050312119841467
Rumping S, Boendermaker L, Ruyter DJ de. Stimulating interdisciplinary collaboration among youth social workers: A scoping review. Health & Social Care in the Community [Internet]. 2019 [cited 2020 Jul 27]; 27(2): 293–305. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1111/hsc.12589. DOI: https://doi.org/10.1111/hsc.12589
Rauvola RS, Briggs EP, Hinyard LJ. Nomology, validity, and interprofessional research: The missing link(s). Journal of Interprofessional Care [Internet]. 2020 Jul 3 [cited 2020 Nov 23]; 34(4): 545–56. DOI: https://doi.org/10.1080/13561820.2020.1712333