Criteria used to diagnose personality disorders (PD) have been extensively criticised in the succeeding editions of the Diagnostic and Statistical Manual of Mental Disorders (DSM). Among these objections, the lack of theoretical and empirical support for the delimitation of the PD’s 10 categories stands out as a major issue. That lack of evidence generated clinical issues for practitioners, such as difficulties to describe an individual’s singularity using a unique diagnostic category. These issues led to an increase of cases labelled as unspecified PD, along with high comorbidity rates (e.g., Hopwood et al., 2011; Krueger et al., 2011). As a result, DSM-5 (American Psychiatric Association, 2013a) added the Section III, referred to Emerging Measures and Models. Among these models, an alternative approach to diagnose PDs, differing from the traditional categorical classification comprised in Section II was introduced. Such new approach includes criteria based on a hybrid dimensional-categorical model. On the one hand, the goal is to achieve a categorical diagnose of six PDs on the grounds of several dimensions defined by Criterion A and Criterion B. On the other hand, the continuity of the adaptive and pathological personality represents the core of this approach, therefore making it useful to describe community population.
Criterion A suggests analysing the levels of impairment in personality regarding both self and interpersonal functioning. As for the self functioning, two areas are taken into account: 1) identity, characterised by neat boundaries between the self and other persons, a sound self-esteem, and an appropriate regulation of emotions, and, 2) self-direction, which implies seeking realistic goals, according to prosocial and constructive behaviours, as well as the ability to be self-reflective. Concerning the interpersonal functioning, it encompasses: 1) empathy, involving the ability to understand and sympathise with other people’s feelings, as well as being aware of the impact of the own behaviour in other persons‘ lives, and 2) intimacy, linked to the desire of bonding and the development of close and mutual relationships.
Criterion B introduces 25 pathological personality trait facets, grouped into five trait domains: negative affectivity – experiencing negative emotions and their behavioural outcomes, detachment – avoiding interaction with others and restricting emotional experience, antagonism – behaving in a way that causes conflict with others, always acting to take advantage, disregarding people‘s needs and feelings due to an egotistic attitude, disinhibition – impulsive behaviour aimed at immediate satisfaction, and psychoticism – eccentric behaviour and ideation compared to those which are common in the cultural environment where the individual was raised.
Due to the fact that the Personality Inventory for DSM-5 (PID-5; American Psychiatric Association, 2013b; Krueger, Derringer, Markon, Watson, & Skodol, 2012) was developed to measure Criterion B, it has drawn more attention than Criterion A. PID-5 also has two short forms (e.g. American Psychiatric Association, 2013c; Góngora & Castro Solano, 2017b; Maples et al., 2015), and an informant-report version (PID-5-IRF; Markon, Quilty, Bagby, & Krueger, 2013), whose psychometric features were examined in various studies (e.g., Al-Dajani, Gralnick, & Bagby, 2016; Zimmermann, Kerber, Rek, Hopwood, & Krueger, 2019).
Although many measures of Criterion A have been developed, results regarding their structure are not conclusive. Moreover, none of these measures was developed taking into account the Latin American culture or the Spanish language. DSM-5 introduces the Level of Personality Functioning Scale (LPFS), which entails the description of the four dimensions above mentioned (identity, self-direction, empathy, intimacy) according to different levels of severity, ranked from “little or no impairment“ to “extreme“ level of impairment. Following such descriptions, clinicians must estimate the severity of the examinee’s symptoms. The LPFS first validity evidences analysis was conducted by Bender, Morey, and Skodol (2011). LPFS’s utility as a diagnostic method has been verified, no matter the expertise of the examiner (e.g., Buer Christensen et al., 2018; Zimmermann et al. 2014, 2015). Additionally, it is worth mentioning that self-report measures developed to assess Criterion A are scarce and incipient (Zimmermann et al., 2019).
The pioneer studies were performed in Germany, where Hutsebaut, Feenstra, and Kamphuis (2016) developed the Level of Personality Functioning Scale–Brief Form (LPFS-BF), composed of 12 items. A principal components analysis found a structure representing the Self-Functioning and the Interpersonal Functioning dimensions (35.2% of explained variance), with internal consistency values of α = .57, and α = .65. Moreover, patients obtained significantly higher scores compared to a community sample. Convergent validity evidences with the Brief Symptom Inventory (BSI; de Beurs & Zitman, 2006), which is a general measure of pathology, were also analysed. The correlation between the LPFS-BF and the BSI scores achieved an r = .51 for Self-Functioning, whilst Interpersonal Functioning obtained r = .38. Later on, Weekers, Hutsebaut, and Kamphuis (2019) developed the LPFS-BF 2.0 on the basis of LPFS-BF. This new scale presents alterations in 3 items as well as in the response scale, to make it alike the PID-5. A confirmatory factor analysis conducted on a clinical sample verified the same factors which were found in the previous principal components analysis. The association between factors was moderate (r = .44).
Morey (2017) developed the Level of Personality Functioning Scale–Self Report (LPFS-SR). It includes 80 items assessing the four dimensions composing Criterion A. Studies on psychometric features were performed on an American sample. A principal components analysis using the four scores as input variables found a unique factor explaining 85.5% of the variance. Such factor was identified as a global dimension of impairment, feasible to be observed in the intrapersonal or/and the interpersonal sphere. This global impairment score obtained high correlation coefficients (r = .72, and r = .85) with several measures of personality disorders, such as the General Assessment of Personality Disorder (GAPD; Livesley, 2009), and the General Personality Pathology Scale (GPP; Morey et al., 2011). As for the internal consistency, Cronbach´s Alpha coefficients were .96 for the total score and ranged from .81 to .89 for the dimensions. Hopwood et al. (2018) followed Morey´s studies (Morey, 2017), replicating the principal components analysis, finding a unique factor as well. The scale’s internal consistency was α = .92, with coefficients ranging from .92 to .80 regarding the four dimensions. Correlations between LPFS-SR and the dimensions composing the Big Five Inventory–2 (Soto & John, 2017) were significant. Neuroticism obtained high correlations with the LPFS-SR total score (r = .60), with the Self Domain (r = .67), and with the Interpersonal Domain (r = .47). Conscientiousness, Agreeableness, Extraversion, Openness obtained negative values with both domains and with the LPFS-SR total score (-.30 to -.58). The analysis of the link between Criterion A and Criterion B showed that 18 out of the 25 PID-5 pathological personality trait facets reached correlations higher than .50 with the LPFS-SR dimensions.
Also in the United States, this time analysing a clinical sample, Huprich et al. (2018) developed the DSM-5 Levels of Personality Functioning Questionnaire (DLOPFQ), composed of 132 items assessing the 4 dimensions that were introduced in the DSM-5. Such 4 dimensions were afterwards divided into the Social and Work subscales, leading to 8 different scores. Results showed an internal consistency with Cronbach´s Alphas between .72 and .80. Every scale was positively correlated with the scales composing the short version of PID-5, with Pearson´s r indices from .21 to .70. Associations between the 8 dimensions of DLOPFQ with Antagonism and Detachment were high. Negative associations with the Swartz Outcome Scale–10 (SOS-10; Baity, Kehl-Fie, & Blais, 2009), which assesses psychological well-being, were also found (between -.25 and -.59). Further studies on DLOPFQ raised the question about the pertinence of dividing the 4 areas (Self-Direction, Identity, Intimacy, Empathy) into Social and Work subscales, therefore considering 8 scores (Nelson et al., 2018). After that, they developed a short version (DLOPFQ-SF), selecting 24 items following expert advice. An exploratory factor analysis conducted on a sample of patients and non-patients found a 4-factor structure explaining 52.9% of the variance. Since some items loaded on two factors, a 1-factor, a 2-factor and a 3-factor model were tested by confirmatory factor analyses. Findings showed a better fit for the 4-factor model, even though items with double loadings were admitted. Correlations with psychological well-being, measured by SOS-10, obtained negative coefficients (Pearson’s r from -.24 to -.56). Internal consistency was adequate (α = .73 / α = .96).
The Self and Interpersonal Functioning Scale (SIFS) is another example of a test to measure Criterion A. It was developed by Gamache, Savard, Leclerc, and Côté (2019), and the psychometric analyses were performed on Canadian community and clinical samples. A 4-factor-24-item model was confirmed by the factor analysis procedure. A second-order analysis obtained one general personality pathology factor. Regarding the scores’ reliability, Cronbach’s Alphas indicating internal consistency ranged from .60 to .92, and stability reliability found Pearson’s r coefficients between .63 and .91. Significant differences in items’ scores by group (community sample versus clinical sample) were verified, except for two items. However, authors maintained such items in the final version of the scale. Besides, correlations between SIFS’ scores and the Criterion B domains, measured by PID-5, were positive and high (r = .49 to r = .81).
Finally, the unique study conducted on adolescents (12 to 18-year-old children) deserves a special mention (Goth, Birkhölzer, & Schmeck, 2018). It developed the Levels of Personality Functioning (LoPF–Q 12–18), composed of 97 items, whose features were analysed on clinical and community samples from Switzerland, Austria, and Germany. Exploratory factor analysis reported a 4-factor structure explaining 39.9% of the variance. Most of the items (72.2%) showed loadings higher than .30 in only one factor. Statistically significant differences were found in average scores obtained by a clinical sample versus a school sample. Internal consistency ranged from .76 to .92. Table 1 summarises features of the scales above mentioned.
Table 1
Author | Scale | Country | Participant | Item | Factor | Type of factor analysis | α |
---|---|---|---|---|---|---|---|
Hutsebaut et al. (2016) | LPFS-BF | Netherlands | 240 adults (patients) | 12 | 2 | PCA | .57/.65 |
Weekers et al. (2019) | LPFS-BF 2.0 | Netherlands | 229 adults (patients) | 12 | 2 | CFA | - |
Morey (2017) | LPFS-SR | EEUU | 306 adults (community) | 80 | 1 | PCA | .96 |
Hopwood et al. (2018) | LPFS-SR | EEUU | 1976 adults (community) | 80 | 1 | PCA | .92 |
Huprich et al. (2018) | DLOPFQ | EEUU | 140 adults (patients) | 132 | 8 | - | .72/.80 |
Siefert et al. (2019) | DLOPFQ-SF | EEUU | 500 adults (community), 135 adults (patients), 644 adults (college students) | 24 | 4 | EFA CFA |
.73/.96 |
Gamache et al. (2019) | SIFS | Canada | 280 adults (community), 106 adults (patients) | 24 | 4 | CFA | .60/.92 |
Goth et al. (2018) | LoPF–Q 12–18 | Switzerland, Austria, Germany | 351 adolescents (students), 415 adolescents (patients) | 97 | 4 | EFA | .76/.92 |
Note. PCA = principal component analysis; EFA = exploratory factor analysis; CFA = confirmatory factor analysis.
The scales previously described present an inconvenient to be highlighted. On the one hand, the diversity of dimensions found by different authors did not reach consensus on the measurement of Criterion A. On the other hand, no scale has been designed taking into consideration the specificities of the Spanish language. Furthermore, Latin America shows a lack of studies analysing Criterion A or developing measures of it. As a matter of fact, only scales assessing Criterion B are available for clinicians and researchers (e.g., Góngora & Castro Solano, 2017b; Stover, Castro Solano, & Fernández Liporace, 2019). As a result, this study is aimed at developing a scale to measure personality functioning in terms of the self and interpersonal dimensions introduced in DSM-5. It is also aimed at analysing its psychometric features in order to make the scale suitable to be used in local population.
Method
Design
A non-experimental and cross-sectional design was conducted.
Participants
A non-probabilistic sampling was employed. 342 adults from Buenos Aires city and its outskirts (50% females, 50% males) with ages between 19 and 75 years old (M = 39.90, SD = 13.75) participated. Most of them had a job (78.9%). The remaining percentages were as follows: housewives/househusbands (4.4%), retired (5%), unemployed looking for a job (4.7%), and unemployed not looking for a job (7%). As for educational qualifications, high school graduates represented the higher percentage, with 48.9% whilst 44% were college graduates. Smaller percentages corresponded to the ones graduated from Elementary school (6.7%), and those who dropped that educational stage (0.3%).
Material
Sociodemographic Survey
It gathers information on gender, age, educational status, and occupation.
Personality Functioning Scale (PFS)
28 items to assess impairment in personality regarding self and interpersonal functioning were developed. A 4-point Likert response scale from Totally false to Very true was employed.
Personality Inventory for DSM-5 Brief Form (PID-5-BF)
The short local and adapted version of PID-5-BF (Góngora & Castro Solano, 2017b) is composed of 25 items using a 4-point Likert response from Very false or Often false to Very true or Often true. Five major domains are measured: Negative Affectivity, Disinhibition, Detachment, Antagonism, Psychoticism. An exploratory factor analysis found five factors. Their internal consistency ranged between α = .86 to α = .90.
Mental Health Continuum Short Form (MHC-SF)
MHC-SF (Keyes, 2005; Lupano Perugini, de la Iglesia, & Castro Solano, 2017) is composed of 14 items assessing Emotional, Social and Psychological Well-being. It also includes a total score indicating the examinee’s positive mental health. Emotional Well-being coincides with the hedonic well-being, whilst the other two dimensions correspond to eudemonic well-being. Items include a 5-point Likert response, from Never to Every day. A confirmatory factor analysis found three factors with adequate internal consistency indices (α = .78, α = .89).
Symptom Check List 27 (SCL-27)
SCL-27 (de la Iglesia & Castro Solano, 2019; Hardt & Gerbershagen, 2001) is a short version of the SCL-90-R (Casullo & Pérez, 2008; Derogatis, 1983). It is composed of 27 items responded by a 5-point Likert scale (Not at all to Extremely), assessing psychopathological unspecified symptoms suffered in the last week. Its 1-dimension structure was verified by a confirmatory factor analysis, and its internal consistency, estimated by Cronbach’s Alpha was .92.
Procedure
Considering previous studies and the DSM-5 guidelines, items to assess impairments in personality functioning in terms of self and interpersonal domains were developed. Five experts examined those items following recommendations for short scales’ development (Stanton, Sinar, Balzer, & Smith, 2002). 28 items were selected according to how well they met DSM-5’s criteria (American Psychiatric Association, 2013a). Later, a pilot study, aimed at examining the items clarity, was run with 20 adults. Although all of the items remained, a few minor modifications in the statements were made. The Appendix contains the version developed in Spanish.
After conducting the procedures above described, data were gathered in individual sessions. Psychology undergraduates collaborated under the supervision of trained psychologists. Participants volunteered and no retribution was given, neither economical nor academic. An informed consent signed by the participants guaranteed confidentiality of results and anonymity. Participants were told about the feasibility of ceasing participation at any moment of the process. Eight answer sheets, which showed many non-responded items were left out.
Data Analysis
Construct validity evidences of the scale were examined by means of a minimum rank factor analysis. A polychoric covariance matrix was employed since the response scale was ordinal (Muthén & Kaplan, 1985). Ordinal Alpha coefficients were calculated to estimate internal consistency of scores (Elosúa & Zumbo, 2008). Such analyses were conducted using the FACTOR software (Lorenzo-Seva & Ferrando, 2013). Additionally, Cronbach’s Alphas were also determined. The Attenuation Index was used to estimate which percentage of the theoretical internal consistency decreased when Cronbach’s Alpha was calculated (Dominguez-Lara, 2018).
Pearson’s r coefficients between the scale´s scores, the short version of the PID-5 scores, the SCL-27 score and de MHC score were calculated, in order to analyse criterion validity evidences. The effect sizes of the correlations were examined regarding the following cut-off points: small = .10, medium = .30, large = .50 (Cohen, 1988). Such calculations were run employing PASW Statistics for Windows, Version 18.0 (SPSS, 2009).
Results
Construct Validity
A minimum rank factor analysis with a direct oblimin rotation was performed, in order to examine construct validity evidences. Prior to that, a polychoric correlations matrix was generated. The parallel analysis method (Horn, 1965) suggested the retention of two factors. Items 14 and 27 were excluded since they showed cross-loadings that are less than .10, different from the loading on the factor of interest. The sample size was adequate for the calculations which were performed (KMO = .923; Bartlett’s Sphericity Test: χ2 = 3389.1, df = 325; p < .01). The explained total variance was 51.33%, mostly by the first factor (43.73%), whereas the second factor explicative percentage was, comparatively, much lower (7.59%). Regarding the content of the items, factors were identified as Interpersonal (F1) and Self (F2). Table 2 shows factorial loadings higher than .40 in bold. The correlation between factors was positive and large (r = .663; p < .01).
Table 2
Item | F1 | F2 |
---|---|---|
1. Close relationships rarely end up well. | .753 | .061 |
3. Even though I try, I’m not able to maintain long-term successful relationships. | .627 | .116 |
5. I don´t care much about having close relationships. | .910 | -.109 |
7. Since close relationships make me feel helpless, they aren’t worth the risk. | .717 | .101 |
9. I could only bond closely with someone able to perceive and respond to my needs. | .510 | .016 |
11. I can’t stand when someone has an opinion quite different from mine. | .554 | .147 |
13. I can´t understand why people act in the way they do. | .652 | -.010 |
15. I seldom have many pleasant or positive interactions with people. | .795 | -.023 |
17. I don´t care about the consequences of my actions that might affect other people. | .816 | -.099 |
19. I don´t have a clue about other people’s intentions. | .656 | .047 |
21. Many people have harmful intentions. | .464 | .250 |
23. Relationships are often painful, and they also make me suffer. | .588 | .285 |
25. Every now and then, ignoring the outcomes of my behaviour on others is easy for me. | .612 | .068 |
2. Understanding the distinction between what I think and what others expect me to think can be hard for me. | .085 | .619 |
4. It’s hard for me to set my own personal goals. | .086 | .646 |
6. I am a spur-of-the-moment kind of person, so I don´t usually focus on long-term desires and plans. | -.133 | .723 |
8. Generally, I feel awesome or awful about myself. | .031 | .687 |
10. Looking back impartially at my life is hard for me. | .155 | .489 |
12. I have doubts about the standards I should follow in my behaviour. | .140 | .671 |
16. I experience fast changes of emotions. | .098 | .604 |
18. The values guiding my behaviour always depend on the situation. | .005 | .642 |
20. My personal standards are usually too high or too low. | .009 | .734 |
22. Some of my personality features don´t match with each other. | -.014 | .784 |
24. I get either furious or embarrassed when I don´t pull things off. | -.132 | .612 |
26. When I accomplish something, I think I´m a fake. | .250 | .559 |
28. It is hard for me to control my emotions when people judge me. | -.053 | .779 |
Note. Factorial loadings higher than .40 are shown in bold.
Internal Consistency
Internal consistency was adequate either when it was calculated by ordinal Alphas or when Cronbach’s Alphas were used, resulting higher with the former (Table 3). The Attenuation Index was below 30% (Dominguez-Lara, 2018). That indicates that both Alpha coefficients are dependable.
Table 3
Scale | Ordinal Alpha | Cronbach’s Alpha | Attenuation index |
---|---|---|---|
Interpersonal | .92 | .88 | 4% |
Self | .86 | .87 | 1% |
Criterion Validity
Positive and large associations among the five PID-5 BF domains and the PFS dimensions were found, except for the association between the Interpersonal dimension and the Negative Affectivity dimension, which was medium. As for SCL-27 score, positive associations were reported: medium with the PFS Interpersonal dimension and large with the PFS Self dimension. The correlations between PFS scores and the MHC scores were significant and negative. They were small with Social Well-being and moderate with the remaining ones (Table 4).
Table 4
Dimension | Interpersonal | Self |
---|---|---|
Negative affectivity | .272** | .512** |
Detachment | .625** | .544** |
Antagonism | .495** | .496** |
Disinhibition | .441** | .551** |
Psychoticism | .495** | .570** |
SCL-27 | .353** | .570** |
Emotional well-being | -.432** | -.419** |
Social well-being | -.123* | -.153* |
Psychological well-being | -.343** | -.388** |
Total well-being | -.329** | -.326 |
*p < .05. **p < .01.
Discussion
The study was aimed at developing a short scale to assess impairments in personality according to the Criterion A introduced in the DSM-5’s Section III (American Psychiatric Association, 2013a). Based on Morey’s studies (Morey, 2017) and following Stanton’s recommendations for short scales’ development (Stanton et al., 2002), 28 items were examined by a minimum rank factor analysis, obtaining a 26-item-2-factor structure. The exam of the content of the items composing the factors suggested that there is a correspondence between the impairment dimensions related to the Self and to the Interpersonal Relationships. The number of factors has been a controversial issue since 1-factor, 2-factor, 4-factor and 8-factor structures were reported (e.g., Zimmermann et al., 2019). DSM-5 introduces two major dimensions (Self and Interpersonal). The Self-Functioning one is composed of two lower rank dimensions (Identity and Self-Direction), whilst the Interpersonal Functioning major dimension involves the Empathy and Intimacy minor dimensions. However, such classification was only verified by Goth et al. (2018) and Gamache et al. (2019).
The present study, like those conducted by Hutsebaut et al. (2016) and Weekers et al. (2019), found two factors, following the estimations of the parallel analysis (Horn, 1965). Besides, the fact that double factorial loadings were absent must be highlighted since such issue had been negatively pointed out by Goth et al. (2018) and Siefert et al. (2019) about their results. Consequently, construct validity evidences for the PFS scale seem adequate since they are theoretically coherent with DSM-5, and because of the psychometric quality of the items as well. Although two factors were found, the correlations between them were large. Hence, further confirmatory studies should examine the likelihood of a unique underlying factor as reported by Morey (2017) and Hopwood et al. (2018).
Regarding scores’ reliability, internal consistency was estimated by means of two statistics: Cronbach’s Alpha, following previous studies, and ordinal Alpha coefficients which is more appropriate since data were ordinal. Both estimators reached adequate values (Cortina, 1993). Such result represents an improvement regarding previous studies run on short scales, where those coefficients were barely up to .65 (e.g., Gamache et al., 2019; Hutsebaut et al., 2016).
As for criterion validity evidences, correlations between EFP and PID-5-BF were large. Significant and high values verify the link between Criterion A and Criterion B. Such results are reasonable since they correspond to the main criteria to diagnose PDs according to the DSM-5’s Section III. These findings add strength to the evidence previously reported by Hopwood et al. (2018) and by Gamache et al. (2019) about correlations higher than .50 between scales measuring Criterion A and Criterion B. Associations between SCL-27 score and the EFP major dimensions scores were analysed. Pearson´s r with the EFP Self dimension score was large, whilst it was medium regarding EFP Interpersonal dimension score. Two issues should be underlined. On the one hand, the SCL-27’s items content does not assess symptoms involving interpersonal relationships. On the other, values follow the same correlational pattern between LPFS-BF and BSI scores (BSI is a scale similar to SLC-27; Hutsebaut et al., 2016). Beyond the differences among the values achieved by Pearson’s r coefficients between PFS dimensions scores and the SCL-27 score, evidence supporting the link between psychopathological distress experienced during the last week and personality dysfunctions was verified. The PFS obtained negative correlations with the MHC scores. As reported by Huprich et al. (2018) and Siefert et al. (2019), psychological well-being is usually the opposite pole of impairments in personality functioning.
About the weaknesses of the study, the use of a convenience community sample restricts the conclusions’ generalisation. Even though DSM-5 (American Psychiatric Association, 2013a) states that the dimensional model is useful to assess either individuals from the community population or suffering from personality dysfunctions, adding a clinical sample would have been optimal in order to test such assertion. Besides, even when the answer sheets were carefully reviewed, the lack of validity scales arises as an issue since it might generate biased responses.
As regards of the limitations above described and taking into consideration that DSM-5 was originally aimed at diagnosing psychopathological disorders, further studies should be focused on analysing psychometric features of the PFS in clinical samples. Replicating the studies on the structure of the scale in other countries in Latin America would also be a matter of interest, as well as the development and adaptation of such scale in other languages.
In sum, a scale to assess Criterion A, suitable to be used in local population given their linguistic adaptation to the Spanish spoken in Argentina, with adequate validity evidences and appropriate reliability results has been developed. This is the first scale in Spanish developed to assess Criterion A, as a first step in the analysis of the new model to assess PDs presented in the DSM-5’s Section III (American Psychiatric Association, 2013a). From the methodological standpoint, the ordinal nature of items was taken into consideration, calculating polychoric correlational matrices and ordinal Alphas, thus ameliorating previous studies’ weaknesses. As for clinicians, 28 items enable shorter testing sessions as well as easier and faster scoring processes compared to longer versions, involving from 80 to 132 items (e.g., Hopwood et al., 2018; Huprich et al., 2018; Morey, 2017). The theoretical contribution here presented, referred to the emerging models introduced in DSM-5 deserves to be pointed out since the notion of impairments in personality functioning according to Criterion A has been analysed in a Latin American sample for the first time.