SciELO - Scientific Electronic Library Online

 
vol.15 número2Tradução e adaptação da Level of Personal Functioning Scale - Brief Form 2.0Resiliência individual e familiar e o papel das redes de apoio em vítimas de acidente de trânsito: uma revisão integrativa índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Links relacionados

Compartilhar


Ciencias Psicológicas

versão impressa ISSN 1688-4094versão On-line ISSN 1688-4221

Cienc. Psicol. vol.15 no.2 Montevideo dez. 2021  Epub 01-Dez-2021

https://doi.org/10.22235/cp.v15i2.2069 

Original Articles

Structure and invariance of the Hospital Anxiety Depression Scale (HADS) in adolescents

Estructura e invarianza de la Escala de Ansiedad y Depresión Hospitalaria (Hospital Anxiety Depression Scale, HADS) en adolescentes

Estrutura e invariância da Hospital Anxiety Depression Scale (HADS) em adolescentes

André Faro1 
http://orcid.org/0000-0002-7348-6297

Ludgleydson Fernandes de Araújo2 
http://orcid.org/0000-0003-4486-7565

Silvana Carneiro Maciel3 
http://orcid.org/0000-0003-1489-1126

Tiago Jessé Souza de Lima4 
http://orcid.org/0000-0001-8840-4285

Luana Elayne Cunha de Souza5 
http://orcid.org/0000-0001-9425-9598

1 Universidade Federal de Sergipe (UFS), Brazil, andre.faro.ufs@gmail.com

2 Universidade Federal do Piauí (UFPI), Brazil

3 Universidade Federal da Paraíba (UFPB), Brazil

4 Universidade de Brasília (UnB), Brazil

5 Universidade de Fortaleza (Unifor), Brazil


Abstract:

The main objective of this study was to test the factorial structure and gender invariance of the Hospital Anxiety Depression Scale (HADS) in a non-clinical sample of 657 adolescents (Mage = 16.3 years; SD = 1.19). The research design was an instrumental investigation, based on a cross-sectional survey with a sample of adolescents in Brazil. The results presented satisfactory evidence of the validity of the factorial structure and gender invariance for the sample. The composite reliability was also satisfactory, and no problems were detected related to common method bias. The mean of the items explained variance was .31 (31 %), with a Cronbach’s Alpha at .84 for the total scale, .81 and .69 for the anxiety and depression subscales, respectively. In the discussion, we analyzed questions related to the average variance extracted of the scale, which was lower than expected. Thus, we conclude that the current findings provide validity evidence to the application of the HADS with Brazilian adolescents for clinical or research purposes.

Keywords: anxiety; depression; confirmatory factor analysis; measurement invariance; adolescents

Resumen:

El principal objetivo del presente estudio fue evaluar la estructura factorial y la invarianza de género de la Escala de Ansiedad y Depresión Hospitalaria (Hospital Anxiety Depression Scale, HADS) en una muestra no clínica de 657 adolescentes (M edad = 16.3; DE = 1.19). El diseño de pesquisa fue una investigación instrumental, basada en una encuesta transversal con una muestra de adolescentes en Brasil. Los resultados mostraron evidencias satisfactorias de la validez de la estructura factorial y de la invarianza de género para este público. La confiabilidad compuesta también fue satisfactoria, así como no se detectaron problemas relacionados con el sesgo del método común. La media de la varianza explicada de los ítems fue de .31 (31 %), con un alfa de Cronbach de .84 para la escala total, .81 y .69 para las subescalas de ansiedad y depresión, respectivamente. En la discusión, se analizan preguntas relacionadas con la varianza promedio extraída de la escala, que resultó debajo de las expectativas iniciales. Se concluye que los hallazgos actuales brindan evidencias de validez a la aplicación de la HADS con adolescentes brasileños, sea con fines clínicos o de investigación científica.

Palabras clave: ansiedad; depresión; análisis factorial confirmatorio; invarianza de medición; adolescentes

Resumo:

O principal objetivo deste estudo foi testar a estrutura fatorial e invariância de gênero da Escala de Ansiedade e Depressão Hospitalar (Hospital Anxiety Depression Scale, HADS) em uma amostra não-clínica de 657 adolescentes (Midade =16,3; DP = 1,19). O desenho da pesquisa foi instrumental, baseado em um levantamento transversal com uma amostra de adolescentes no Brasil. Os resultados apontaram evidências satisfatórias de validade da estrutura fatorial e de invariância de gênero para esse público. A Confiabilidade Composta também se mostrou satisfatória, bem como não foram detectados problemas relativos ao Viés do Método Comum. A média da variância explicada dos itens foi de 0,31, com um alfa de Cronbach de 0,84 para a escala total, 0,81 e 0,69 para as subescalas de ansiedade e depressão, respectivamente. Na discussão, foram analisadas questões relativas à Variância Média Extraída da escala, que se revelou abaixo do esperado. Concluiu-se que os achados trazem evidências de validade para a utilização da HADS junto a adolescentes brasileiros, seja com finalidade clínica ou investigação científica.

Palavras-chave: ansiedade; depressão; análise fatorial confirmatória; invariância de medida; adolescentes

The Hospital Anxiety and Depression Scale (HADS) is an instrument for screening symptoms of anxiety and depression that is widely applied internationally, having been adapted to more than 15 languages (Cosco, Doyle, Ward & McGee, 2012), including Brazilian Portuguese (Botega, Bio, Zomignani, Garcia Júnior & Pereira, 1995). The HADS was developed for use in general medical outpatient clinics, although it is widely used in clinical research and practice (Crawford, Henry, Crombie & Taylor, 2001). Thus, the scale is more sensitive to mild forms of psychiatric disorders, avoiding the “floor effect” commonly observed when questionnaires developed to clinical populations are applied in non-clinical populations (Herrmann, 1997). Several studies have indicated its applicability to clinical and non-clinical populations (see Bjelland, Dahl, Haug & Neckelmann, 2002; Westhoff-Bleck et al., 2019). Furthermore, the HADS is considered to be practical (14 items, 7 for each disorder), easy to apply (can be self-administered) and simple to interpret, because it has a cutoff point regarding the presence of significant symptomology for possible or probable cases of each disorder (Faro, 2015).

Examination of the psychometric properties of the HADS, through confirmatory factor analysis (CFA), has been performed internationally since at least 2000 (Bjelland et al., 2002). The first study conducted in Brazil was published in 2015 (Faro, 2015). The studies testing the factorial structure of the HADS through CFA have addressed the adequacy of the original model (bifactorial) in comparison with alternative factorial structures, especially using samples of adults in clinical or non-clinical conditions (see Bjelland et al., 2002; Cosco et al., 2012). In contrast, studies testing the factorial structure of the HADS in samples of adolescents are scarce: to the best of our knowledge, only two have been published so far (Chan, Leung, Fong, Leung & Lee, 2010; Mihalca & Pilecka, 2015). In face of the high prevalence of common mental disorders among Brazilian adolescents, which is approximately 38 % in girls and 22 % in boys (Lopes et al., 2016), evaluate the psychometric parameters of HADS in a sample of adolescents is justified given its usefulness as a screening tool (Chan et al., 2010). Since the common mental disorders’ symptoms are often vague, making these disorders poorly identified by school administrators or even health services (Lopes et al., 2016), a brief and reliable screening tool, like HADS, can be useful in the early identification of these symptoms, favoring further evaluation and assistance.

Furthermore, a gap exists in the literature (even involving adults) investigating whether the bifactorial structure of the HADS is gender invariant (see Cosco et al., 2012), although there is evidence that the symptoms of anxiety and depression can be different in men and women (Cavanagh, Wilson, Kavanagh & Caputi, 2017; Hammen, 2018; Salk, 2017). The literature shows that adolescence is a critical period for the development of these disorders, and that differences exist in some clinical symptomatic manifestations, at the start and during the progression of the disorders with respect to gender, specifically in this age range (Bulhões, Ramos, Severo, Dias & Barros, 2019; Fredrick, Demaray, Malecki & Dorio, 2018; Krause et al., 2017).

Finally, given the shortage of works and the relevance of a deeper understanding of the structure of the HADS in different groups, we tested the bifactorial structure (anxiety and depression) of the HADS and evaluated whether that structure is invariant in function of the gender in a non-clinical sample of adolescents. We also assessed the composite reliability, common method bias and average variance extracted of the HADS and its respective factors.

Method

Research design

This was an instrumental study, based on a cross-sectional survey with a sample of adolescents.

Participants

The sample was composed of 657 high school students from two Brazilian states, 69.9 % (n = 459) from Sergipe and 30.1 % (n = 198) from Paraiba. The majority were girls (58.3 %; n = 383) and the average age was 16.3 years (SD= 1.19), while 74.3 % (n = 488) of the participants were from public schools and the rest from private ones. The grade distribution was 38.1 % in the 10th grade (n = 250), 36.5 % in the 11th (n = 243) and 25.4 % (n = 167) in the 12th. There were no significant differences as to sex and age between the two states (p≥ .05). Proportionally, there were only significantly more participants in the 11th grade in the sample from Sergipe (42.7 %, n = 196) than the sample from Paraíba (22.2 %, n = 44) (χ²= 25.044; p< .001). The other grade strata were proportionally similar.

Procedure

This study was approved by the research ethics committee of the Federal University of Sergipe (registration number 1.505.545). The sample was chosen by convenience, and the data were collected in the classroom after approval by the respective school administrators and parents or formal caregivers through an informed consent. Teachers were present when the students filled out the instrument. All the adolescents first signed the informed agreement form in two counterparts.

Instruments

The HADS contains 14 sentences in two sub-scales: HADS-A (Anxiety, odd-numbered items) and HADS-D (Depression, even-numbered items). The cutoff point of ≥ 9 is considered the most common in studies using the HADS (Cosco et al., 2012; Faro, 2015). It was applied the Brazilian version of the HADS, translated, adapted, and validated by Botega et al. (1995). The diagnostic classification provided by the HADS refers to the screening of significant symptoms of the mild anxiety disorder (MAD) and mild depressive disorder (MDD). The responses are on a scale from 0 to 3 points for each item, so that the highest possible sum for each sub-scale is 21. Finally, sociodemographic data are collected, such as gender, age and school grade.

Data analysis

For descriptive reasons, we calculated the mean and standard deviation of the items in the total sample and by gender. It was also estimated the inter-item and item-total correlations, the mean of the explained variance of the items, and the Cronbach’s Alpha (α) for the internal consistence of the HADS, HADS-A and HADS-D.

Confirmatory Factor Analysis (CFA) was performed by the maximum likelihood estimation method (AMOS, version 22). There were four measures of adjustment of the models: (i) chi-square to degrees of freedom ratio (χ²/df, desirable < 3); (ii) Goodness of Fit Index (GFI, desirable > .95); (iii) Comparative Fit Index (CFI, desirable > .95); and (iv) Root Mean Square Error of Approximation (RMSEA, desirable < .06 and p-close > .500; Marôco, 2014). The gender invariance was analyzed based on two steps: the configural invariance (unconstrained model) and the metric invariance (measurement weights). The parameters applied to reject invariance were ΔCFI (≥ .01) and ΔRMSEA (≥ .015), which reveal the volume of discrepancy of the model fit without and with invariance constraints (Marôco, 2014).

We applied the Common Method Bias (CMB) test, in which the expectation is that the standardized regression weights of the model with one Common Latent Factor (CLF) is not greater than .200 in relation to the model without a CLF (Podsakoff, MacKenzie & Podsakoff, 2012). Finally, we calculated the composite reliability (CR, desirable > .70) and average variance extracted (AVE, desirable > .50) to assess the reliability and precision of the measure, respectively (Marôco, 2014; Valentini & Damásio, 2016).

Results

The descriptive statistics of the HADS items are detailed in the Table 1. The items with the highest and lowest means in the scale were: items 3 (1.4) and 4 (.4) in the total sample; items 5 (1.3) and 4 (.4) for males; and items 8 (1.7) and 4 (.4) for females. Any negative values were found in the subscales or the total scale inter-items indices. The inter-item correlations varied from .20 (items 7-11) to .51 (items 9-13) in the HADS-A, from .11 (items 2-10) to .48 (items 4-6) in the HADS-D, and from .04 (items 2-5) to .51 (items 9-13) in the HADS. The mean of the inter-item correlations was: HADS-A, .38 (.078); HADS-D, .25 (.103); and HADS, .28 (.111). The mean of the item-total correlations was .48 (.118). The total explained variance showed a mean of .31 (31 %), with the following Cronbach’s Alpha coefficients: HADS-A, .81; HADS-D, .69; and HADS, .84.

Table 1: Descriptive statistics of the HADS in the total sample and by gender 

Note: 1. M = Mean 2. SD = Standard Deviation.

The CFA was performed with the two correlated latent factors (HADS-A and HADS-D), and a desirable fit was achieved after inclusion of 5 covariances between the measurement errors, based on inspection of the modification indices. In the HADS-A, the errors of the following items were correlated: 3 and 9 (.22), and 9 and 13 (.16), while in the HADS-D, items 12 and 14 (.17), 6 and 8 (-.28), and 4 and 8 (-.23) were correlated. The correlation between the factors was .83. The value of χ²/df was 2.3, with GFI of .965, CFI of .960 and RMSEA (90 % CI) of .045 (.036 - .054, p-close= .830). Table 2 reports the regression weights and correlations between the factors in the full sample and by gender.

Table 2: Standard regression weights (factor loadings) and correlation indices of the HADS model in the total sample and by gender 

Note: 1. Anx = HADS-A (Anxiety); Dep = HADS-D (Depression). 2. Factor loadings after bootstrapping (2000 simulations, all significant in p < .005).

Then we tested the model’s gender invariance. First we detected configural invariance, i.e., the structure of the HADS with free parameters was equivalent in both groups (χ²/df = 1.6; GFI= .952; CFI = .960; RMSEA (90 % CI) = .031 (.024 - .038 and p-close = 1.000)), with ΔCFI below .001 and ΔRMSEA of .014, both within the desirable limit. That finding was corroborated because although the highest discrepancies by gender were observed for items 9 (z = -1.491) and 1 (z = -1.467) in the HADS-A, and for items 8 (z = -1.204) and 6 (z = -1.110) in the HADS-D, the regression weights of all 14 items did not differ significantly for males and females.

Regarding the metric invariance, the difference between the values of χ² in the comparison between the models with unconstrained parameters (232.352, df = 142) and fully constrained parameters (253.291, df= 156) was not significant (χ²(df)= 20.939 (14), p = .103), revealing that the model was invariant to the regression weights in function of gender ( χ²/df = 1,6, GFI= .948, CFI = .956, RMSEA (90 % CI) = .031 (.024 - .038) and p-close = 1.000). Finally, the values of ΔCFI (.004) and ΔRMSEA (< .001) were below the thresholds for rejection of invariance, demonstrating the metric equivalence of the HADS in function of gender.

The analysis of CMB revealed no differences greater than .200 between the standardized regression weights with and without a common latent factor. The CR calculation showed that both factors had desirable values (HADS-A, CR = .80 and HADS-D, CR = .71). Finally, the AVE values of the HADS-A and HADS-D were .37 and .28, respectively, below the desirable cutoff point (> .50).

Discussion

The results of this study provide evidence of the validity of the structure of the HADS in a sample of adolescents, in accordance with results obtained with adult test subjects (Faro, 2015; Lin & Pakpour, 2017; Nezlek, Rusanowska, Holas & Kreptz, 2019; Roberts, Fletcher & Merrick, 2014) and adolescents (Chan et al., 2010). We detected a good fit of the bifactorial HADS model with the inclusion of five cross-loadings between items. The inclusion of the covariance between the errors is not contraindicated when this occurs within the latent factors themselves, because it reflects the existence of a relationship between the characteristics of the items (Marôco, 2014). Since the HADS is a measure for screening symptoms of anxiety and depression, the cross-loadings point to the expected co-occurrence of characteristics of the clinical situations (Eysenck & Fajkowska, 2017), making it plausible, under justifiable conditions, to associate measurement errors. In any event, as pointed out by Nezlek et al. (2019), this type of modification of the model implies a certain limitation on its replicability for similar samples in other populations.

Among the indicators of the CFA of the HADS, the factor loading values of some items stood out. To support the model’s validity, items should have regression weights of at least .60 or .70, depending on the author considered (Marôco, 2014). In the HADS-A, the average factor loading was .61 (SD = .078) while in the HADS-D it was .51 (SD = .173), below the recommended value. Average values of ≥ .50 and ≤ .70 were also found in similar studies, also having good fits in the CFA of the HADS (Annunziata, Muzzatti & Altoè, 2011, HADS-A = .70 and HADS-D = .65; Lin & Pakpour, 2017, HADS-A = .66 and HADS-D = .60; Roberts et al., 2014, HADS-A= .66 and HADS-D = .51). Another study with adolescents found a basically equal mean value for the HADS-A and a lower value than found here for the HADS-D (Chan et al., 2010; HADS-A = .62 and HADS-D = .45). Therefore, mean factor loadings between .50 and .60 are common when analyzing the HADS, despite the favorable fits in the CFA with different samples.

We found that the HADS model was invariant in function of gender in its structure (number and configuration of factors) and metric (equivalence of factor loadings between groups). That finding shows that the scale has similar qualities for application in both groups, and also allows comparison of the results (Marôco, 2014). Additionally, our results did not find significant presence of CMB, which supports the credibility of the instrument. This aspect gains more importance in this study because analysis of bias was not performed in other CFA studies of the HADS (e.g., Annunziata et al., 2011; Roberts et al., 2014), even the most recent ones (e.g., Lin & Pakpour, 2017; Stott et al., 2017).

The findings on the CMB did not show any relevant differences in relation to the standardized regression weights. Thus, these indicators were not substantially influenced by questions related to, for instance, social desirability, cross-sectional design, or adverse effects of the composition of the items, which would have favored a false common variance of the method (Podsakoff et al., 2012).

The CR had satisfactory values, especially in the case of the HADS-A. A high CR is an indicator of internal consistency of the relationship of the items in the factor and suggests the reliable reproducibility of the measure in similar samples. Some studies of the HADS applying CFA have assessed the CR in their samples (e.g., Haugan & Drageset, 2014), but in general, studies have only applied Cronbach’s alpha (e.g., Roberts et al., 2014), while some have not calculated a reliability measure (e.g., Annunziata et al., 2011; Stott et al., 2017). According to Valentini and Damásio (2016), the CR is more appropriate than Cronbach’s alpha when performing CFA. For that reason, we believe the findings of this investigation shed new light on the validity of the HADS.

Unlike the CR, the AVE was below the desirable limit, especially in the HADS-D. Usually, the AVE is argued to be an indicator of convergent validity in CFA (Fornell & Larcker, 1981). Valentini and Damásio (2016), through a simulation study, showed that the AVE tends to decline with rising homogeneity of the regression weights, while it is also affected by the number of items (the lower the number, the greater the demand for high values to reach the desirable AVE). Therefore, considering the findings of those authors, the average of the factor loadings of the HADS had low standard deviations (< .30, see Valentini & Damásio, 2016), suggesting the loadings were predominantly heterogeneous. Besides this, in the HADS the factors are composed of only a few items (7 each), which also might have caused overestimation of the problem of low regression weights (averages of .61 and .51 for the HADS-A and HADS-D). These two aspects possibly help explain the AVE value in this investigation.

It should be noted that the AVE is also considered to be a very restrictive evaluation index, so that it does not always suitably reflect the quality of the model, meaning it might be possible to judge the reliability just by means of the CR (Malhotra, 2011). Furthermore, it is more appropriate to consider the AVE as a measure of precision rather than of convergent validity, since the AVE involves the average variance that is explained by the latent variable and does not presuppose an external measure for convergence (Valentini & Damásio, 2016). Therefore, since we obtained desirable CR values of the HADS-A and HADS-D, we believe the low AVE value does not undermine the validity of the measure. It can be considered reliable (satisfactory CR), although a caveat is warranted regarding the precision of the measure (low AVE).

The problem detected here with the low AVE and factor loadings is something that should be analyzed in future studies. For that purpose, a suggested strategy is to remove the items with the lowest factor loadings (Malhotra, 2011). In this sample, items 2, 11 and 14 had the lowest regression weights, making them possible targets for deletion from the model. However, we decided not to alter the scale’s factorial structure, since except for the AVE, the findings were satisfactory, including the model’s invariance. Besides this, since our sample consisted only of adolescents from two Brazilian states, we believe these findings, although important, do not (yet) provide sufficient indications that the HADS would produce different results with this public in other contexts, which would justify possible removal of items and change in the measure’s structure.

The choice to maintain the model also was based on the fact it has been found to be a good solution with the basic structure of two factors and seven items per factor, since the scale has shown good clinical utility in its original format (Bjelland et al., 2002; Cosco et al., 2012; Roberts et al., 2014). This is a debate similar to that raised in a recent study in Sweden (Djukanovic, Carlsson & Arestedt, 2017). Furthermore, the reduction of the number of items would affect the cutoff point of the scale, since it is a diagnostic screening instrument. Consequently, a validity study would be necessary for redefinition of its classification rule, which was not the objective of this investigation. Comments in a similar direction were made in a study of adults suffering from dementia (Stott et al., 2017). In summary, particularly because our sample consisted of adolescents, there is a need for more evidence of the psychometric qualities of the HADS for this group, especially regarding the aspects detected.

Further studies of the theme are warranted, since more psychometric evaluations of the HADS in Brazil, to the effect of psychological interventions related to depressive and anxious disorders in adolescents. A specific suggestion is related to performing a CFA with a clinical sample of adolescents in order to verify the structural equivalence between different sample profiles. A last recommendation is a population screening of depressive and anxious symptomatology in Brazilian adolescents, because the extension of the HADS makes it possible to reach a wide public through a free and brief instrument, which significantly reduces research costs.

The main limitation of this study was that it did not involve analysis of criterion validity, so the results found apply to the HADS in its original format and not to diagnostic categorization. Additionally, these findings do not include other questions that are also pertinent to psychometric evaluation, such as the quality of the items, which can be addressed by item response theory and/or Rasch analysis, as have been applied in recent works (e.g., Ayis, Ayerbe, Ashworth & Wolfe, 2018; Lin & Pakpour, 2017; Lin et al., 2017; LoMartire, Ang, Gerdle, & Vixner, 2019).

Finally, the main contribution of this study is the confirmation of the structure and invariance of the HADS among adolescents, which corroborates the instrument’s validity, as well as the possibility of comparison between the genders. The results show some positive aspects regarding the use of the HADS, but also some fragilities, reflecting the continuous and dynamic construction of scientific knowledge.

References:

Annunziata, M.A., Muzzatti, B., & Altoè, G. (2011). Defining Hospital Anxiety and Depression Scale (HADS) structure by confirmatory factor analysis: A contribution to validation for oncological settings. Annals of Oncology, 22, 2330-2333. [ Links ]

Ayis, S.A, Ayerbe, L., Ashworth, M., & Wolfe, C.D.A. (2018). Evaluation of the Hospital Anxiety and Depression Scale (HADS) in screening stroke patients for symptoms: Item Response Theory (IRT). Journal of Affective Disorders, 228, 33-40. doi: 10.1016/j.jad.2017.11.037 [ Links ]

Bjelland, I., Dahl, A.A., Haug, T. T., & Neckelmann, D. (2002). The validity of the Hospital Anxiety and Depression Scale: An update literature review. Journal of Psychosomatic Research, 52, 69-77. [ Links ]

Botega, N. J., Bio, M. R., Zomignani, M. A., Garcia Júnior, C., & Pereira, W. A. (1995). Mood disorders among medical in-patients: A validation study of the hospital anxiety and depression scale (HAD) (Transtornos do humor em enfermaria de clínica média e validação de escala de medida (HAD) de ansiedade e depressão). Revista de Saúde Pública, 29, 355-363. [ Links ]

Bulhões, C., Ramos, E., Severo, M., Dias, S., & Barros, H. (2017). Measuring depressive symptoms during adolescence: What is the role of gender? Epidemiology and Psychiatric Sciences, 28,1-11. doi: 10.1017/S2045796017000312 [ Links ]

Cavanagh, A., Wilson, C.J., & Kavanagh, D.J. (2017). Differences in the expression of symptoms in men versus women with depression: A systematic review and meta-analysis. Harvard Review of Psychiatry, 25(1), 29-38. doi: 10.1097/HRP.0000000000000128. [ Links ]

Chan, Y. F., Leung, D. Y., Fong, D. Y., Leung, C. M., & Lee, A. M. (2010). Psychometric evaluation of the Hospital Anxiety and Depression Scale in a large community sample of adolescents in Hong Kong. Quality of Life Research, 19(6), 865-873. doi: 10.1007/s11136-010-9645-1 [ Links ]

Cosco, T. D., Doyle, F., Ward, M., & McGee, H. (2012). Latent structure of the Hospital Anxiety and Depression Scale: A 10-year systematic review. Journal of Psychosomatic Research, 72, 180-184. doi:10.1016/j.jpsychores.2011.06.008 [ Links ]

Crawford, J. R., Henry, J. D., Crombie, C., & Taylor, E. P. (2001). Normative data for the HADS from a large non‐clinical sample. British Journal of Clinical Psychology, 40(4), 429-434. doi:10.1348/014466501163904 [ Links ]

Djukanovic, I., Carlsson, J., & Årestedt, K. (2017). Is the Hospital Anxiety and Depression Scale (HADS) a valid measure in a general population 65-80 years old? A psychometric evaluation study. Health and Quality of Life Outcomes, 15(1), 193-203. doi: 10.1186/s12955-017-0759-9 [ Links ]

Eysenck, M. W., & Fajkowska, M. (2017). Anxiety and depression: Toward overlapping and distinctive features. Cognition & Emotion, 9931, 1-10. doi: 10.1080/02699931.2017.1330255 [ Links ]

Faro, A. (2015). Confirmatory factor analysis and standardization of the Hospital Anxiety and Depression Scale (HADS) (Análise fatorial confirmatória e normatização da Hospital Anxiety and Depression Scale (HADS)). Psicologia: Teoria e Pesquisa, 31(3), 349-353. doi: 10.1590/0102-37722015032072349353 [ Links ]

Fornell, C., & Larcker, D. F. (1981). Evaluating structural equations models with unobservable variables and measurement error. Journal of Marketing, 18, 39-50. [ Links ]

Fredrick, S.S., Demaray, M.K., Malecki, C.K., & Dorio, N.B. (2018). Can social support buffer the association between depression and suicidal ideation in adolescent boys and girls? Psychology in the Schools, 55, 490-505. doi: 10.1002/pits.22125 [ Links ]

Hammen, C. (2018). Risk factors for depression: An autobiographical review. Annual Review of Clinical Psychology, 14, 1-28. doi: 10.1146/annurev-clinpsy-050817-084811 [ Links ]

Haugan, G., & Drageset, J. (2014). The Hospital Anxiety and Depression Scale: Dimensionality, reliability and construct validity among cognitively intact nursing home patients. Journal of Affective Disorders, 165, 8-15. doi: 10.1016/j.jad.2014.04.042 [ Links ]

Herrmann, C. (1997). International experiences with the Hospital Anxiety and Depression Scale-a review of validation data and clinical results. Journal of Psychosomatic Research, 42(1), 17-41. doi: 10.1016/S0022-3999(96)00216-4 [ Links ]

Krause, E. D., Vélez, C. E., Woo, R., Hoffmann, B., Freres, D. R., Abenavoli, R. M., & Gillham, J. E. (2018). Rumination, depression, and gender in early adolescence: A longitudinal study of a bidirectional model. The Journal of Early Adolescence, 38(7), 923-946. doi: 10.1177/0272431617704956 [ Links ]

Lin, C.-Y., & Pakpour, A. H. (2017). Using Hospital Anxiety and Depression Scale (HADS) on patients with epilepsy: Confirmatory factor analysis and Rasch models. Seizure: European Journal of Epilepsy, 45, 42-46. doi: 10.1016/j.seizure.2016.11.019 [ Links ]

Lin, X., Chen, Z., Jin, L., Gao, W., Qu, B., Zuo, Y., Liu, R., & Yu, M. (2017). Rasch analysis of the Hospital Anxiety and Depression Scale among Chinese cataract patients. PloS One, 12(9), e0185287. doi: 10.1371/journal.pone.0185287 [ Links ]

LoMartire, R., Ang, B.O., Gerdle, B. & Vixner, L. (2019). Psychometric properties of Short Form-36 Health Survey, EuroQol 5-dimensions, and Hospital Anxiety and Depression Scale in patients with chronic pain. Pain, 00, 1-13. doi: 10.1097/j.pain.0000000000001700 [ Links ]

Lopes, C. S., Abreu, G. D. A., Santos, D. F. D., Menezes, P. R., Carvalho, K. M. B. D., Cunha, C. D. F., ... & Szklo, M. (2016). ERICA: Prevalence of common mental disorders in Brazilian adolescentes. Revista de Saúde Pública, 50, 14s. doi: 10.1590/S01518-8787.2016050006690 [ Links ]

Malhotra, N. K. (2011). Marketing Research: An applied Orientation. NJ: Pearson Education. [ Links ]

Marôco, J. (2014). Análise de equações estruturais: Fundamentos teóricos, software e aplicação. Pêro Pinheiro, Portugal: ReportNumber. [ Links ]

Mihalca, A. M., & Pilecka, W. (2015). The factorial structure and validity of the Hospital Anxiety and Depression Scale (HADS) in Polish adolescents. Psychiatria Polska, 49(5), 1071-1088. doi: 10.12740/PP/38139. [ Links ]

Nezlek, J.B., Rusanowska, M., Holas, P., & Kreptz, I. (2019). The factor structure of a Polish language version of the Hospital Anxiety Depression Scale (HADS). Current Psychology. doi: 10.1007/s12144-019-0164-0 [ Links ]

Podsakoff, P. M., MacKenzie, S.B., & Podsakoff, N.P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539-569.doi: 10.1146/annurev-psych-120710-100452 [ Links ]

Roberts, M. H., Fletcher, R. B., & Merrick, P. L. (2014). The validity and clinical utility of the hospital anxiety and depression scale (HADS) with older adult New Zealanders. International Psychogeriatrics, 26, 325-333. doi: 10.1017/S104161021300197X [ Links ]

Salk, R.H., Hyde, J.S., & Abramson, L.Y. (2017). Gender differences in depression in representative national samples: Meta‐analyses of diagnoses and symptoms. Psychological Bulletin, 143, 783-822. doi: 10.1037/bul0000102 [ Links ]

Stott, J., Spector, A., Orrell, M., Scior, K., Sweeney, J., & Charlesworth, G. (2017). Limited validity of the Hospital Anxiety and Depression Scale (HADS) in dementia: Evidence from a confirmatory factor analysis. International Journal of Geriatric Psychiatry, 32, 805-813. doi: 10.1002/gps.4530 [ Links ]

Valentini, F., & Damásio, B. F. (2016). Average variance extracted and composite reliability: Reliability coefficients (Variância média extraída e confiabilidade composta: Indicadores de precisão). Psicologia: Teoria e Pesquisa, 32(2), e322225. doi: 10.1590/0102-3772e322225 [ Links ]

Westhoff-Bleck, M., Winter, L., Aguirre Davila, L., Herrmann-Lingen, C., Treptau, J., Bauersachs, J., Bleich, S., & Kahl, K.G. (2019). Diagnostic evaluation of the Hospital Depression Scale (HADS) and the Beck-Depression Inventory-II (BDI-II) in adults with congenital heart disease using structured clinical interview: Impact of depression severity. European Journal of Preventive Cardiology, 0, doi: 10.1177/2047487319865055 [ Links ]

Correspondence: André Faro, Universidade Federal de Sergipe (UFS), Brazil. E-mail: andre.faro.ufs@gmail.com

How to cite: Faro, A., Fernandes de Araújo, L., Carneiro Maciel, S., Souza de Lima, T. J. & Cunha de Souza, L. E. (2021). Structure and invariance of the Hospital Anxiety Depression Scale (HADS) in adolescents. Ciencias Psicológicas, 15(2), e-2069. doi: https://doi.org/10.22235/cp.v15i2.2069

Authors' participation: a) Conception and design of the work; b) Data acquisition; c) Analysis and interpretation of data; d) Writing of the manuscript; e) Critical review of the manuscript. A. F. has contributed in a, b, c, d, e; L. F. A. in a, c, e; S. C. M. in a, b, c, e; T. J. S. L. in a, c, e; L. E. C. S. in a, c, e.

Scientific editor in charge: Dra. Cecilia Cracco

Received: February 11, 2020; Accepted: May 10, 2021

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License