SciELO - Scientific Electronic Library Online

 
vol.17 número1La pandemia de COVID-19 y su efecto en la estructura del Brief-COPEModelo de comunicación sobre el uso del condón en hombres índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Links relacionados

Compartir


Ciencias Psicológicas

versión impresa ISSN 1688-4094versión On-line ISSN 1688-4221

Cienc. Psicol. vol.17 no.1 Montevideo  2023  Epub 01-Jun-2023

https://doi.org/10.22235/cp.v17i1.3051 

Original Articles

Psychometric properties and measurement invariance of an academic self-efficacy scale in college students from five Latin American countries

Propiedades psicométricas e invariancia de medida de una escala de autoeficacia académica en estudiantes universitarios de cinco países latinoamericanos

Propriedades psicométricas e invariância de medida de uma escala de autoeficácia acadêmica em estudantes universitários de cinco países da América Latina

Sergio Dominguez-Lara1 
http://orcid.org/0000-0002-2083-4278

Danitsa Alarcón-Parco2 
http://orcid.org/0000-0002-4556-0795

Yolanda Campos-Uscanga3 
http://orcid.org/0000-0002-5114-3621

William Tamayo-Agudelo4 
http://orcid.org/0000-0002-5858-4964

César Merino-Soto5 
http://orcid.org/0000-0002-1407-8306

Marisa Cecilia Tumino6 
http://orcid.org/0000-0002-1913-6931

Josué Mauricio Quinde7 
http://orcid.org/0000-0002-2928-8787

Giovanna Barroca de Moura8 
http://orcid.org/0000-0001-7970-4323

Maria das Graças de Almeida Baptista9 
http://orcid.org/0000-0003-1084-4269

1 Universidad de San Martín de Porres, Peru

2 Universidad de San Martín de Porres, Peru

3 Universidad Veracruzana, Mexico

4 Universidad Cooperativa de Colombia, Colombia; University College London, United Kingdom

5 Universidad de San Martín de Porres, Perú

6 Universidad Adventista del Plata, Argentina

7 Universidad Adventista del Plata, Argentina

8 Universidade Federal da Paraíba, Brazil; Universidade de Coimbra, Portugal

9 Universidade Federal da Paraíba, Brazil


Abstract:

Our objective was to analyze the measurement invariance of the Academic Situations Specific Perceived Self-Efficacy Scale (ASSPSES) among Peruvian, Mexican, Colombian, Argentinean, and Brazilian college students, and its relationship with academic emotional exhaustion (AEE). In addition to the ASSPSES, the Emotional Exhaustion Scale (EES) was used. Two thousand one hundred forty-two college students (70.26% women) between the ages of 16 and 35 (M = 21.79 years) participated. The one-dimensional structure of ASSPSES was corroborated in each sample with a confirmatory factor analysis and the measurement invariance analysis was carried out with a multi-group factor analysis (MGFA) and with the differential item functioning. The relationship with the AEE was tested with the Pearson correlation coefficient. Regard the results, in all of the samples, the one-dimensional model presented adequate psychometric indicators with respect to both dimensionality and reliability. Similarly, regarding the analysis of measurement invariance, a strong variance was attained, and DIF is weak, which together with the MGFA results provides favorable evidence of measurement invariance. We conclude that ASSPSES is an invariant measure among the analyzed groups although replicating the study is necessary for the consolidation of the findings. These findings contribute to the understanding of the internal structure of the ASSPSES, something that had been awaiting evaluation, given how the scale is used in various contexts.

Keywords: academic self-efficacy; college students; psychometric properties; validity; Latin America

Resumen:

El objetivo fue analizar la invarianza de medición de la Escala de Autoeficacia Percibida Específica para Situaciones Académicas (EAPESA) entre estudiantes universitarios peruanos, mexicanos, colombianos, argentinos y brasileños, y su relación con el agotamiento emocional académico (AEA). Además de la EAPESA, se usó la Escala de Cansancio Emocional (ECE). Participaron 2142 estudiantes universitarios (70.26 % mujeres) entre los 16 y 35 años (M = 21.79). La estructura unidimensional de la EAPESA se corroboró en cada muestra con un análisis factorial confirmatorio, y la invarianza de medición se llevó a cabo con un análisis factorial de grupo múltiple (AFGM) y con el funcionamiento diferencial de los ítems (FDI). La relación con el AEA se evaluó con el coeficiente de correlación de Pearson. Respecto a los resultados, en todas las muestras el modelo unidimensional presentó adecuados indicadores psicométricos, tanto en lo que respecta a su dimensionalidad como en cuanto a su confiabilidad. Del mismo modo, en cuanto al análisis de invarianza de medición, se alcanza la invarianza fuerte, y el FDI es débil, lo que junto con el AFGM brinda evidencia favorable de invarianza de medición. Se concluye que la EAPESA es una medida invariante entre los grupos analizados, aunque es necesario replicar la investigación para consolidar los hallazgos. Estos resultados contribuyen a entender la estructura interna de la EAPESA, algo que estaba aguardando una valoración, ya que dicha escala es usada en varios contextos.

Palabras clave: autoeficacia académica; estudiantes universitarios; propiedades psicométricas; validez; América Latina

Resumo:

El objetivo fue analizar la invarianza de medición de la Escala de Autoeficacia Percibida Específica para Situaciones Académicas (EAPESA) entre estudiantes universitarios peruanos, mexicanos, colombianos, argentinos y brasileños, y su relación con el agotamiento emocional académico (AEA). Además de la EAPESA, se usó la Escala de Cansancio Emocional (ECE). Participaron 2142 estudiantes universitarios (70.26% mujeres) entre los 16 y 35 años (M = 21.79). La estructura unidimensional de la EAPESA se corroboró en cada muestra con un análisis factorial confirmatorio, y la invarianza de medición se llevó a cabo con un análisis factorial de grupo múltiple (AFGM) y con el funcionamiento diferencial de los ítems (FDI). La relación con el AEA se evaluó con el coeficiente de correlación de Pearson. Respecto a los resultados, en todas las muestras el modelo unidimensional presentó adecuados indicadores psicométricos, tanto en lo que respecta a su dimensionalidad como en cuanto a su confiabilidad. Del mismo modo, en cuanto al análisis de invarianza de medición, se alcanza la invarianza fuerte, y el FDI es débil, lo que junto con el AFGM brinda evidencia favorable de invarianza de medición. Se concluye que la EAPESA es una medida invariante entre los grupos analizados, aunque es necesario replicar la investigación para consolidar los hallazgos. Estos resultados contribuyen a entender la estructura interna de la EAPESA, algo que estaba aguardando una valoración, ya que dicha escala es usada en varios contextos.

Palavras-chave: autoeficacia académica; estudiantes universitários; propriedades psicométricas; validez; América Latina

Introduction

Academic Self-Efficacy and its Importance

Becoming a higher-education student involves a process of change and integration into a new social and academic world. This process can result in academic difficulties and may even lead students to withdraw from college altogether (Medrano et al., 2010), because factors other than cognitive abilities are related to the difficulties encountered in higher education. Therefore, being able to successfully face academic life requires behaviors that facilitate a high level of performance as well as a belief that the student’s own skills and aptitudes are enough for them to successfully complete their college studies. Hence, academic self-efficacy (ASE) is a crucial component.

ASE refers to the beliefs that people have about their own ability to learn and acquire behaviors during previously defined levels, such as high school (Khan, 2013) or university (Zander et al., 2018). In this sense, it is important to know the role that ASE has in learning and academic performance, since it responds to the emotional expectations of students, cognitively activating the performance and attention to situational demands.

Thus, the context where the teaching-learning process takes place is of utmost importance because it is known that SES is formed through four sources of information that inevitably appear in higher education. In the first place, there is direct experience, since it is through this that students interpret this information as positive and strengthen their perception of SES. Secondly, there is vicarious experience, where through the observation of models similar to themselves, students learn new strategies to execute certain tasks successfully. Thirdly, there is the social persuasion, that is, when the people around promote the perception that the person possesses the capabilities to solve various situations. Finally, the physical and emotional states also inform depending on the circumstances, since sleep, anxiety, stress, etc., also help to interpret one's own capacity and competence to solve problems (Bandura, 2001).

Thus, self-efficacy influences students' academic motivation (Borzone-Valdebenito, 2017; Rosario et al., 2012) and their learning behaviors in different educational contexts (Alegre, 2014) since it is considered a self-regulatory mechanism of learning because beliefs about one's own ability influence the achievement attained and behaviors chosen, and also the environment can modify those beliefs through persuasion or vicarious learning (Zamora-Araya, 2020), protects from negative effect of anxiety (Green, 2022), and remains stable over the time in students, but tend to increase in women more than men (Bulfone et al., 2021).

For these reasons, as relevant as knowing what strengths a college student has would be the personal judgment about what they can do with the capabilities they possess. For example, self-esteem predicts over the time the ASE in college students (Luo et al., 2022). Therefore, the lack of knowledge about the ASE and the inadequate selection of learning strategies have been considered relevant to know the variables involved in the adaptation process of university students, which could favorably impact their academic performance and thus favor their permanence in the university (Borzone-Valdebenito, 2017; Gomes & Soares, 2013).

In Latin America, the study of ASE in college students has demonstrated a sustained rise, with a variety of findings that help us understand the importance of ASE in academic behavior. For example, the ASE had a direct effect on engagement (β = .39; Mesurado et al., 2016), flow (β = .49; Mesurado et al., 2016), attention in classes (β = .15; Sánchez-Rosas & Esquivel, 2016), academic motivation (β = .337; Montes de Oca & Moreta-Herrera, 2019), academic progress goals (β = .49; Moran et al., 2019), and academic performance (β = .21; Llorca et al., 2017).

Likewise, there was a positive correlation with self-regulated learning, both from a one-dimensional perspective (r = .650; Alegre, 2014) as well as in the review dimension (r = .15), formulation (r = .21), organization (r = .32), critical thinking (r = .32), metacognitive self-regulation (r = .33), time management and study environment (r= .34), effort regulation (r = .23), and help seeking (r = .19; Ventura et al., 2017). Similarly, there was a positive correlation with autonomy (r = .77; Buadas et al., 2017), academic performance (r = .325; Alegre, 2014; r = .409; Ávalos et al., 2018; ω2 = .037; Ferrel-Ortega et al., 2017), pre-exam coping strategies (r = .344; Dominguez-Lara, 2018a), learning strategies (r = .59; Martins & Santos, 2019), college adjustment (r > .20; Borzone-Valdebenito, 2017), wellbeing (r = .336; Bueno-Pacheco et al., 2018; r = .64; Espinoza & Barra, 2018), and resiliency (r = .34; León et al., 2019). By contrast, there is a negative correlation with stress (r = -.37; Gutiérrez-García & Landeros-Velázquez, 2018) and academic procrastination (r = -.32; Moreta-Herrera et al., 2019).

Likewise, we found that motivational scaffolding (η2= 0.65) and cognitive scaffolding (η2= 0.68) within an e-learning environment had a significant effect upon ASE (Valencia-Vallejo et al., 2019a, 2019b). In addition, they did so as far as individual variables, mood (d = .85; Medrano et al., 2016), structural empowerment (β = .18; Tumino et al., 2020), and psychological empowerment (β = .20; Tumino et al., 2020), affect levels of self-efficacy.

Although what has previously been described may reveal the theoretical importance (correlation with related constructs) and the empirical importance (moderate or high effect size) of ASE, because it is modeled through vicarious learning within socialization processes (Bandura, 1977), it will be dependent upon the cultural group to which the assessed subject belongs. In addition, according to some academic development and career selection models (Brown & Lent, 2019), which are related with Bandura’s socio-cognitive theory, learning experiences have had an impact on the formulation of ASE, like the scientific background that they could have (Bulfone et al., 2021). For example, the ASE levels are higher in advanced semester students than the first semester students (Hernández-Jacquez, 2022). These experiences are influenced by ethnic characteristics, parental rearing practices, sex, and access to healthcare and education. This means that there may be significant differences between experiences in different Latin American countries, and there could be significant variations within a single country. Additionally, some experiences may be susceptible to sociodemographic, political, and economic changes, and these variations may affect measurements in a construct such as ASE.

In particular, Latin American countries share characteristics that make allowance for an assumption of similarity. However, some differences do exist. These differences could create biases in the measurements if the instruments that are used do not consider such differences. This is because an implicit cultural equivalency does not exist just because these cultures share a common language, ethnic features, or certain characteristics related to socioeconomic and political development. For example, Latin American countries have stood out for their collectivist values (Hofstede, 1980) although there are discrepancies as to how the levels of these are manifested. An example of this is Argentina, a country that has been assessed as the most individualistic country of the region, with individualism rankings close to those of the United States (Hofstede, 1989). The Latin American region is also characterized by a predominance of traditional values (prominence of religion, bonds between children and parents, and respect for authority and for traditional families) and self-expression (environmental protection, trust, and tolerance) although countries such as Argentina, Chile, and Uruguay have a lower level of traditionalist values when compared with Ecuador, Guatemala, Colombia, and Mexico. While Mexico, Uruguay, and Colombia have greater levels of self-expression than Peru, Brazil, and Guatemala do. Therefore, and given that the ASE is an individualized variable, it is probable that differences will exist among Latin American countries in terms of measurement constructs as well as scoring.

Evaluation of Academic Self-Efficacy

The ASE has usually been assessed as part of a general model of academic burnout with the Maslach Burnout Inventory-Student Survey (MBI-SS; Schaufeli et al., 2002), either as academic inefficacy or academic efficacy. However, because efficacy and inefficacy are not perfect opposites (Bresó et al., 2007; Morgan et al., 2014; Schaufeli & Salanova, 2007), a low score in inefficacy does not necessarily imply an elevated perception of ASE. Furthermore, the reliability coefficients for that dimension of burnout model have produced inconsistent results, which have generally not been reliable in either the inefficacy dimension (Bresó et al., 2007; Schaufeli & Salanova, 2007) or the efficacy dimension (Atalayin et al., 2015; Galán et al., 2011; Hu & Schaufeli, 2009), except in some cases, where these were, in fact, acceptable (Yavuz & Dogan, 2014; Zhang et al., 2007). Because of this inconsistency with regard to the reliability assessment and its potentially negative impact on empirical results (Zimmerman & Zumbo, 2015), we must continue to search for alternative measuring tools.

Other options in the Spanish language are the Inventory of Expectations and Academic Self-Efficacy (Barraza, 2010), the Inventory of Self-Efficacy for Study (Pérez & Delgado, 2006), as well as the Academic Situations Specific Perceived Self-Efficacy Scale (ASSPSES; Palenzuela, 1983). Unlike the former inventories, the Perceived Academic Self-Efficacy Scale offers greater evidence of replicability at a structural factorial level, and in relation to the number of items it offers (10 in the original version), this is an attractive option for a brief one-dimensional evaluation of ASE (Navarro-Loli & Dominguez-Lara, 2019), particularly when simultaneously evaluating several constructs to analyze explanatory models.

ASSPSES has received attention in Ibero-American countries, and the psychometric indicators have been favorable in Peru (Dominguez-Lara, 2016), Argentina (Tumino et al., 2020), España (Palenzuela, 1983), Mexico (Dominguez-Lara & Campos-Uscanga, 2020), Ecuador (Moreta-Herrera et al., 2021) and Chile (Del Valle et al., 2018; Escobar & Pérez, 2017) in terms of internal structure (one-dimensional structure) and internal coherence (coefficients greater than .80), but there are still no reports from Brazil or Colombia. This scale offers various advantages: it is brief, there is unrestricted access (payment is not required), it was originally developed in Spanish, and there are consistent psychometric findings in the countries where it was analyzed. However, the comparison between countries in intercultural studies is a pending task because there are still no reports addressing its measurement invariance among Latin American countries that allow this comparison to be made accurately, since it is normally assumed that the evaluation of a construct is independent of the group to which it belongs (Byrne & van de Vijver, 2010) and when differences are found, it is not possible to know whether they are real differences or the product of the different representation of the construct in each of the groups (Meredith, 1993).

In this sense, measurement invariance analysis provides for an approximation to structural equivalence of the measurement instruments, something that is required when applied to comparative cross-cultural research (Byrne et al., 2009). Structural equivalence refers to the similarity in composition of the dimensions of the construct being evaluated across different cultural groups (Byrne et al., 2009) because assuming the equivalence of psychological constructs between groups is questionable in light of the ongoing critiques of the generalized investigative model based on reported findings concerning populations living in western countries that are educated, industrialized, rich, and democratic (WEIRD; Henrich et al., 2010). This phenomenon occasionally contradicts what we see in other countries, particularly in countries labeled developing nations.

It is worth pointing out that there are some studies of invariance that involve the MBI-SS wherein there is an (in)efficacy scale, but these studies focus on comparing students from different European countries (Schaufeli et al., 2002) or comparing European with Latin American students (Campos & Maroco, 2012; Charry et al., 2018). We have not found research with characteristics similar to those of the present study.

Relationship between AS and emotional academic exhaustion

Due to their continuous role in the educational environment, affectations in AS affect learning processes and the development of emotional problems related to the academic environment, such as feelings of inability to perform adequately facilitating the use of ineffective strategies that confirm this idea of low competence (Khan, 2013), which can lead to academic emotional exhaustion (AEE) and subsequently to academic burnout (AB; Yu et al., 2016).

AB refers to exhaustion resulting from academic demands, being pessimistic and losing interest in academic tasks, and feelings of incompetence as a student, including absenteeism, low participation, lack of meaning in activities, and inability to learn (Charkhabi et al., 2013).

The core element of AB is academic emotional exhaustion (AEE), which is defined as the feeling of being emotionally overburdened and drained by others (Greenglass, 2007) and can influence academic performance, student-teacher relationships, and affect students' enthusiasm toward education (Charkhabi et al., 2013). In this sense, AEE could be considered as reflecting an ASE crisis. For these reasons, studies show that the relationships between self-efficacy and AB are negative (Charkhabi et al., 2013; Kong et al., 2021).

The Present Study

The aim of this investigation has been to perform an analysis of measurement invariance of ASSPSES between college students from five Latin American countries (Peru, Colombia, Mexico, Argentina, and Brazil) from the perspective of classic test theory to contribute to the teaching-learning process through the use of a scale widely used in Spanish-speaking countries, because the ASE influences the environment, behaviors, and attitudes in the school environment and, in turn, is influenced by them (Bandura, 1997). Students' self-efficacy can be increased by the reinforcement obtained through positive comments received from teachers and family members and by fulfilling learning goals resulting from academic efforts (Schunk, 2012). As a complement, increased ASE should affect the likelihood of students' acquisition of self-regulated learning patterns and the provision of adequate learning spaces (Schunk & DiBenedetto, 2016).

As has already been mentioned, most psychological constructs are dependent upon sociocultural aspects, like the ASE (Thomas et al., 2022), indicating the need to verify the measurement equivalence of the construct in relation to the country being evaluated. This is relevant because in the scales relying upon verbal language (be it oral or written), words can have different meanings, depending on the manner and context wherein they are used (Fernández et al., 2010). Therefore, the evaluation instruments cannot be immediately applied to different groups of subjects from those for which the evaluation was originally designed because there is a chance of conceptual errors occurring when there is a direct translation or when a test that was designed for one cultural subgroup is applied to another subgroup without revisions. In this sense, the differences found in the meaning and structure of the psychological construct measurements tend to originate in the variety of social institutions, values, and socialization practices.

In this order of ideas, the ASE has been studied in the countries that participated in this investigation, but with different measurement scales, such as MBI-SS in Colombia (e.g., Ferrel-Ortega et al., 2017), ASSPSES in Peru (e.g., Dominguez-Lara, 2018), or the Academic Behavior Self-Efficacy Scale (ABSES) in Mexico validated by Blanco-Vega et al. (2011) (e.g., Borzone-Valdebenito, 2017), just to name a few. In this sense, notwithstanding the information provided in relation to the construct, and given that ASE was not evaluated using the same instrument in each country, direct comparison is not possible. Therefore, we must rely upon instruments with measurement invariance evidence, given the great cultural and subcultural diversity that exists in Latin America. Such instruments would allow us to contrast the findings directly (using the same instrument) and exactly (with equivalent measurement) such that the cultural distinctions that emerge are considered.

Additionally, this study also represents a benefit for non-Latin readers as they could apply analyze the psychometric properties of the instrument in their cultural context, as well as replicate the developed procedure, given that only one study was found that assesses the measurement invariance of an ASE instrument assessing people coming from countries from different continents (Yildirim & Aybek, 2019).

Method

Design

This is an instrumental research (Ato et al., 2013) focused on the study of the psychometric properties of the Academic Situations Specific Perceived Self-efficacy Scale.

Participants

The most salient demographic characteristics can be seen below (Table 1). It should be stressed that most students are unmarried, almost a fifth of them work, and Mexican students primarily attend public institutions, while the Peruvian, Argentine, and Colombian students primarily attend private universities. The size of the sample is appropriate in all cases, considering that this is a one-dimensional model with fewer than 10 items and with anticipated factorial loadings of .70 (Wolf et al., 2013). Finally, after homogenizing the comparisons, only participants younger than 36 were included as is the case with other studies where data from various different sources are considered (Potthoff et al., 2016).

Table 1: Demographic characteristics 

Source: Elaborated by authors. Note. N: sample size; Rage: Range of age; M: Mean; SD: Standard Deviation.

Instruments

Academic Situations Specific Perceived Self-Efficacy Scale (ASSPSES). This is a one-dimensional measure of ASE (Palenzuela, 1983) that consists of nine items with four response options (from never to always), in which the highest score corresponds with a higher ASE. The items were elaborated according to a logical strategy based on Bandura's theory (1977). The version used was the one adapted to Peruvian college students (Dominguez-Lara, 2016).

Emotional Exhaustion Scale (EES). The EES (Fontana, 2011) is a unidimensional measure of AE by means of 10 items scaled in Likert format with five response options ranging from rarely (1) to always (5). The version adapted in Mexico, Colombia and Peru (Dominguez-Lara et al., 2021) was used for students of those nationalities. This scale was not applied to students from Brazil and Argentina.

Procedure

This research study is a product associated with an investigative project approved by the first author’s university. The research work was carried out according to the principles of the Declaration of Helsinki (World Medical Association, 1964) and the ethical code of the Colegio de Psicólogos del Perú (Colegio de Psicólogos del Perú, 2017). The process underscores a signature for informed consent as well as specific instructions. The voluntary nature of participation was stressed, along with anonymity, with regard to responses.

The researchers from Colombia and Mexico were invited later, and because this was a project that did not involve invasive or potentially harmful procedures, it was not necessary to bring it before evaluation committees in the various universities. Instead, permission was obtained by approaching authorities directly. Data originating from Brazil and Argentina were gathered as parts of separate projects led by authors from those countries, following all of the ethical guidelines required by their respective institutions, including the Portuguese version of the ASSPSES, in the case of Brazil. In all cases, the questionnaires were administered in pencil-paper format, except in the case of Colombia, where a Google Docs form was used.

Data Analysis

Prior to analyzing measurement invariance, a series of descriptive and factorial analyses were carried out for each sample. In particular, an approximation of the univariate normality through the exploration of skewness (< |3|) and kurtosis (< |10|; Kline, 2016) of each item, as well as the multivariate normality with the Mardia’s coefficient (G2 < 70; Rodríguez & Ruiz, 2008). Due to the number of items, it is likely that there is overlap, so it is important to evaluate it. In that sense, the multicollinearity criterion used in the context of factor analysis was taken into account. Thus, inter-item correlations (r ii ) above .90 suggest multicollinearity (Brown, 2015).

After that, a confirmatory factor analysis was carried out (CFA) for each of the samples. The extraction method was Weighted Least Squares Mean and Variance Adjusted (WLSMV) with polychoric correlations. The WLSMV was carried out in this study because it is appropriate for ordinal items (Ledesma et al., 2021). Furthermore, estimates the factorial loadings with more accurate compared to other methods based on maximum likelihood (Li, 2016a, 2016b).

The valuation of the model was carried out both general and specific. In general terms, the magnitude of some fit indices was examined, such as the CFI (> .90; McDonald & Ho, 2002), the upper limit of the confidence interval (CI) of RMSEA (< .10; West et al., 2012), and WRMR (< 1; DiStefano et al., 2018). The magnitude of factorial loadings was evaluated individually (> .50; Dominguez-Lara, 2018b) as was the difference between highest and lowest magnitude inside of each structure (< |.10|: trivial; ≥ |.10|: small; ≥ |.20|: moderate; ≥ |.30|: large; ≥ |.40|: very large; Finch & French, 2008) and the average variance extracted by factor (AVE > .50; Fornell & Larcker, 1981).

With respect to reliability, in each model, the assumption of tau-equivalence was evaluated prior to the calculation of the coefficient alpha (Dunn et al., 2014), and it was concluded that it is satisfied if ΔCFI < −.01 y ΔRMSEA < .015 (Chen, 2007). Likewise, the construct reliability was valued with the coefficient ordinal alpha (Dominguez-Lara, 2018c) and ω (> .70; Hunsley & Marsh, 2008). The difference between the coefficients alpha and omega (Δω-α) was considered significant when exceeding |.06| (Gignac et al., 2007).

Following these initial steps, a measurement invariance analysis of the one-dimensional model for ASSPSES was conducted among the five samples through a multi-group factor analysis (MGFA) was carried out, and the statistical equivalence of the internal structure of the ASSPSES (configural invariance) was initially examined, as were the factor loadings (metric invariance), thresholds (strong invariance), and finally, residuals (strict invariance; Pendergast et al., 2017). Evidence regarding the level of measurement invariance was initially evaluated in general terms through the examination of variation in the CFI and RMSEA. Thus, the level of metric invariance was considered favorable according to the RMSEA variation (Δ ≤ .05; Rutkowski & Svetina, 2017) y CFI (Δ ≥ −.004; Rutkowski & Svetina, 2017). With regard to strong invariance, the RMSEA (Δ ≤ .01; Rutkowski & Svetina, 2017) was considered as well as the CFI (Δ ≥−.004; Rutkowski & Svetina, 2017). Subsequently, potential non-invariant parameters (according to the modification indices) were examined individually, with a focus on misspecifications (Saris et al., 2009). Finally, if the number of non-invariant parameters would be less than 20 % so that measurement invariance would be determined (Dimitrov, 2010).

Since different methods of assessing measurement equivalence do not converge perfectly due to differences in the sample size of the groups compared, the magnitude of the factor loadings, and the degree of item invariance, the probability of false positives and false negatives was reduced by implementing a complementary approach to measurement invariance. Then, a nonparametric approach based on contingency tables was introduced for the detection of differential item functioning (DIF) in more than two groups. The method was generalized Mantel-Haenszel statistics (Fidalgo & Madeira, 2008) based on the Mantel-Haenszel statistic for contingency tables organized in Q: R x C (Q: strata; R: row; C: colum; Landis et al., 1978). This method allows us to obtain a full statistical test of the null hypothesis of absence of DIF in more than three groups simultaneously.

The specifications for this procedure were as follows: a) the matching variable was the ASSPSES total observed score, and transformed into quantiles; to address the sensitivity of DIF detection, the total score was transformed into five (quintiles) and ten intervals (deciles), b) the number of focus groups was five, corresponding to each country compared, c) the alpha for testing the null hypothesis of absence of DIF was at .05 corrected with Bonferroni´s method (.01/9 = .005) to reduce the effect of repeated statistical testing (Fidalgo, 2011; Penfield, 2001), d) items detected with possible DIF were analyzed post hoc by paired comparisons between groups (Fidalgo & Scalon, 2009), and where the alpha (. 05) of these paired comparisons was also adjusted with the Bonferroni method due to its effectiveness (Kim & Oshima, 2013); and e) the Generalized Ordinal Ordinal Mantel-Haenszel statistic QGMH(2) (df = number of response options - 1) was used, in which the response variable is ordinal (ASSPSES items) and the grouping variable is nominal (in this study, five-level factor, one for each country). The QGMH(2) statistic tests the null hypothesis against no differences in item mean scores across group factor levels, and is sensitive to DIFs of similar direction and magnitude across response categories (Fidalgo 2011; Fidalgo & Scalon, 2012).

Because of the sample size the p-value approach is likely to reject the null hypothesis (Halsey, 2019), even regardless of the magnitude of the DIF, the partial gamma coefficient (( p; Davis, 1967) was used as an effect size estimator. This statistic is applicable to Q: R x C tables characteristic of DIF for ordinal variables (Schnohr et al., 2008) and was valued according to this scale: Between 0 and .15, weak; between .16 and .30, moderate, greater than .30 strong (Schnohr et al., 2008).

The analytic process was facilitated by the software program Mplus Version 7 (Muthén & Muthén, 1998-2015), and the misspecifications were analyzed with a specific module (Dominguez-Lara & Merino-Soto, 2018). The DIF analysis was carried out with the software GMHDIF (Fidalgo, 2009, 2011) and R package iarm (Mueller, 2020)

Finally, regarding the evidence of validity due to its relationship with other variables, the association between the measure of ASE and that of AEE was explored with Pearson correlation coefficient under an effect size approach, where a value between .20 and .50 is considered low, between .50 and .80, moderate, and greater than .80, high (Ferguson, 2009).

Results

To the extent that descriptive analysis is concerned, all five samples evidenced acceptable magnitudes of skewness and kurtosis in each of the items, as well as acceptable multivariate normality (G2ARG = 43.08; G2BRA = 6.82; G2COL = 36.66; G2MEX = 22.79; G2PER = 29.16). As for the inter-item correlation (r ii ) by country, in Peru it ranged between .474 and .694 (M = .58), in Mexico between .48 and .69 (M = .58), in Colombia between .56 and .75 (M = .64), in Argentina between .40 and .57 (M = .47) and in Brazil between .26 and .64 (M = .47), which indicates the absence of multicollinearity between items.

The structural analysis reveals the fulfillment of a one-dimensional structure, with respect to the fit indices, the factor loadings and the AVE (> .50), and with minor differences between the highest and lowest factor loading (Table 3). With respect to reliability, in most of the samples (except for Brazil and Peru) the assumption of tau-equivalence was met for an appropriate estimate of the coefficient α. In addition, all of the reliability indicators were favorable (> .80) and virtually the same in terms of magnitude (Table 2).

As far as the evidence for measurement invariance is concerned, the variation of the fit indices fell within the expected range following the incremental restriction of parameters, both for CFI and RMSEA, until reaching strong invariance (Table 2). In addition, an individual analysis of the estimated parameters reveals complimentary information. As has already been suggested, the one-dimensional structure provides satisfactory indicators when analyzed simultaneously (configural invariance), but when load factors are fixed to a specific designated value -a reference value (RV)- to analyze the metric invariance, some differences emerge among the groups. For example, the factors loadings of several items in the Colombian and Argentine samples are, respectively, higher and lower than the RV (Table 3). Meanwhile, the Peruvian, Brazilian, and Colombian samples do not reveal differences (except for Item 1 for the Brazilian students). However, after modeling the strong invariance, these differences disappeared, and only some thresholds appeared as not invariant in an isolated way (i.e., one threshold per country; Table 3).

Table 2: Structural Analysis (internal structure and tau-equivalence) and measurement invariance 

Source: Elaborated by authors. Note. PER: Peru; COL: Colombia; ARG: Argentina; MEX: México; BRA: Brazil. %At: percentage of attenuation.

Table 3: Individual Parameters of Items by Country 

As for DIF, when the total score was divided into quintiles and deciles (Table 4), the QMH(2) statistic detected three items with probable differential functioning (items 1, 3 and 6) , with QMH(2) > 28.0 (p< .0005). The p coefficients ranged from , and for items detected with DIF, the p coefficients ranged from , which can be considered weak. Similarly, when the total score was divided into deciles, all items (except item 9) were detected with DIF (p< .0005), but the coefficients ranged, a magnitude also weak in all cases.

Table 4: Differential item functioning of ASSPSES 

Source: Nota:Elaborated by authors. : Partial gamma coefficient. QMH(2): Generalized Ordinal Mantel-Haenszel statistic (df = 4). * Bonferroni correction p = .0005.

Thus, considering the sources of information, measurement invariance was favorably evidenced taken account the information of the two approaches revised.

Regarding the association with the measure of EEE, small correlations were found with the sample obtained from Mexico (r = -.29), Colombia (r = -.21) and Peru (r = -.34).

Discussion

The aim of the study was to analyze measurement invariance of ASSPSES among college students from five Latin American countries. The research approach emerges from the premise that any kind of intercultural research involves an overlapping of cultures (Sarmento, 2014), allowing for the recognition of differential and common elements in diverse groups with respect to a particular phenomenon.

With regard to the structural results for each group, the psychometric indicators do not differ from previous findings regarding the internal structure and reliability of ASSPSES in the samples from Peru (Dominguez-Lara, 2016), Mexico (Dominguez-Lara & Campos-Uscanga, 2020), and Argentina (Tumino et al., 2020). The factorial parameters from Colombia are more favorable (i.e., higher factor loads), and in Brazil, the scenario was similar to that in the first three countries, with the exception of item 1, which obtained an acceptable factor loading, but one that was lower than those of the others. In this sense, the internal structure of ASSPSES also receives favorable evidence for Colombia and Brazil. Regarding reliability, the level of precision attained is notable in all cases, including cases where the tau-equivalence was not met.

In relation to the former, it is worth recalling an elevated RMSEA in all cases, which is explained by the magnitudes of the observed factor loads (> .70; Mahler, 2016; Savalei, 2012), but an RMSEA at the margin of what is acceptable, together with a good CFI in all cases, does not necessarily mean a bad model (Lai & Green, 2016).

With regard to the invariance analysis that was conducted, it is possible to conclude with a high level of certainty that ASSPSES is invariant among the groups, at least up through the strong invariance in the MGFA and DIF. This indicates that the construct is measured similarly among the students surveyed and with tolerable measurement error (reliability coefficients > .85), which provides greater possibilities for a joint study of the construct, and even for individual educational diagnostic purposes due to its high degree of reliability.

Although this study is the first that involves an analysis of ASSPSES carried out simultaneously in different samples and with favorable findings at that, certain caution is advisable with regard to the descriptive aspects of the findings. For example, Colombia has the highest factor loads, while Argentina has the lowest. This would indicate that although ASE is evaluated in a one-dimensional manner in both countries (and in the other countries), the proportion of true variance differs between these countries, and it is probable that, if a comparison were carried out, the Argentine sample would have more measurement errors than the Colombian sample would.

In this vein, it stands out that all of the countries have item 3 (“I feel confident about approaching situations that test my academic capability”) as one of the two most representative items. The next most representative item is item 6 (“I believe that I am a capable and competent person in my academic life”) for Peru, Colombia, and Mexico, item 5 (“I don’t care that the professors are demanding and tough because I trust my own academic capability”) for Argentina, and item 7 (“I believe I am sufficiently capable of having a good academic record if I set out to do so”) for Brazil. As for the least representative item, item 7 for Peru and Mexico, and item 8 (“I think I can pass the classes fairly easily and even get good grades”) for Colombia, Argentina, and Brazil.

Regarding the association between ASE and AB, the negative correlation is compatible with previous evidence (Charkhabi et al., 2013; Kong et al., 2021) and would indicate that cognitive and social demands could affect SSA beliefs and thereby decrease achievement expectations, planning ability, and academic performance by increasing the experience of stress. This information could be useful to professionals guiding students because students with high levels of ASE should be tolerable and not lead to problems in achieving learning goals.

These results have various practical applications. To begin with, being able to rely on an invariant measurement for ASE allows for a more precise comparison among groups. Likewise, it is possible to consider the use of ASSPSES in comparative research of intercultural nature. From a broad, evidence-based vantage point, this approach would, make, among other features, allowances for the identification of subject areas in the region where further investigation is needed. It is also possible to use the questionnaire to evaluate the efficacy of intervention programs geared toward ASE (e.g., Roshangar et al., 2020; Sohrabi et al., 2022), particularly in instances of low ASE, given the demonstrated correlation with various variables that directly affect the academic achievement of students. In addition, it is possible to encourage the development of research regarding the advancement of health and wellbeing in young people because ASE has a positive correlation with autonomy (Buadas et al., 2017), resiliency (León et al., 2019), moods (Medrano et al., 2016), structural and psychological empowerment (Tumino et al., 2020), and has a negative correlation with stress (Gutiérrez-García & Landeros-Velázquez, 2018) and academic procrastination (Moreta-Herrera et al., 2019), while in other cultural contexts, self-efficacy has proven to be a direct predictor of academic resiliency (Martin & Marsh, 2006), as well as being a predictor of academic performance (Ansong et al., 2019). All of this is relevant at the moment wherein this paper is written because of the current context of generalized uncertainty resulting from the global health emergency caused by the COVID-19 pandemic and given that Latin America is one of the regions with the greatest numbers of people infected, students of all educational levels will be prioritized with regard to intervention (Moreta-Herrera et al., 2022). In that sense, possessing a valid and reliable measure of ASE for a sizable portion of Latin American countries could help consolidate and standardize programs that help students succeed academically and conquer adversities, considering the importance of ASE in these processes, and the same instrument can be used to evaluate its effectiveness due to its brevity and ease of administration.

This study has various strengths. The first is that, in addition to the variation in the fit indices, the individual parameters were also examined (e.g., modification indices) as a foundation for decision making in the analysis of measurement invariance. The second strength concerns the criteria used to assess measurement invariance. Traditionally, cut-off points are used for the variation of adjustment indices (e.g., ΔRMSEA) based on quantitative variables and two groups (e.g., Chen, 2007). However, in light of the fact that we are working with a greater number of groups (5) and a one-dimensional model of ordinal variables, the criteria used was more appropriate (Rutkowski & Svetina, 2017).

Regarding the limitations, it must be remembered that the samples gathered are not representative of each of the participating countries and were collected from different independent studies, so that in future studies the collection of information will be planned jointly. Therefore, it is not possible to generalize the results for the entire population of Latin American students. Second, a majority of the participants were women in all five countries, with percentages ranging from 88.9 % for Colombia to 59.9 % for Mexico. Third, the study did not examine other contextual factors (van de Vijver, 2009) that may have differed among countries and which could have potentially affected the results (e.g., educational models at Latin American institutions of higher education, the educational quality of participating institutions, how these institutions are ranked within their respective countries as well as in the Latin American context). This was because, for example, a majority of the Mexican students attended a public university, while students from all the other countries attended private universities. Fourth, the evaluation of the ESA was only carried out in the Peruvian, Mexican and Colombian samples, since they shared the same evaluation format, while the applications in Argentina and Brazil were developed in the framework of independent projects that did not include this construct, although in all cases the institutional ethical procedures and the presentation of informed consent were respected. Finally, it is true that noisy data is a potential problem for any psychometric study, but it would only appear in the presence of adequate statistical significance of the model (favorable fit indices, acceptable factor loadings, etc.) and low reliability coefficients (Clayson & Miller, 2017), which is not compatible with the findings of the present manuscript, because reliability coefficients are above .88 in all cases.

Then, it is concluded that ASSPSES is an invariant measurement of ASE among students from five Latin American countries and that the findings contribute to the understanding of the internal structure of the scale, something that had been awaiting evaluation, given how the scale is used in various contexts.

Nonetheless, further research is recommended where groups are balanced in terms of sex and field of study to minimize the likelihood of introducing biases resulting from the characteristics of the participants. To that end, it would be useful to carry out invariance analyses according to gender, type of institution (public or private), and work situation (whether the student works) to determine whether the factorial structure is maintained. It would also be appropriate to supplement such an investigation with an invariance analysis from the perspective of item response theory models wherein parameters of difficulty and discrimination are used to evaluate the latent space and specific contribution levels of the items.

References:

Alegre, A. (2014). Academic self-efficacy, self-regulated learning and academic performance in first-year university students. Propósitos y Representaciones, 2(1), 79-120. https://doi.org/10.20511/pyr2014.v2n1.54Links ]

Ansong, D., Eisensmith, S. R., Okumu, M., & Chowa, G. A. (2019). The importance of self-efficacy and educational aspirations for academic achievement in resource-limited countries: Evidence from Ghana. Journal of Adolescence, 70(1), 13-23. https://doi.org/10.1016/j.adolescence.2018.11.003Links ]

Atalayin, C., Balkis, M., Tezel, H., Onal, B., & Kayrak, G. (2015). The prevalence and consequences of burnout on a group of preclinical dental students. European Journal of Dentistry, 9(3), 356-363. https://doi.org/10.4103/1305-7456.163227Links ]

Ato, M., López, J., & Benavente, A. (2013). Un sistema de clasificación de los diseños de investigación en psicología. Anales de Psicología, 29(3), 1038-1059. https://doi.org/10.6018/analesps.29.3.178511Links ]

Ávalos, M. L., Oropeza, R., Ramírez, J. C., & Palos, M. U. (2018). Percepción de autoeficacia y rendimiento académico en estudiantes de bachillerato. Caleidoscopio - Revista Semestral de Ciencias Sociales y Humanidades, 22(39), 33-46. https://doi.org/10.33064/39crscsh1323Links ]

Bandura, A. (1977). Self-Efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191-215. [ Links ]

Bandura, A. (1997). Self-efficacy: The exercise of control. Freeman. [ Links ]

Bandura, A. (2001). Social Cognitive Theory: an agentic perspective. Annual Reviews Psychologist. 52(1), 2-18. https://doi.org/10.1146/annurev.psych.52.1.1Links ]

Barraza, A. (2010). Validación del inventario de expectativas de autoeficacia académica en tres muestras secuenciales e independientes. CPU-e, Revista de Investigación Educativa, 10(1), 1-30. [ Links ]

Blanco-Vega, H., Martínez-Marín, M., Zueck-Enríquez, M. C. & Gastélum-Cuadras, G. (2011). Análisis psicométrico de la escala autoeficacia en conductas académicas en universitarios de primer ingreso. Revista Electrónica Actualidades Investigativas en Educación, 11(3), 1-27. [ Links ]

Borzone-Valdebenito, M. A. (2017). Autoeficacia y vivencias académicas en estudiantes universitarios. Acta Colombiana de Psicología, 20(1), 266-274. https://doi.org/10.14718/ACP.2017.20.1.13Links ]

Bresó, E., Salanova, M., & Schaufeli, W. B. (2007). In search of the “third dimension” of burnout: Efficacy or inefficacy? Applied Psychology, 56(3), 460-478. https://doi.org/10.1111/j.1464-0597.2007.00290.xLinks ]

Brown, S. D., & Lent, R. W. (2019). A Social Cognitive View of Career Development and Guidance. In J. A. Athanasou & H. N. Perera (Eds.), International Handbook of Career Guidance (pp. 147-166). Springer. [ Links ]

Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press. [ Links ]

Buadas, C. R., Lobo, P. E., & Díaz, N. Y. (2017). Aprendizaje autónomo y autoeficacia en alumnos universitarios de inglés como lengua extranjera. Aportes Científicos desde Humanidades, 12(2), 129-138. [ Links ]

Bueno-Pacheco, A., Lima-Castro, S., Peña-Contreras, E., Cedillo-Quizhpe, C., & Aguilar-Sizer, M. (2018). Adaptación al español de la Escala de Autoeficacia General para su uso en el contexto ecuatoriano. Revista Iberoamericana de Diagnóstico y Evaluación e Avaliação Psicológica, 48(3), 5-17. https://doi.org/10.21865/RIDEP48.3.01Links ]

Bulfone, G., Badolamenti, S., Biagioli, V., Maurici, M., Macale, L., Sili, A., Vellone, E., & Alvaro, R. (2021). Nursing students' academic self-efficacy: A longitudinal analysis of academic self-efficacy changes and predictive variables over time. Journal of Advanced Nursing, 77(5), 2353-2362. https://doi.org/10.1111/jan.14771Links ]

Byrne, B. M. & van de Vijver, F. (2010). Testing for measurement and structuralequivalence in large-scale cross-cultural studies: Addressing the issue of none-quivalence. International Journal of Testing, 10(2), 107-132. https://doi.org/10.1080/15305051003637306Links ]

Byrne, B. M., Oakland, T., Leong, F. T., van de Vijver, F. J., Hambleton, R. K., Cheung, F. M., & Bartram, D. (2009). A critical analysis of cross-cultural research and testing practices: Implications for improved education and training in psychology. Training and Education in Professional Psychology, 3(2), 94-105. https://doi.org/10.1037/a0014516Links ]

Campos, J. A. D. B., & Maroco, J. (2012). Maslach Burnout Inventory - Student Survey: Portugal - Brazil cross - cultural adaptation. Revista de Saúde Pública, 46(5), 816-824. https://doi.org/10.1590/S0034-89102012000500008Links ]

Charkhabi, M., Azizi Abarghuei, M., & Hayati, D. (2013). The association of academic burnout with self-efficacy and quality of learning experience among Iranian students. SpringerPlus, 2, 677. https://doi.org/10.1186/2193-1801-2-677Links ]

Charry, C., Garzón, A., Pozo, C., & Bretones, B. (2018). Invarianza factorial del burnout académico para estudiantes hispanohablantes. Revista Mexicana de Investigación Educativa, 23(79), 1195-1215. [ Links ]

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464-504. https://doi.org/10.1080/10705510701301834Links ]

Clayson, P. E. & Miller, G. A. (2017). Psychometric considerations in the measurement of event-related brain potentials: Guidelines for measurement and reporting. International Journal of Psychophysiology, 111, 57-67. https://doi.org/10.1016/j.ijpsycho.2016.09.005Links ]

Colegio de Psicólogos del Perú. (2017). Código de ética y deontología. https://www.cpsp.pe/documentos/marco_legal/codigo_de_etica_y_deontologia.pdfLinks ]

Davis, J. A. (1967). A partial coefficient for Goodman and Kruskal’s Gamma. Journal of the American Statistical Association 62, 189-193. https://doi.org/10.1080/01621459.1967.10482900Links ]

Del Valle, M., Díaz, A., Pérez, M., & Vergara, J. (2018). Análisis Factorial Confirmatorio Escala Autoeficacia Percibida en Situaciones Académicas (EAPESA) en Universitarios Chilenos. Revista Iberoamericana de Diagnóstico y Evaluación e Avaliação Psicológica, 49(4), 97-106. https://doi.org/10.21865/RIDEP49.4.08Links ]

Dimitrov, D. M. (2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43(2), 121-149. https://doi.org/10.1177/0748175610373459Links ]

DiStefano, C., Liu, J., Jiang, N., & Shi, D. (2018). Examination of the weighted root mean square residual: Evidence for trustworthiness? Structural Equation Modeling: A Multidisciplinar Journal, 25(3), 453-466. https://doi.org/10.1080/10705511.2017.1390394Links ]

Dominguez-Lara, S. & Campos-Uscanga, Y. (2020). Análisis psicométrico de una medida de autoeficacia académica en estudiantes mexicanos de ciencias de la salud. Online Advance. Educación Médica. https://doi.org /10.1016/j.edumed.2020.09.021Links ]

Dominguez-Lara, S. & Merino-Soto, C. (2018). Análisis de las malas especificaciones en modelos de ecuaciones estructurales. Revista Argentina de Ciencias del Comportamiento,10(2), 19-24. https://doi.org/10.30882/1852.4206.v10.n2.19595Links ]

Dominguez-Lara, S. (2016). Valores normativos de una escala de autoeficacia académica en estudiantes universitarios de Lima. Interacciones, 2(2), 91-98. https://doi.org/10.24016/2016.v2n2.31 Links ]

Dominguez-Lara, S. (2018a). Afrontamiento ante la ansiedad pre-examen y autoeficacia académica en estudiantes de ciencias de la salud. Educación Médica, 19(1), 39-42. https://doi.org/10.1016/j.edumed.2016.07.007Links ]

Dominguez-Lara, S. (2018b). Proposal for cut-offs for factor loadings: A construct reliability perspective. Enfermería Clínica, 28(6), 401-402. https://doi.org/10.1016/j.enfcli.2018.06.002Links ]

Dominguez-Lara, S. (2018c). Reliability and ordinal alpha. Actas Urológicas Españolas, 42(2), 140-141. https://doi.org/10.1016/j.acuro.2017.07.002Links ]

Dominguez-Lara, S., Alarcón-Parco, D., Fernández-Arata, M., Tamayo-Agudelo, W., Bernal-Vargas, L., & Campos-Uscanga, Y. (2021). Invarianza factorial de una medida de burnout académico entre estudiantes universitarios de Perú, México y Colombia. Revista Argentina de Ciencias del Comportamiento, 13(3), 70-86. [ Links ]

Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399-412. https://doi.org/10.1111/bjop.12046Links ]

Escobar, A. & Pérez, C. (2017). Estructura factorial y confiabilidad de una escala de autoeficacia académica en estudiantes chilenos de Fonoaudiología. Educación Médica Superior, 31(3), 70-79. [ Links ]

Espinoza, C. & Barra, E. (2018). Autoeficacia, apoyo social y bienestar psicológico en estudiantes universitarios asmáticos. Revista de Psicología, 14(28), 141-147. [ Links ]

Ferguson, C.J. (2009). An effect size primer: A guide for clinicians and researchers. Professional Psychology: Research and Practice, 40(5), 532-538. https://doi.org/10.1037/a001580Links ]

Fernández, A., Pérez, E., Alderete, A. M., Richaud, M. C., & Liporace, M. F. (2010). ¿Construir o adaptar tests psicológicos? Diferentes respuestas a una cuestión controvertida. Revista Evaluar, 10(1), 60-74. https://doi.org/10.35670/1667-4545.v10.n1.459Links ]

Ferrel-Ortega, F. R., Ferrel-Ballestas, L. F., Cantillo-Aguirre, A. A., Jaramillo-Campo, J., & Jiménez-Suárez, S. M. (2017). Variables académicas y sociodemográficas relacionadas con el Síndrome de Burnout, en estudiantes de Ingenierías y Ciencias de la Salud de una universidad estatal de Colombia. Psicogente, 20(38), 336-352. https://doi.org/10.17081/psico.20.38.2555Links ]

Fidalgo A. M. (2011). A new approach for differential item functioning detection using Mantel-Haenszel methods. The GMHDIF program The Spanish Journal of Psychology, 14(2), 1018-1022. https://doi.org/10.5209/rev_sjop.2011.v14.n2.47Links ]

Fidalgo, A. M. & Madeira, J. M. (2008) Generalized Mantel-Haenszel methods for DIF detection. Educational and Psychological Measurement, 68, 940-958. https://doi.org/10.1177/0013164408315265Links ]

Fidalgo, A. M. & Scalon, J. D. (2009). Using Generalized Mantel-Haenszel statistics to assess DIF among multiple groups. Journal of Psychoeducational Assessment, 28(1), 60-69. https://doi.org/10.1177/0734282909337302Links ]

Fidalgo, A. M. & Scalon, J. D. (2012). Uso dos métodos Mantel-Haenszel para a detecção do funcionamento diferencial dos itens e software relacionado. Psicologia: Reflexão e Crítica, 25(1), 60-68. https://doi.org/10.1590/S0102-79722012000100008Links ]

Fidalgo, A. M. (2009). GMHDIF: A computer program for detecting DIF in dichotomous and polytomous items using generalized Mantel-Haenszel Statistics. Applied Psychological Measurement, 35, 247-249. https://doi.org/10.1177/0146621610375691Links ]

Finch, W. H. & French, B. F. (2008). Comparing factor loadings in exploratory Factor Analysis: A New Randomization Test. Journal of Modern Applied Statistical Methods, 7(2), 376-384. https://doi.org/10.22237/jmasm/1225512120Links ]

Fontana, S. (2011). Estudio preliminar de las propiedades psicométricas de la escala de desgaste emocional para estudiantes universitarios. Revista Argentina de Ciencias del Comportamiento, 3(2), 44-48. [ Links ]

Fornell, C. & Larcker, D.F. (1981). Evaluationg structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. https://doi.org/10.1177/002224378101800104Links ]

Galán, F., Sanmartín, A., Polo, J., & Giner, L. (2011). Burnout risk in medical students in Spain using the Maslach Burnout Inventory-Student Survey. International Archives of Occupational and Environmental Health, 84(4), 453-459. https://doi.org/10.1007/s00420-011-0623-xLinks ]

Gignac, G. E., Bates, T. C., & Jang, K. (2007). Implications relevant to CFA model misfit, reliability, and the Five Factor Model as measured by the NEO-FFI. Personality and Individual Differences, 43(5), 1051-1062. https://doi.org/10.1016/j.paid.2007.02.024Links ]

Gomes, G. & Soares, A. B. (2013). Inteligência, habilidades sociais e expectativas acadêmicas no desempenho de estudantes universitários. Psicologia: Reflexão e Crítica, 26(4), 780-789. https://doi.org/10.1590/S0102-79722013000400019Links ]

Green, Z. A. (2022). Generalized self-efficacy shields on the negative effect of academic anxiety on academic self-efficacy during COVID-19 over time: A mixed-method study. Journal of School and Educational Psychology, 2(1), 44-59. https://doi.org/10.47602/josep.v2i1.17Links ]

Greenglass, E. R. (2007). Teaching and Stress. In G. Fink (Ed.), Encyclopedia of Stress (2nd ed., pp. 713-717). Academic Press. [ Links ]

Gutiérrez-García, A. G. & Landeros-Velázquez, M.G. (2018). Autoeficacia académica y ansiedad, como incidente crítico, en mujeres y hombres universitarios. Revista Costarricense de Psicología, 37(1), 1-25. https://doi.org/10.22544/rcps.v37i01.01Links ]

Halsey, L. G. (2019). The reign of the p-value is over: what alternative analyses could we employ to fill the power vacuum? Biology letters, 15(5), 20190174. https://doi.org/10.1098/rsbl.2019.0174Links ]

Henrich, J., Heine, S. J., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33(2-3), 61-83. https://doi.org/10.1017/s0140525x0999152xLinks ]

Hernández-Jacquez, L. F. (2022). Evolución del nivel de autoeficacia académica percibida en estudiantes universitarios mexicanos del medio rural. Revista Brasileira de Educação do Campo, 7, e13450. https://doi.org/10.20873/uft.rbec.e13450Links ]

Hofstede, G. (1980). Culture’s consequences: International differences in work related values. Sage [ Links ]

Hofstede, G. (1989). Un reexamen des cultures Nationales. Les Cahiers Internationaux de Psychologie Sociale, 2-3, 43-64. [ Links ]

Hu, Q. & Schaufeli, W. B. (2009). The factorial validity of the Maslach Burnout Inventory-Student Survey in China. Psychological Reports, 105(2), 394-408. https://doi.org/10.2466/PR0.105.2.394-408Links ]

Hunsley, J. & Marsh, E. J. (2008). Developing criteria for evidence-based assessment: An introduction to assessment that work. In J. Hunsley & E. J. Marsh (Eds.), A guide to assessments that work (pp. 3-14). Oxford University Press. [ Links ]

Khan, M. (2013). Academic self-efficacy, coping, and academic performance in college. International Journal of Undergraduate Research and Creative Activities, 5(4), 1-13. https://doi.org/10.7710/2168-0620.1006. [ Links ]

Kim, J. & Oshima, T. C. (2013). Effect of multiple testing adjustment in differential item functioning detection. Educational and Psychological Measurement, 73(3), 458-470. https://doi.org/10.1177/0013164412467033Links ]

Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). The Guilford Press. [ Links ]

Kong, L-N., Yang, L., Pan, Y-N., & Chen, S-Z. (2021). Proactive personality, professional self-efficacy and academic burnout in undergraduate nursing students in China. Journal of Professional Nursing, 37(4), 690-695. https://doi.org/10.1016/j.profnurs.2021.04.003Links ]

Lai, K. & Green, S. B. (2016). The problem with having two watches: assessment of fit when RMSEA and CFI disagree. Multivariate Behavioral Research, 51(2-3), 220-239. https://doi.org/10.1080/00273171.2015.1134306Links ]

Landis, J. R., Heyman, E. R., & Koch, G. G., (1978). Average partial association in three-way contingency tables: A review and discussion of alternative tests. International Statistical Review, 46, 237-254. https://doi.org/10.2307/1402373Links ]

Ledesma, R. D., Ferrando, P. J., Trógolo, M. A., Poó, F. M., Tosi, J. D., & Castro, C. (2021). Exploratory factor analysis in transportation research: Current practices and recommendations. Transportation Research Part F: Traffic Psychology and Behaviour, 78, 340-352. https://doi.org/10.1016/j.trf.2021.02.021Links ]

León, A., González, S., González, N., & Barcelata, B. (2019). Estrés, autoeficacia, rendimiento académico y resiliencia en adultos emergentes. Electronic Journal of Research in Educational Psychology, 17(1), 129-148. http://doi.org/10.25115/ejrep.v17i47.2226Links ]

Li, C. (2016a). The performance of ML, DWLS, and ULS estimation with robust corrections in structural equation models with ordinal variables. Psychological Methods, 21(3), 369-387. https://doi.org/10.1037/met0000093Links ]

Li, C. (2016b). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavioral Research Methods, 48, 936-949. https://doi.org/10.3758/s13428-015-0619-7Links ]

Llorca, A., Richaud, M. C., & Malonda, E. (2017). Parenting, peer relationships, academic self-efficacy, and academic achievement: direct and mediating effects. Frontiers in Psychology, 8, 2120. https://doi.org/10.3389/fpsyg.2017.02120Links ]

Luo, Y., Gao, W., & Liu, X. (2022). Longitudinal relationship between self-esteem and academic self-efficacy among college students in China: Evidence from a cross-lagged model. Frontiers in Psychology, 13, 877343. https://doi.org/10.3389/fpsyg.2022.877343Links ]

Mahler, C. (2016). The Influence of Model Components and Misspecification Type on the Performance of the Comparative Fit Index (CFI) and the Root Mean Square Error of Approximation (RMSEA) in Structural Equation Modeling (Doctoral dissertation, University of Calgary). https://prism.ucalgary.ca/bitstream/handle/11023/3240/ucalgary_2016_mahler_claudia.pdf?sequence=1Links ]

Martin, A. J. & Marsh, H. (2006). Academic resilience and its psychological and educational correlates: a construct validity approach. Psychology in the Schools, 43(3), 267-281. https://doi.org/10.1002/pits.20149Links ]

Martins, R. M. M. & Santos, A. A. A. (2019). Estratégias de aprendizagem e autoeficácia acadêmica em universitários ingressantes: estudo correlacional. Psicologia Escolar e Educacional, 23, e176346. http://doi.org/10.1590/2175-35392019016346Links ]

McDonald, R. P. & Ho, M.-H. R. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7(1), 64-82. https://doi.org/10.1037/1082-989X.7.1.64Links ]

Medrano, L. A., Flores-Kanter, E., Moretti, L., & Pereno, G. L. (2016). Los efectos de la inducción de estados emocionales positivos y negativos sobre las creencias de autoeficacia académica de estudiantes universitarios. Psicología Educativa: Revista de los Psicólogos de la Educación, 22(2), 135-141. https://doi.org/10.1016/j.pse.2015.03.003 Links ]

Medrano, L., Galleano, C., Galera, M., & Del Valle, R. (2010). Creencias Irracionales, rendimiento y deserción académica de ingresantes universitarios. Liberabit, 16(2), 183-192. [ Links ]

Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525-543. https://doi.org/10.1007/BF02294825Links ]

Mesurado, B., Richaud, M. C., & Mateo, J. N. (2016). Engagement, flow, self-efficacy, and eustress of university students: a cross-national comparison between the Philippines and Argentina. The Journal of Psychology, 150(3), 281-299. https://doi.org/10.1080/00223980.2015.1024595Links ]

Montes de Oca, C. I. & Moreta Herrera, R. (2019). La función predictora de la Autoeficiencia en la motivación escolar en los estudiantes de medicina del Ecuador. Uniandes EPISTEME, 6(4), 565-578. [ Links ]

Moran, V. E., Jaime, M. F. Z., & Cupani, M. (2019). Adaptación argentina de dos medidas de autoeficacia en el ámbito académico universitario. Contextos educativos: Revista de Educación, 24, 197-211. https://doi.org/10.18172/con.3622Links ]

Moreta-Herrera, R., Lara-Salazar, M., Camacho-Bonilla, P., & Sánchez-Guevera, S. (2019). Análisis factorial, fiabilidad y validez de la escala de autoeficacia general (EAG) en estudiantes ecuatorianos. Psychology, Society, & Education, 11(2), 193-204. https://doi.org/10.25115/psye.v10i1.2024Links ]

Moreta-Herrera, R., Montes de Oca, C., Navarro Cuellar, L. F., & Villegas Villacrés, N. (2021). Validez factorial con estimación robusta de la Escala de Autoeficacia Percibida Específica de Situaciones Académicas (Eapesa) en universitarios ecuatorianos. Ciencias Psicológicas, 15(1), e-2153. http://doi.org/10.22235/cp.v15i1.2153Links ]

Moreta-Herrera, R., Vaca-Quintana, D., Quistgaard-Álvarez, A., Merlyn-Sacoto, M.-F., & Dominguez-Lara, S. (2022). Análisis psicométrico de la Escala de Cansancio Emocional en estudiantes universitarios ecuatorianos durante el brote de COVID-19. Ciencias Psicológicas, 16(1), e-2755. https://doi.org/10.22235/cp.v16i1.2755Links ]

Morgan, B., De Bruin, G. P. & De Bruin, K. (2014). Operationalizing burnout in the Maslach Burnout Inventory-Student Survey: personal efficacy versus personal inefficacy. South African Journal of Psychology, 44(2), 216-227. https://doi.org/10.1177/0081246314528834Links ]

Mueller, M. (2020). iarm: Item Analysis in Rasch Models. R package version 0.4.2. https://CRAN.R-project.org/package=iarmLinks ]

Muthén, L.K. & Muthén, B.O. (1998-2015). Mplus User’s guide (7th ed.). Los Angeles, Muthén & Muthén. [ Links ]

Navarro-Loli, J. S. & Dominguez-Lara, S. (2019). Propiedades psicométricas de la Escala de Autoeficacia Percibida Específica de Situaciones Académicas en adolescentes peruanos. Psychology, Society, & Education, 11(1), 53-68. https://doi.org/10.25115/psye.v10i1.1985 Links ]

Palenzuela, D. L. (1983). Construcción y validación de una escala de autoeficacia percibida específica de situaciones académicas. Análisis y Modificación de Conducta, 9(21), 185-219. [ Links ]

Pendergast, L. L., von der Embse, N., Kilgus, S. P., & Eklund, K. R. (2017). Measurement equivalence: A non-technical primer on categorical multi-group confirmatory factor analysis in school psychology. Journal of School Psychology, 60(1), 65-82. https://doi.org/10.1016/j.jsp.2016.11.002Links ]

Penfield, R. D. (2001). Assessing differential item functioning among multiple groups: A comparison of three Mantel-Haenszel procedures. Applied Measurement in Education, 14, 235-259. https://doi.org/10.1207/S15324818AME1403_3Links ]

Pérez, E. R. & Delgado, M. (2006). Inventario de Autoeficacia para el Estudio: desarrollo y validación inicial. Avaliação Psicológica, 5(2), 135-143. [ Links ]

Potthoff, S., Garnefski, N., Miklósi, M., Ubbiali, A., Domínguez-Sánchez, F. J., Martins, E. C., Witthöft, M., & Kraaij, V. (2016). Cognitive emotion regulation and psychopathology across cultures: A comparison between six European countries. Personality and Individual Differences, 98, 218-224. https://doi.org/10.1016/j.paid.2016.04.022Links ]

Rodríguez, M. & Ruiz, M. (2008). Atenuación de la asimetría y de la curtosis de las puntuaciones observadas mediante transformaciones de variables: Incidencia sobre la estructura factorial. Psicológica, 29(2), 205-227. [ Links ]

Rosario, P., Lourenço, A., Olímpia, M., Núñez, J., González-Pienda, J., & Valle, A. (2012). Autoeficacia y utilidad percibida como condiciones necesarias para el aprendizaje académico autorregulado. Anales de Psicología. 28(1), 37-44. [ Links ]

Roshangar, F., Azar, E. F., Sarbakhsh, P., & Azarmi, R. (2020). The effect of case-based learning with or without conceptual mapping method on critical thinking and academic self-efficacy of nursing students. Journal of Biochemical Technology, 11(1), 37-44. [ Links ]

Rutkowski, L. & Svetina, D. (2017). Measurement invariance in international surveys: Categorical indicators & fit measure performance. Applied Measurement in Education, 30(1), 39-51. https://doi.org/10.1080/ 08957347.2016.1243540Links ]

Sánchez-Rosas, J. & Esquivel, S. (2016). Calidad instruccional docente, valor de la tarea, autoeficacia y aburrimiento: Un modelo de atención en clase. Revista de Psicología (Santiago), 25(2), 1-20. https://doi.org/10.5354/0719-0581.2017.44966Links ]

Saris, W. E, Satorra, A., & van der Veld, W. M. (2009). Testing structural equation modeling or detection of misspecifications? Structural Equation Modeling, 16(4), 561-582. https://doi.org/10.1080/10705510903203433Links ]

Sarmento, C. (2014). Interculturalism, multiculturalism, and intercultural studies: questioning definitions and repositioning strategies. Intercultural Pragmatics, 11(4), 603-618. https://doi.org/10.1515/ip-2014-0026Links ]

Savalei, V. (2012). The relationship between root mean square error of approximation and model misspecification in confirmatory factor analysis. Educational and Psychological Measurement, 72(6), 910-932. https://doi.org/10.1177/0013164412452564Links ]

Schaufeli, W. B. & Salanova, M. (2007). Efficacy or inefficacy, that’s the question: burnout and work engagement and their relationship with efficacy beliefs. Anxiety, Stress, and Coping, 20(2), 177-196. https://doi.org/10.1080/10615800701217878Links ]

Schaufeli, W. B., Salanova, M., Gonzàlez-Romà, V., & Bakker, A. B. (2002). The measurement of engagement and burnout: A two simple confirmative analytic approach. Journal of Happiness Studies, 3, 71-92. https://doi.org/10.1023/A:1015630930326Links ]

Schnohr, C. W., Kreiner, S., Due, E. P., Currie, C., Boyce, W., & Diderichsen, F. (2008). Differential item functioning of a Family Affluence Scale: validation study on data from HBSC 2001/02. Social Indicator Research, 89(1), 79-95. https://doi.org/10.1007/s11205-007-9221-4Links ]

Schunk, D. H. (2012). Social cognitive theory. In K. R. Harris, S. Graham & T. Urdan (Eds.), APA educational psychology handbook, Vol. 1: Theories, constructs, and critical issues (pp. 101-123). American Psychological Association [ Links ]

Schunk, D. H., & DiBenedetto, M. K. (2016). Self-efficacy theory in education. In K. R. Wentzel & D. B. Miele (Eds.), Handbook of Motivation at School (pp. 34-54). Routledge. [ Links ]

Sohrabi, A., Mehdad, A., Sadeghi, A., & Aghaei, A. (2022). Investigating the impact of Lent and Brown social cognitive therapy on the components of academic self-efficacy perception of students at Isfahan University of Medical Sciences. Iranian Journal of Medical Education, 22, 305-313. [ Links ]

Thomas, R., Wheeler, L. A., Delgado, M. Y., Nair, R. L., & Coulter, K. M. (2022). Latinx adolescents’ academic self-efficacy: Explaining longitudinal links between ethnic-racial identity and educational adjustment. Cultural Diversity and Ethnic Minority Psychology, 28(1), 29-38. https://doi.org/10.1037/cdp0000488Links ]

Tumino, M. C., Quinde, J. M., Casali, L. N., & Valega, M. R. (2020). Autoeficacia en estudiantes universitarios: El rol del empoderamiento académico. IJERI: International Journal of Educational Research and Innovation, 14, 211-224. https://doi.org/10.46661/ijeri.4618Links ]

Valencia-Vallejo, N., López-Vargas, O., & Sanabria-Rodríguez, L. (2019a). Effect of a metacognitive scaffolding on self-efficacy, metacognition, and achievement in e-learning environments. Knowledge Management & E-Learning, 11(1), 1-19. https://doi.org/10.34105/j.kmel.2019.11.001Links ]

Valencia-Vallejo, N., López-Vargas, O., & Sanabria-Rodríguez, L. (2019b). Effect of motivational scaffolding on e-learning environments: self-efficacy, learning achievement, and cognitive style. Journal of Educators Online, 15(1), 1-14. [ Links ]

van de Vijver, F. J. (2009). Types of comparative studies in cross-cultural psychology. Online Readings in Psychology and Culture, 2(2), 1-12. http://doi.org/10.9707/2307-0919.1017Links ]

Ventura, A. C., Cattoni, M. S., & Borgobello, A. (2017). Aprendizaje autorregulado en el nivel universitario: Un estudio situado con estudiantes de psicopedagogía de diferentes ciclos académicos. Revista Electrónica Educare, 21(2), 315-334. https://doi.org/10.15359/ree.21-2.15Links ]

West, S. G., Taylor, A. B., & Wu, W. (2012). Model fit and model selection in structural equation modeling. In R. H. Hoyle (Ed.), Handbook of Structural Equation Modeling (pp. 209-231). Guilford. [ Links ]

Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013). Sample size requirements for structural equation models: An evaluation of power, bias, and solution propriety. Educational and Psychological Measurement, 73(6), 913-934. https://doi.org/10.1177/0013164413495237Links ]

World Medical Association. (1964). Declaration of Helsinki. Helsinki. http://www.conamed.gob.mx/prof_salud/pdf/helsinki.pdfLinks ]

Yavuz, G. & Dogan, N. (2014). Maslach Burnout Inventory-Student Survey (MBI-SS): A validity study. Procedia-Social and Behavioral Sciences, 116, 2453-2457. https://doi.org/10.1016/j.sbspro.2014.01.590 Links ]

Yildirim, O. & Aybek, E.C. (2019). Testing measurement invariance of academic self-efficacy scale for Singapore, Spain and Turkey. Journal of Education in Science, Environment and Health (JESEH), 5(2), 156-163. https://doi.org/10.21891/jeseh.585605Links ]

Yu, J. H., Chae, S. J., & Chang, K. H. (2016). The relationship among self-efficacy, perfectionism and academic burnout in medical school students. Korean Journal of Medical Education, 28, 49-55. https://doi.org/10.3946/kjme.2016.9Links ]

Zamora-Araya, J., Cruz-Quesada, J., & Amador-Montes, M. (2020). Autoeficacia y su relación con el rendimiento académico en estudiantes de enseñanza de la matemática. Revista Innovaciones Educativas, 22(32), 137-150. https://doi.org/10.22458/ie.v22i32.2818Links ]

Zander, L., Brouwer, J., Jansen, E., Crayen, C., & Hannover, B. (2018). Academic self-efficacy, growth mindsets, and university students' integration in academic and social support networks. Learning and Individual Differences, 62, 98-107. https://doi.org/10.1016/j. lindif.2018.01.012Links ]

Zhang, Y., Gan, Y., & Cham, H. (2007). Perfectionism, academic burnout and engagement among Chinese college students: a structural equation modeling analysis. Personality and Individual Differences, 43(6), 1529-1540. https://doi.org/10.1016/j.paid.2007.04.010Links ]

Zimmerman, D. W. & Zumbo, B. D. (2015). Resolving the issue of how reliability is related to statistical power: adhering to mathematical definitions. Journal of Modern Applied Statistical Methods, 14(2), 9-26. https://doi.org/10.22237/jmasm/1446350640Links ]

How to cite: Dominguez-Lara, S., Alarcón-Parco, D., Campos-Uscanga, Y., Tamayo-Agudelo, W., Merino-Soto, C., Tumino, M. C., Quinde, J. M., De Moura, G. B., & Baptista, M. G. A. (2023). Psychometric properties and measurement invariance of an academic self-efficacy scale in college students from five Latin American countries. Ciencias Psicológicas, 17(1), e-3051. https://doi.org/10.22235/cp.v17i1.3051

Authors’ participation: a) Conception and design of the work; b) Data acquisition; c) Analysis and interpretation of data; d) Writing of the manuscript; e) Critical review of the manuscript. S. D-L. has contributed in a, b, c, d; D. A-P. in a, b, d; Y. C-U. in a, b, d, e; W. T-A. in b, d, e; C. M-S. in c, d, e; M. C. T. in b, d, e; J. M. Q. in b, d, e; G. B. de M. in b, d, e; M. G. A. B. in b, d, e.

Managing scientific editor: Dra. Cecilia Cracco

Received: September 16, 2022; Accepted: January 21, 2023

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License