Hostname: page-component-76fb5796d-wq484 Total loading time: 0 Render date: 2024-04-26T20:14:17.975Z Has data issue: false hasContentIssue false
  • English
  • Français

Cross-Cultural Invariance of Emotional Skills and Competence Questionnaire between Portugal and Croatia

Published online by Cambridge University Press:  25 May 2016

Ana Costa ,
Luísa Faria  and
Vladimir Takšić
Ana Costa
Affiliation:
Universidade do Porto (Portugal)
Luísa Faria*
Affiliation:
Universidade do Porto (Portugal)
Vladimir Takšić
Affiliation:
Sveučilište u Rijeci (Croatia)
*
*Correspondence concerning this article should be addressed to Luísa Faria. Faculty of Psychology and Educational Sciences. Universidade do Porto. Rua Alfredo Allen. 4200–135. Porto (Portugal). Phone: +351–226079700. E-mail: lfaria@fpce.up.pt
Get access Rights & Permissions [Opens in a new window]

Abstract

Emotional intelligence (EI) and its measures have been widespread across several countries and cultures and the need for valid and robust measures that could expand research on international settings is on the current agenda. This study aimed to assess the measurement invariance of a widely used self-report EI measure, Emotional Skills and Competence Questionnaire (ESCQ), in two cultural contexts (Portugal vs. Croatia). The ESCQ, a 42-item self-report EI scale which comprises three dimensions – Perceive and Understand Emotion, Express and Label Emotion and Manage and Regulate Emotion - was administered to 1,188 Portuguese and Croatian secondary students. The results showed that the ESCQ had satisfactory reliability and the three-factor structure was replicated on both country samples. Configural (χ2 = 308.71, df = 220, p < .01; RMSEA = .030, CFI = .956, TLI = .948) and partial metric (Δχ2 = 9.102, Δdf = 10, p = .522; ΔCFI = −.01, ΔRMSEA = .002) and scalar (Δχ2 = 15.290, Δdf = 21, p = .083; ΔCFI = .001, ΔRMSEA = .006) invariances were supported across groups. This EI measure invariance cross-cultural study highlighted cultural particularities related to emotional competence in Portugal and Croatia contexts and contributed to bring awareness to the validity of cross-cultural studies in the emotional abilities field.

Keywords

competenceemotional intelligenceinvarianceskills
Type
Research Article
Information
The Spanish Journal of Psychology , Volume 19 , 2016 , E31
Copyright
Copyright © Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2016 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Batista-Foguet, J. M., Saris, W., Boyatzis, R., Guillén, L., & Serlavós, R. (2009). Effect of response scale on assessment of emotional intelligence competencies. Personality and Individual Differences, 46, 575–580. http://dx.doi.org/10.1016/j.paid.2008.12.011 Google Scholar
Bollen, K. A. (1989). Structural equations with latent variables. New York, NY: John Wiley & Sons, Inc.Google Scholar
Bollen, K. A., & Barb, K. H. (1981). Pearson’s r and coarsely categorized measures. American Sociological Review, 46, 232–239. http://dx.doi.org/10.2307/2094981 CrossRefGoogle Scholar
Boyatzis, R., Goleman, D., & Rhee, K. (2000). Clustering competence in emotional intelligence: Insights from the Emotional Competence Inventory (ECI). In Bar-On, R. & Parker, J. D. A. (Eds.), Handbook of emotional intelligence (pp. 343–362). San Francisco, CA: Jossey-Bass.Google Scholar
Brown, G. T. L. (2004). Measuring attitudes with positively packed self-report ratings: Comparison of agreement and frequency scales. Psychological Reports, 94, 1015–1024. http://dx.doi.org/10.2466/pr0.94.3.1015-1024 Google Scholar
Brown, J. D. (2001). Statistics corner. Questions and answers about language testing statistics: Can we use the Spearman-Brown prophecy formula to defend low reliability? Shiken: JALT Testing & Evaluation SIG Newsletter , 4, 7–9.Google Scholar
Byrne, B. M. (2004). Testing for multigroup invariance using AMOS graphics: A road less traveled. Structural Equation Modeling, 11, 272–300. http://dx.doi.org/10.1207/s15328007sem1102_8 CrossRefGoogle Scholar
Byrne, B. M., & Campbell, T. L. (1999). Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface. Journal of Cross-Cultural Psychology, 30, 555–574. http://dx.doi.org/10.1177/0022022199030005001 CrossRefGoogle Scholar
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. http://dx.doi.org/10.1080/10705510701301834 Google Scholar
Ciarrochi, J., Chan, A. Y. C., Caputi, P., & Roberts, R. (2001). Measuring emotional intelligence. In Ciarrochi, C., Forgas, J. P., & Mayer, J. D. (Eds.), Emotional intelligence in everyday life: A scientific inquiry (pp. 25–45). Philadelphia, PA: Psychology Press.Google Scholar
Costa, A., & Faria, L. (2014). Avaliação da inteligência emocional: Que diálogo entre medidas de desempenho e de autorrelato? [Assessment in emotional intelligence: What dialog between ability-based and self-report measures?]. Psicologia: Teoria e Pesquisa, 30, 339–346.Google Scholar
Costa, A., & Faria, L. (2015). The impact of emotional intelligence on academic achievement: A longitudinal study in Portuguese secondary school. Learning and Individual Differences, 37, 38–47. http://dx.doi.org/10.1016/j.lindif.2014.11.011 Google Scholar
Dolan, C. V. (1994). Factor analysis of variables with 2, 3, 5, and 7 response categories: A comparison of categorical variable estimators using simulated data. British Journal of Mathematical and Statistical Psychology, 47, 309–326. http://dx.doi.org/10.1111/j.2044-8317.1994.tb01039.x CrossRefGoogle Scholar
Duffy, M. E. (2006). Translating instruments into other languages. Clinical Nurse Specialist, 20, 225–226. http://dx.doi.org/10.1097/00002800-200609000-00006 Google Scholar
Ekerman, G., Saklofske, D. H., Austin, E., & Stough, C. (2011). Measurement invariance and differential item functioning of the Bar-On EQ-i: S measure over Canadian, Scottish, South African and Australian samples. Personality and Individual Differences, 50, 286–290. http://dx.doi.org/10.1016/j.paid.2010.10.004 Google Scholar
Elosua, P., & Hermosilla, D. (2013). Does body dissatisfaction have the same meaning for males and females? A measurement invariance study. Revue Européenne de Psychologie Appliquée/European Review of Applied Psychology, 63, 315–321. http://dx.doi.org/10.1016/j.erap.2013.06.002 Google Scholar
Emmerling, R. J., & Boyatzis, R. E. (2012). Emotional and social intelligence competencies: Cross-cultural implications. Cross-Cultural Management: An International Journal, 19(1), 4–18. http://dx.doi.org/10.1108/13527601211195592 CrossRefGoogle Scholar
Faria, L., Lima Santos, N., Takšić, V., Räty, H., Molander, B., Holmström, S., … Toyota, H. (2006). Cross-cultural validation of the Emotional Skills and Competence Questionnaire (ESCQ). Psicologia, 2, 95–127.Google Scholar
Fernandez, I., Carrera, P., Sanchez, F., Paez, D., & Candia, L. (2000). Differences between cultures in emotional verbal and non-verbal reactions. Psicothema, 12, 83–92.Google Scholar
Ghorbani, N., Davison, H. K., Bing, M. N., Watson, P. J., & Mack, D. A. (2002). Self-reported emotional intelligence. Construct similarity and functional dissimilarity of higher-order processing in Iran and the United States. International Journal of Psychology, 37, 297–308. http://dx.doi.org/10.1080/00207590244000098 CrossRefGoogle Scholar
González-Romá, V., Hernández, A., & Gómez-Benito, J. (2006). Power and Type I error of the mean and covariance structure analysis model for detecting differential item functioning in graded response items. Multivariate Behavioral Research, 41, 29–53. http://dx.doi.org/10.1207/s15327906mbr4101_3 Google Scholar
Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: Implications for affect, relationships, and wellbeing. Journal of Personality and Social Psychology, 85, 348–362. http://dx.doi.org/10.1037/0022-3514.85.2.348 CrossRefGoogle Scholar
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structure Equation Modeling, 6, 1–55. http://dx.doi.org/10.1080/10705519909540118 CrossRefGoogle Scholar
Karim, J., & Weisz, R. (2010). Cross-cultural research on the reliability and validity of the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT). Cross-Cultural Research, 44, 374–404. http://dx.doi.org/10.1177/1069397110377603 Google Scholar
Kline, R. B. (2010). Principles and practice of structural equation modeling (3rd Ed.). New York, NY: Guilford.Google Scholar
Li, T., Saklofske, D. H., Bowden, S. C., Yan, G., & Fung, T. S. (2012). The measurement invariance of the Wong and Law Emotional Intelligence Scale (WLEIS) across three Chinese university student groups from Canada and China. Journal of Psychoeducational Assessment, 30, 439–452. http://dx.doi.org/10.1177/0734282912449449 Google Scholar
Little, T. D. (1997). Mean and covariance structures (MACS) analysis of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53–76. http://dx.doi.org/10.1207/s15327906mbr3201_3 CrossRefGoogle Scholar
Matsumoto, D. (1989). Cultural influences on the perception of emotion. Journal of Cross-Cultural Psychology, 20, 92–105. http://dx.doi.org/10.1177/0022022189201006 Google Scholar
Matsumoto, D. (1993). Ethnic differences in affect intensity, emotion judgments, display rule attitudes, and self-reported emotional expression in an American sample. Motivation and Emotion, 17, 107–123. http://dx.doi.org/10.1007/BF00995188 CrossRefGoogle Scholar
Mayer, J. D., Caruso, D. R., & Salovey, P. (1999). Emotional intelligence meets traditional standards for an intelligence. Intelligence, 27, 267–298. http://dx.doi.org/10.1016/S0160-2896(99)00016-1 Google Scholar
Mayer, J. D., & Salovey, P. (1997). What is emotional intelligence? In Salovey, P. & Sluyter, D. J. (Eds.), Emotional development and emotional intelligence. Educational implications. New York, NY: Basic Books.Google Scholar
Molander, B., Holmström, S., & Takšić, V. (2009). Cross-cultural and sex differences in the Emotional Skills and Competence Questionnaire scales: Challenges of differential item functioning analyses. Horizons of Psychology, 18, 35–53.Google Scholar
Molander, B., Holmström, S., & Takšić, V. (2011). South and north: DIF analyses of university-student responses to the Emotional Skills and Competence Questionnaire. Psychological Topics, 20, 425–447.Google Scholar
Mullen, M. R. (1995). Diagnosing measurement equivalence in cross-national research. Journal of International Business Studies, 26, 573–596. http://dx.doi.org/10.1057/palgrave.jibs.8490187 Google Scholar
Muthén, B., & Kaplan, D. (1985). A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38, 171–189.Google Scholar
Parker, J. D. A., Saklofske, D. H., Shaughnessy, P. A., Huang, S. H. S., Wood, L. M., & Eastabrook, J. M. (2005). Generalizability of the emotional intelligence construct: A cross-cultural study of North American aboriginal youth. Personality and Individual Differences, 39, 215–227. http://dx.doi.org/10.1016/j.paid.2005.01.008 Google Scholar
Petrides, K. V., & Furnham, A. (2003). Trait emotional intelligence: Behavioural validation in two studies of emotion recognition and reactivity to mood induction. European Journal of Personality, 17, 39–57. http://dx.doi.org/10.1002/per.466 Google Scholar
Rivers, S. E., Brackett, M. A., & Salovey, P. (2008). Measuring emotional intelligence as a mental ability in adults and children. In Boyle, G. J., Matthews, G., & Saklofske, D. H. (Eds.), The Sage handbook of personality theory and assessment: Vol. 2, Personality measurement and testing (pp. 440–460). Los Angeles, CA: Sage.Google Scholar
Roberts, R. D., Zeidner, M., & Matthews, G. (2001). Does emotional intelligence meet traditional standards for an intelligence? Some new data and conclusions. Emotion, 1, 196–231. http://dx.doi.org/10.1037/1528-3542.1.3.196 Google Scholar
Shulruf, B., Alesi, M, Ciochină, L., Faria, L., Hattie, J., Hong, F., … Watkins, D. (2011). Measuring collectivism and individualism in the third millennium. Social Behavior and Personality, 39, 173–188. http://dx.doi.org/10.2224/sbp.2011.39.2.173 Google Scholar
Siu, A. F. Y. (2009). Trait emotional intelligence and its relationships with problem behavior in Hong Kong adolescents. Personality and Individual Differences, 47, 553–557. http://dx.doi.org/10.1016/j.paid.2009.05.004 Google Scholar
Stocker, J., & Faria, L. (2012). Competência percebida no ensino secundário: Do conceito à avaliação através de um questionário compósito. [Perceived competence in secondary school: From conceptualization to assessment through a composite questionnaire]. Psicologia, 21, 113–140.Google Scholar
Takšić, V. (2001). Upitnici emocionalne kompetentnosti (inteligencije). [Emotional competence (intelligence) questionnaires]. In Lackovic-Grgin, K. & Penezic, Z. (Eds.), Zbirka psihologijskih mjernih instrumenata [The collection of psychological instruments]. Zadar, Croatia: Faculty of Philosophy.Google Scholar
Takšić, V., Mohorić, T., & Duran, M. (2009). Emotional Skills and Competence Questionnaire (ESCQ) as a self-report measure of emotional intelligence. Horizons of Psychology, 18, 7–21.Google Scholar
van de Vijver, F., & Tanzer, N. K. (2004). Bias and equivalence in cross-cultural assessment: An overview. Revue Européenne de Psychologie Appliquée 54, 119–135. http://dx.doi.org/10.1016/j.erap.2003.12.004 CrossRefGoogle Scholar
Zeidner, M., Roberts, R. D., & Matthews, G. (2002). Can emotional intelligence be schooled? A critical review. Educational Psychologist, 37, 215–231. http://dx.doi.org/10.1207/S15326985EP3704_2 CrossRefGoogle Scholar