Skip to main content Accessibility help
×
Home
Hostname: page-component-5cfd469876-kqxn7 Total loading time: 0.2 Render date: 2021-06-25T14:25:39.206Z Has data issue: true Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "metricsAbstractViews": false, "figures": true, "newCiteModal": false, "newCitedByModal": true, "newEcommerce": true }

Design and Evaluation Process of a Personal and Motive-Based Competencies Questionnaire in Spanish-Speaking Contexts

Published online by Cambridge University Press:  22 March 2016

Joan Batista-Foguet
Affiliation:
Universitat Ramon Llull (Spain)
Alaide Sipahi-Dantas
Affiliation:
Universitat Ramon Llull (Spain)
Laura Guillén
Affiliation:
European School of Management and Technology (Germany)
Rosario Martínez Arias
Affiliation:
Universidad Complutense (Spain)
Ricard Serlavós
Affiliation:
Universitat Ramon Llull (Spain)
Corresponding
E-mail address:

Abstract

Most questionnaires used for managerial purposes have been developed in Anglo-Saxon countries and then adapted for other cultures. However, this process is controversial. This paper fills the gap for more culturally sensitive assessment instruments in the specific field of human resources while also addressing the methodological issues that scientists and practitioners face in the development of questionnaires. First, we present the development process of a Personal and Motive-based competencies questionnaire targeted to Spanish-speaking countries. Second, we address the validation process by guiding the reader through testing the questionnaire construct validity. We performed two studies: a first study with 274 experts and practitioners of competency development and a definitive study with 482 members of the general public. Our results support a model of nineteen competencies grouped into four higher-order factors. To assure valid construct comparisons we have tested the factorial invariance of gender and work experience. Subsequent analysis have found that women self-rate themselves significantly higher than men on only two of the nineteen competencies, empathy (p < .001) and service orientation (p < .05). The effect of work experience was significant in twelve competencies (p < .001), in which less experienced workers self-rate higher than experienced workers. Finally, we derive theoretical and practical implications.

Type
Research Article
Copyright
Copyright © Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2016 

Access options

Get access to the full version of this content by using one of the access options below.

References

Afthanorhan, W. M. A. B. W., & Ahmad, S. (2013). Modeling the multimediator on motivation among youth in higher education institution towards volunteerism program. Mathematical Theory and Modeling, 3, 6470.Google Scholar
Armstrong, M., & Taylor, S. (2014). Armstrong’s handbook of human resource management practice . Philadelphia, PA: Kogan Page Publishers.Google Scholar
Bagozzi, R. P. (1984). A prospectus for theory construction in marketing. Journal of Marketing, 48, 1129. http://dx.doi.org/10.2307/1251307 CrossRefGoogle Scholar
Bar-On, R. (2006). The Bar-On model of emotional-social intelligence. Psicothema, 18, 124131.Google ScholarPubMed
Bartram, D. (2005). The Great Eight Competencies: A criterion-centric approach to validation. Journal of Applied Psychology, 90, 11851203. http://dx.doi.org/10.1037/0021-9010.90.6.1185 CrossRefGoogle ScholarPubMed
Batista-Foguet, J. M., Boyatzis, R., Guillén, L., & Serlavos, R. (2008). Assessing emotional intelligence competencies in two global contexts. In Emmerling, R. (Ed.), Emotional intelligence: Theoretical and cultural perspectives. (pp. 89114), San Francisco, CA: Nova Science Publishers.Google Scholar
Batista-Foguet, J. M., Saris, W., Boyatzis, R., Guillén, L., & Serlavòs, R. (2009). Effect of response scale on assessment of emotional intelligence competencies. Personality and Individual Differences, 46, 575580. http://dx.doi.org/10.1016/j.paid.2008.12.011 CrossRefGoogle Scholar
Bisbe, J., Batista-Foguet, J. M., & Chenhall, R. (2007). Defining management accounting constructs: The risks of theoretical misspecification. Accounting, Organizations and Society, 32, 789820.CrossRefGoogle Scholar
Cheung, F. M. (2004). Use of Western- and indigenously-developed personality tests in Asia. Applied Psychology: An International Review, 53, 173191. http://dx.doi.org/10.1111/j.1464-0597.2004.00167.x CrossRefGoogle Scholar
Costa, P. T., & McCrae, R. R. (1992). Four ways five factors are basic. Personality and Individual differences, 13, 653665. http://dx.doi.org/10.1016/0191-8869(92)90236-I CrossRefGoogle Scholar
Cuesta, M., & Fonseca-Pedrero, E. (2014). Estimating the reliability coefficient of tests in presence of missing values. Psicothema, 26, 516524.Google Scholar
Du Gay, P., Salaman, G., & Rees, B. (1996). The conduct of management and the management of conduct: Contemporary managerial discourse and the constitution of the “Competent” manager. Journal of Management Studies, 33, 263282.CrossRefGoogle Scholar
Dulewicz, V., Higgs, M., & Slaski, M. (2003). Measuring emotional intelligence: Construct and criterion-related validity. Journal of Managerial Psychology, 18, 405420. http://dx.doi.org/10.1108/02683940310484017 CrossRefGoogle Scholar
Emmerling, R. J., & Boyatzis, R. E. (2012). Emotional and social intelligence competencies: Cross cultural implications. Cross Cultural Management: An International Journal, 19(1), 418. http://dx.doi.org/10.1108/13527601211195592 CrossRefGoogle Scholar
Extremera, N., Fernandez-Berrocal, P., & Salovey, P. (2006). Spanish version of the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT). 2.0: Reliabilities, age and gender differences. Psicothema, 18, 4248.Google ScholarPubMed
Fernández-Alonso, R., Suárez-Alvarez, J., & Muñiz, J. (2012). Imputación de datos perdidos en las evaluaciones diagnósticas educativas [Imputation of missing data on educational diagnostic assessments]. Psicothema, 24, 167175.Google Scholar
Gouveia, V., Milfont, T. L., Gouveia, R. S. V., Neto, J. R. N., & Galvão, L. (2012). Brazilian-Portuguese empathy quotient: Evidences of its construct validity and reliability. The Spanish Journal of Psychology, 15, 777782. http://dx.doi.org/10.5209/rev_SJOP.2012.v15.n2.38889 CrossRefGoogle ScholarPubMed
Guillén, L., & Saris, W. (2013). Competencies, personality traits, and job outcomes of middle managers: A motive-based approach. Human Performance, 26, 127.CrossRefGoogle Scholar
Heise, D. R., & Bohrnstedt, G. W. (1970). Validity, invalidity and reliability. In Borgatta, E. F. & Bohrnstedt, G. W (Eds.), Sociological Methodology, (pp.104129). San Francisco, CA: Jossey-Bass. http://dx.doi.org/10.2307/270785 Google Scholar
Hossiep, R., & Parchen, M. (2006). BIP. Bochumer Inventar zur berufsbezogenen Persönlichkeitsbeschreibung [BIP, Bochum Inventory of Personality and Skills]. Göttingen, Germany: Hogrefe. Adaptación española: Arribas, D. & Pereña, J. (2006). BIP, Inventario Bochum de Personalidad y Competencias. [BIP, Bochum Inventory of Personality and Skills]. Madrid, Spain: TEA Ediciones.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 155. http://dx.doi.org/10.1080/10705519909540118 CrossRefGoogle Scholar
Jarvis, C. B., Mackenzie, S. B., & Podsakoff, P. M. (2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30, 199218. http://dx.doi.org/10.1086/376806 CrossRefGoogle Scholar
Libbrecht, N., De Beuckelaer, A., Lievens, F., & Rockstuhl, T. (2014). Measurement invariance of the Wong and Law Emotional Intelligence Scale scores: Does the measurement structure hold across far eastern and European countries? Applied Psychology, 63, 223237. http://dx.doi.org/10.1111/j.1464-0597.2012.00513.x CrossRefGoogle Scholar
McClelland, D. C., & Boyatzis, R. E. (1982). Leadership motive pattern and long term success in management. Journal of Applied Psychology, 67, 737743. http://dx.doi.org/10.1037//0021-9010.67.6.737 CrossRefGoogle Scholar
McClelland, D., Atkinson, J., Clark, R., & Lowell, E. (1953). The achievement motive. New York, NY: Appleton-Century-Crofts. http://dx.doi.org/10.1037/11144-000 CrossRefGoogle Scholar
McEnrue, M. P., & Groves, K. (2006). Choosing among tests of emotional intelligence: What is the evidence? Human Resource Development Quarterly, 17, 942. http://dx.doi.org/10.1002/hrdq.1159 CrossRefGoogle Scholar
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525543. http://dx.doi.org/10.1007/BF02294825 CrossRefGoogle Scholar
Mestre, M. V., Samper, P., Frías, M. D., & Tur, A. M. (2009). Are women more empathetic than men? A longitudinal study in adolescence. The Spanish Journal of Psychology, 12, 7683. http://dx.doi.org/10.1017/S1138741600001499 CrossRefGoogle Scholar
Nunnally, J. C. (1978). Psychometric theory (2nd Ed.). New York, NY: McGraw Hill.Google Scholar
Paulhus, D. L. (1991). Measurement and control of response bias. In Robinson, J. P., Shaver, P. R., & Wrightsman, L. S. (Eds.), Measures of personality and social psychological attitudes (pp. 1759). San Diego, CA: Academic Press. http://dx.doi.org/10.1016/B978-0-12-590241-0.50006-X CrossRefGoogle Scholar
Petrides, K. V., & Furnham, A. (2001). Trait emotional intelligence: Psychometric investigation with reference to established trait taxonomies. European Journal of Personality, 15, 425488. http://dx.doi.org/10.1002/per.416 CrossRefGoogle Scholar
Saris, W. E., Satorra, A., & van der Veld, W. M. (2009). Testing structural equation models, or detection of misspecifications? Structural Equation Modeling: A Multidisciplinary Journal, 16, 561582. http://dx.doi.org/10.1080/10705510903203433 CrossRefGoogle Scholar
Scullen, S. E., Mount, M. K., & Judge, T. A. (2003). Evidence of construct validity of developmental ratings of managerial performance. Journal of Applied Psychology, 88, 5066. http://dx.doi.org/10.1037/0021-9010.88.1.50 CrossRefGoogle ScholarPubMed
Steenkamp, J-B. E. M., de Jong, M. G., & Baumgartner, H. (2010). Socially desirable response tendencies in survey research. Journal of Marketing Research, 47, 199214. http://dx.doi.org/10.1509/jmkr.47.2.199 CrossRefGoogle Scholar
Taylor, S. N., & Hood, J. N. (2011). It may not be what you think: Gender differences in predicting emotional and social competence. Human Relations, 64, 627652. http://dx.doi.org/10.1177/0018726710387950 CrossRefGoogle ScholarPubMed
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 470. http://dx.doi.org/10.1177/109442810031002 CrossRefGoogle Scholar

Send article to Kindle

To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Design and Evaluation Process of a Personal and Motive-Based Competencies Questionnaire in Spanish-Speaking Contexts
Available formats
×

Send article to Dropbox

To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

Design and Evaluation Process of a Personal and Motive-Based Competencies Questionnaire in Spanish-Speaking Contexts
Available formats
×

Send article to Google Drive

To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

Design and Evaluation Process of a Personal and Motive-Based Competencies Questionnaire in Spanish-Speaking Contexts
Available formats
×
×

Reply to: Submit a response

Please enter your response.

Your details

Please enter a valid email address.

Conflicting interests

Do you have any conflicting interests? *