Why Japanese workers show low work engagement: An item response theory analysis of the Utrecht Work Engagement scale
© Shimazu et al; licensee BioMed Central Ltd. 2010
Received: 13 October 2010
Accepted: 5 November 2010
Published: 5 November 2010
With the globalization of occupational health psychology, more and more researchers are interested in applying employee well-being like work engagement (i.e., a positive, fulfilling, work-related state of mind that is characterized by vigor, dedication, and absorption) to diverse populations. Accurate measurement contributes to our further understanding and to the generalizability of the concept of work engagement across different cultures. The present study investigated the measurement accuracy of the Japanese and the original Dutch versions of the Utrecht Work Engagement Scale (9-item version, UWES-9) and the comparability of this scale between both countries. Item Response Theory (IRT) was applied to the data from Japan (N = 2,339) and the Netherlands (N = 13,406). Reliability of the scale was evaluated at various levels of the latent trait (i.e., work engagement) based the test information function (TIF) and the standard error of measurement (SEM). The Japanese version had difficulty in differentiating respondents with extremely low work engagement, whereas the original Dutch version had difficulty in differentiating respondents with high work engagement. The measurement accuracy of both versions was not similar. Suppression of positive affect among Japanese people and self-enhancement (the general sensitivity to positive self-relevant information) among Dutch people may have caused decreased measurement accuracy. Hence, we should be cautious when interpreting low engagement scores among Japanese as well as high engagement scores among western employees.
In accordance with the expanding global economy, researchers in occupational health psychology have begun to conduct cross-cultural studies. This article focuses on work engagement from a cultural perspective and addresses basic measurement issues in cross-cultural research on work engagement.
Work engagement: an emerging concept
Psychology has recently been criticized as primarily dedicated to addressing mental illness rather than mental "wellness". Since the beginning of this century, however, increased attention is paid to what has been coined positive psychology: the scientific study of human strengths and optimal functioning . This advocated positive turn is also relevant for occupational health psychology. It has been proposed that in addition to focus on employees' poor functioning as a result of stress and burnout, occupational health psychology should look at optimal functioning and the role of a positive mental state therein, such as work engagement .
Work engagement is a psychological state assumed to be negatively related to burnout. While burnout is usually defined as a syndrome of exhaustion, cynicism, and reduced professional efficacy , engagement is defined as a positive, fulfilling, work-related state of mind that is characterized by vigor, dedication, and absorption . That means that engaged employees have a sense of energetic and effective connection with their work activities. Vigor is characterized by high levels of energy and mental resilience while working. Dedication refers to being strongly involved in one's work and experiencing a sense of significance and pride. Finally, absorption is characterized by being fully concentrated and happily engrossed in one's work.
Work engagement is found to be positively associated with job resources; that is, to those aspects of the job that have the capacity to reduce job demands, are functional in achieving work goals, and may stimulate personal growth, learning, and development . For instance, work engagement tends to be positively related to social support from co-workers and from one's superior, as well as to performance feedback, coaching, job control, opportunities for growth and development, task variety, and training facilities [5–14]. Hence, the more job resources are available, the more likely it is that employees feel engaged.
Work engagement has also been found to be positively related to personal resources, such as self-efficacy , which according to Social Cognitive Theory (SCT) is the "belief in one's capabilities to organize and execute the courses of action required to produce given attainment" . Quite interestingly, it seems that self-efficacy may precede as well as follow engagement [13, 17, 18]. This may point to the existence of an upward spiral: self-efficacy fuels engagement, which, in turn, increases efficacy beliefs, and so on . This is in line with SCT , which holds that there are reciprocal relationships between self-efficacy and positive affective-cognitive outcomes such as work engagement. Moroever, this reciprocal relationship is also compatible with the notion of so-called "gain spirals" as described by the Conservation of Resources (COR) theory .
The possible consequences of work engagement pertain to positive job-related attitudes, employee health, extra-role behaviors, and performance. Compared to those who do not feel engaged, those who feel engaged seem to be more satisfied with their jobs, feel more committed to the organization, and do not intend to leave the organization [5, 22, 23]. Also, engaged workers seem to enjoy good mental [23–27] and psychosomatic health [22, 26, 27]. Furthermore, they exhibit personal initiative, proactive behavior, and learning motivation [28, 29], and engagement seems to play a mediating role between the availability of job resources and these positive organizational behaviors . Taken together, the results concerning positive organizational behavior suggest that engaged workers seem to be able and willing to "go to the extra mile."
Most importantly for organizations, those who are engaged seem to perform better. For instance, Salanova et al.  showed that the levels of work engagement of contact employees from hotels and restaurants were related to service quality, as perceived by customers. More specifically, the more engaged the employees were, the better the service climate was, and the more loyal the customers were. In addition, a study in a fast-food restaurant found that the financial return of a particular shift was positively related to the level of work engagement of the employees who worked in that shift . Finally, Harter et al.  showed that levels of employee engagement were positively related to business-unit performance (i.e., customer satisfaction and loyalty, profitability, productivity, turnover, and safety) across almost 8,000 business units of thirty-six companies.
Measurement of work engagement
Utrecht Work Engagement Scale
Work engagement is operationalized with the Utrecht Work Engagement Scale (UWES) , a self report instrument that includes the above three dimensions. The original UWES (UWES-17) includes 17 items : vigor (6 items), dedication (5 items), and absorption (6 items). The UWES-17 has encouraging psychometric features. For instance, confirmatory factor analyses showed that the hypothesized three-factor structure of the UWES is superior to the one-factor model [4, 5], although the dimensions are highly related. In addition to the UWES-17, a shortened version of nine items (the UWES-9) - with three scales of three items each - shows similar encouraging psychometric features . Hardly any systematic differences in work engagement were observed between men and women, or across age groups. In some occupational groups, engagement levels were found to be higher than in other groups (e.g., executives versus blue-collar workers).
International database on UWES
The UWES is now used especially in western countries. Currently, twenty-one language versions are available (i.e., Afrikaans, Brazilian, Chinese, Czech, Dutch, English, Estonian, Finnish, French, Italian, German, Greek, Japanese, Norwegian, Polish, Portuguese, Romanian, Russian, Spanish, Swedish, and Turkish) and an international data-base exists that includes engagement records of nearly 80,000 employees. For the 17-item version of the UWES the three-factor model fits slightly better to the data than the one factor model, at least as far as samples from western countries like Spain, Portugal, The Netherlands, and Greece are concerned [5, 33, 36–38]. In addition, a cross-national study that included samples from 10 mostly western countries (i.e., Australia, Belgium, Canada, Finland, France, Germany, The Netherlands, Norway, South Africa, and Spain) showed factorial invariance of the three-factor structure of the UWES-9 across samples from various countries . Hence, the factor structure of the UWES is essentially similar and does not differ between countries. However, because the correlations between the three engagement dimensions are very high and the internal consistency of the 9-item scale is very good, the test-authors conclude that the total score can be used as an indicator of work engagement .
Work engagement from a cultural perspective
Culture and positive emotion
Because of the expanding global economy, researchers in occupational health have begun to conduct cross-cultural research. As far as work engagement is concerned, however, cross-cultural research has been largely limited to western countries with relatively small linguistic and cultural differences, such as Spain, Portugal and The Netherlands . Because the investigation of work engagement in other non-western cultures, such as Japan, still stand out, it may contribute to our further understanding and to the generalizability of the concept of work engagement across different cultures. This is of special relevance because, previous cross-cultural studies showed that results obtained in western samples cannot just be generalized to the Japanese context.
For instance, Scholz et al.  showed the validity of generalized self-efficacy, the belief of being able to control challenging environmental demands by taking adaptive action , applied in samples drawn from 25 different countries. However, they also showed that the mean scores of the general self-efficacy scale differed systematically among countries. The lowest means were found for the Japanese, followed by the Hong Kong Chinese; whereas highest values were found for the Costa Ricans, Danes, and French. They explained the low scores of self-efficacy among the Japanese as follows: "hard work and effort is more highly valued than ability in collectivistic cultures. Therefore, self-efficacy may be rated lower in collectivistic cultures than in individualistic cultures".
Another example comes from Iwata et al. , who examined cultural differences in responses to positive and negative items of the Center for Epidemiologic Studies Depression Scale (CES-D)  among American and Japanese adult workers. They found that responses to negatively worded items (e.g., lonely, crying) were generally comparable in the two groups (mean scores 3.91 vs. 3.52 for Japanese and U.S. workers, respectively, p > .10), whereas the Japanese responses to positively worded items (e.g., (not) hopeful, (not) happy) markedly differed from those of U.S. workers (mean scores: 6.03 vs. 1.83, respectively, p < .001: please note that high scores mean high depressive symptoms). Iwata et al.  explained their results in terms of the tendency to suppress positive affect expression among Japanese. According to Iwata et al. , maintenance of social harmony is one of the most important values in Japanese society, and the Japanese have been taught since childhood to understate their own virtues and not to behave assertively. As a result, the Japanese may judge positive affect through a comparison with others (i.e., relativistic judgment), which leads to suppression of positive affect expression (Please note that the same process also plays a role in western people, but only the effect of this comparison is more strong in Japanese people). Kirmayer  pointed out that in some cultures the suppression of distress could be a means of successful coping and, at the same time, might provide a mark of moral distinction. Likewise, the suppression of positive affect may represent a moral distinction and socially desirable behavior in Japanese society.
These examples suggest that a common bias exists in cross-cultural comparison of mental health (e.g., depression) and other psychosocial conditions (e.g., self-efficacy) due to the wording of the items: that is, particularly responses to positive items, such as those tapping work engagement, are likely to be biased among various cultural groups.
International comparison of UWES scores
As mentioned in the previous section, in a collectivistic culture such as Japan, maintenance of social harmony is one of the most important values, which may result in suppressed expression of positive affect . This suggests that such response tendency might negatively affect the psychometric properties of UWES, which consists of positively worded items. So, the following question emerges:
"Is the score on the work engagement scale among Japanese lower than those among other samples?"
To answer this question, scores of UWES-9 among Japanese employees were compared with those from employees from 15 other countries (i.e., Australia, Belgium, Canada, China, Czech Republic, Finland, France, Germany, Greece, Italy, The Netherlands, Norway, South Africa, Spain, and Sweden) by use of an international database (cf. http://www.schaufeli.com/).
Application of Item Response Theory to UWES
We recognize that we should take into account the tendency to suppress the expression of positive affect among Japanese employees when comparing positive aspects of well-being, particularly with other western countries. So, our second question is:
"Is the UWES sensitive to change in the extent of work engagement among employees in non-western countries like Japan?"
To answer this question, an advanced psychometric scale analysis called Item Response Theory (IRT)  was applied to our cross-cultural data. IRT is a model-based approach to understand the nonlinear relationships between individual characteristics (e.g., traits), item characteristics (e.g., difficulty), and individuals' response patterns. The use of IRT to study individual difference variables, such as work engagement, is advantageous for several reasons [44, 45].
First, IRT analyses compute the standard error of measurement (SEM) at each level of the latent trait, which indicates the extent of measurement preciseness at each level of the trait. For instance, it may be the case that the UWES may be more precise at particular levels (high vs. low) of work engagement. Second, IRT analyses compute the amount of psychometric "information" about the latent trait at each level of the trait that is provided by each item, as well as the entire measure, using the item information functions (IIFs) and the test information function (TIF), respectively. The IIFs and TIF are particularly useful because they indicate which items, and which levels of the latent trait, provide substantial information. For instance, it may be that some items or particular levels of the trait (e.g., high vs. low levels of work engagement) provide less information. Taken together, IRT can be used to evaluate measures in terms of how well the items and the entire measure assess a trait at different levels on the continuum for that trait .
The results of TIF and SEM showed that measurement accuracy of both versions was not similar. The amount of information in the Japanese version decreased sharply at the level of less than -2 (Figure 2), meaning that the Japanese version had difficulty in differentiating respondents with extremely low work engagement. On the other hand, the amount of information in the original Dutch version decreased gradually at the level of more than 1 (Figure 3), meaning that the original version had difficulty in differentiating respondents with high work engagement.
These results suggest that extremely low scores of the Japanese UWES-9 do not necessarily indicate low work engagement but might reflect decreased measurement accuracy of the scale in a Japanese sample. A possible cause of decreased measurement accuracy might be the tendency to suppress the expression of positive affect among Japanese people . The results also suggest that (extremely) high scores of the original UWES-9 do not necessarily indicate high work engagement. The typical response tendency known as self-enhancement, the general sensitivity to positive self-relevant information [48, 49], might be a possible cause of decreased measurement accuracy. According to Kitayama et al. , this tendency has positive social and psychological consequences within a culture that is organized to foster and promote the independence and the uniqueness of the self. Because self-enhancement maintains and enhances an overall evaluation of the self such as self esteem, it could be a means of successful coping in western countries.
With the globalization of occupational health psychology, more and more researchers are interested in applying employee well-being like work engagement to diverse populations. This article addressed psychometric issues in conducting cross-cultural studies in the field of occupational health psychology. In comparing positive aspects of well-being like work engagement between western countries and Asian countries (at least Japan), we should take into account the tendency to suppress the expression of positive affect among Japanese as well as the tendency for self-enhancement among westerners. Hence, for the time being, we should be cautious when interpreting low engagement scores among Japanese as well as high engagement scores among western employees. Further psychometric studies are needed to differentiate respondents with low work engagement in Japan and other (east) Asian countries as well as to differentiate those with high work engagement in western countries. Ultimately, accurate measurement contributes to our further understanding and to the generalizability of the concept of work engagement across different cultures.
- Seligman MEP, Csikszentmihalyi M: Positive psychology: An introduction. Am Psychol. 2000, 55: 5-14. 10.1037/0003-066X.55.1.5.View ArticlePubMed
- Schaufeli WB: The future of occupational health psychology. Appl Psychol-Int Rev. 2004, 53: 502-517. 10.1111/j.1464-0597.2004.00184.x.View Article
- Maslach C, Schaufeli WB, Leiter MP: Job burnout. Annu Rev Psychol. 2001, 52: 397-422. 10.1146/annurev.psych.52.1.397.View ArticlePubMed
- Schaufeli WB, Salanova M, Gonzalez-Romá V, Bakker AB: The measurement of engagement and burnout: A two sample confirmative analytic approach. J Happiness Stud. 2002, 3: 71-92. 10.1023/A:1015630930326.View Article
- Schaufeli WB, Bakker AB: Job demands, job resources and their relationship with burnout and engagement: A multi-sample study. J Organ Behav. 2004, 25: 293-315. 10.1002/job.248.View Article
- Hakanen J, Bakker AB, Schaufeli WB: Burnout and work engagement among teachers. J School Psychol. 2006, 43: 495-513. 10.1016/j.jsp.2005.11.001.View Article
- Koyuncu M, Burke RJ, Fiksenbaum L: Work engagement among women managers and professionals in a Turkish bank: Potential antecedents and consequences. Equal Opport Int. 2006, 25: 299-310. 10.1108/02610150610706276.View Article
- Halbesleben JRB: A meta-analysis of work engagement: Relationships with burnout, demands, resources and consequences. Work engagement: Recent developments in theory and research. Edited by: Bakker AB, Leiter MP. 2010, New York: Psychology Press, 102-117.
- Mauno S, Kinnunen U, Ruokolainen M: Job demands and resources as antecedents of work engagement: A longitudinal study. J Vocat Behav. 2007, 70: 149-171. 10.1016/j.jvb.2006.09.002.View Article
- de Lange AH, De Witte H, Notelaers G: Should I stay or should I go? Examining longitudinal relations among job resources and work engagement for stayers versus movers. Work Stress. 2008, 22: 201-223. 10.1080/02678370802390132.View Article
- Hakanen JJ, Schaufeli WB, Ahola K: The Job Demands-Resources model: A three-year cross-lagged study of burnout, depression, commitment, and work engagement. Work Stress. 2008, 22: 224-241. 10.1080/02678370802379432.View Article
- Schaufeli WB, Bakker AB, Van Rhenen W: How changes in job demands and resources predict burnout, work engagement, and sickness absenteeism. J Organ Behav. 2009, 30: 893-917. 10.1002/job.595.View Article
- Xanthopoulou D, Bakker AB, Demerouti E, Schaufeli WB: Reciprocal relationships between job resources, personal resources and work engagement. J Vocat Behav. 2009, 74: 235-244. 10.1016/j.jvb.2008.11.003.View Article
- Korunka C, Kubicek B, Schaufeli WB: Work engagement and burnout: Testing the robustness of the Job Demands-Resources model. J Posit Psychol. 2009, 4: 243-255. 10.1080/17439760902879976.View Article
- Salanova M, Grau R, Llorens S, Schaufeli WB: Exposición a las tecnologías de la información, burnout y engagement: El rol modulador de la autoeficacia profesional [Exposure to information technology, burnout and engagement: About the role of professional self-efficacy]. Psicología Social Aplicada. 2001, 11: 69-89.
- Bandura A: Self-efficacy: The exercise of control. 1997, New York: Freeman
- Llorens S, Schaufeli WB, Bakker AB, Salanova M: Does a positive gain spiral of resources, efficacy beliefs and engagement exist?. Comput Hum Behav. 2007, 23: 825-841. 10.1016/j.chb.2004.11.012.View Article
- Salanova M, Bresó E, Schaufeli WB: Hacia un modelo espiral de la autoeficacia en el estudio del burnout y Engagement [Towards a spiral model of self-efficacy in burnout and engagement research]. Ansiedad y Estrés. (in Spanish)
- Salanova M, Schaufeli WB, Xanthoupoulou D, Bakker AB: The Gain spiral of resources and work engagement: Sustaining a positive worklife. Work engagement: Recent developments in theory and research. Edited by: Bakker AB, Leiter MP. 2010, New York: Psychology Press, 118-131.
- Bandura A: Social cognitive theory: An agentic perspective. Annu Rev Psychol. 2001, 52: 1-26. 10.1146/annurev.psych.52.1.1.View ArticlePubMed
- Hobfoll SE: Conservation of resources: A new attempt at conceptualizing stress. Am Psychol. 1989, 44: 513-524. 10.1037/0003-066X.44.3.513.View ArticlePubMed
- Demerouti E, Bakker AB, de Jonge J, Janssen PPM, Schaufeli WB: Burnout and engagement at work as a function of demands and control. Scand J Work Env Hea. 2001, 27: 279-286.View Article
- Schaufeli WB, Bakker AB: Defining and measuring work engagement: Bringing clarity to the concept. Work engagement: Recent developments in theory and research. Edited by: Bakker AB, Leiter MP. 2010, New York: Psychology Press, 10-24.
- Schaufeli WB, Taris TW, Van Rhenen W: Workaholism, burnout and engagement: Three of a kind or three different kinds of employee well-being. Appl Psychol-Int Rev. 2008, 57: 173-203. 10.1111/j.1464-0597.2007.00285.x.View Article
- Schaufeli WB, Taris TW, Bakker AB: Dr Jekyll or Mr Hyde? On the differences between work engagement and workaholism. Research companion to working time and work addiction. Edited by: Burke RJ. 2006, Cheltenham, UK: Edward Elgar, 193-217.
- Shimazu A, Schaufeli WB, Kosugi S, Suzuki A, Nashiwa H, Kato A, Sakamoto M, Irimajiri H, Amano S, Hirohata K, Goto R, Kitaoka-Higashiguchi K: Work engagement in Japan: Validation of the Japanese version of the Utrecht Work Engagement Scale. Appl Psychol-Int Rev. 2008, 57: 510-523. 10.1111/j.1464-0597.2008.00333.x.View Article
- Shimazu A, Schaufeli WB: Is workaholism good or bad for employee well-being? The distinctiveness of workaholism and work engagement among Japanese employees. Ind Health. 2009, 47: 495-502. 10.2486/indhealth.47.495.View ArticlePubMed
- Salanova M, Schaufeli WB: Work engagement as a mediator between job resources and proactive behaviour: A cross-national study. Int J Hum Resour Man. 2008, 19: 116-131.View Article
- Sonnentag S: Recovery, work engagement, and proactive behavior: A new look at the interface between nonwork and work. J Appl Psychol. 2003, 88: 518-528. 10.1037/0021-9010.88.3.518.View ArticlePubMed
- Salanova M, Agut S, Peiro JM: Linking organizational resources and work engagement to employee performance and customer loyalty: The mediation of service climate. J Appl Psychol. 2005, 90: 1217-1227. 10.1037/0021-9010.90.6.1217.View ArticlePubMed
- Xanthopoulou D, Bakker AB, Demerouti E, Schaufeli WB: Work engagement and financial returns: A diary study on the role of job and personal resources. J Occup Organ Psych. 2009, 82: 183-200. 10.1348/096317908X285633.View Article
- Harter JK, Schmidt FL, Hayes TL: Business-unit-level relationship between employee satisfaction, employee engagement, and business outcomes: A meta-analysis. J Appl Psychol. 2002, 87: 268-279. 10.1037/0021-9010.87.2.268.View ArticlePubMed
- Schaufeli WB, Bakker AB: UWES - Utrecht Work Engagement Scale: Test Manual. 2003, Utrecht, The Netherlands: Utrecht University, Department of Psychology, [http://www.schaufeli.com]
- Schaufeli WB, Bakker AB, Salanova M: The measurement of work engagement with a short questionnaire: A cross-national study. Educ Psychol Meas. 2006, 66: 701-716. 10.1177/0013164405282471.View Article
- Smulders P: De bevlogenheid van werknemers gemeten [The measurement of work engament of employees]. TNO Special. 2006, Sept: 8-12.
- Llorens S, Bakker AB, Schaufeli WB, Salanova M: Testing the robustness of the job demands-resources model. Int J Stress Manage. 2006, 13: 378-391. 10.1037/1072-5245.13.3.378.View Article
- Schaufeli WB, Martinez I, Marques-Pinto A, Salanova M, Bakker AB: Burnout and Engagement in university students: A cross national study. J Cross Cult Psychol. 2002, 33: 464-481. 10.1177/0022022102033005003.View Article
- Xanthopoulou D, Bakker AB, Kantas A, Demerouti E: The measurement of burnout and work engagement: A comparison of Greece and The Netherlands. New Rev Soc Psychol
- Scholz U, Gutierrez-Dona B, Sud S, Schwarzer R: Is general self-efficacy a universal construct?: Psychometric findings from 25 countries. Eur J Psychol Assess. 2002, 18: 242-251. 10.1027//1015-57184.108.40.206.View Article
- Iwata N, Roberts CR, Kawakami N: Japan-U.S. comparison of responses to depression scale items among adult workers. Psychiat Res. 1995, 58: 237-245. 10.1016/0165-1781(95)02734-E.View Article
- Radloff LS: The CES-D scale: A self-report depression scale for research in the general population. Appl Psych Meas. 1977, 1: 385-401. 10.1177/014662167700100306.View Article
- Kirmayer L: Cultural variations in the response to psychiatric disorders and emotional distress. Soc Sci Med. 1989, 29: 327-339. 10.1016/0277-9536(89)90281-5.View ArticlePubMed
- Emberson SE, Reise SP: Item response theory for psychologists. 2000, Mahwah, NJ: Erlbaum
- Oishi S: The application of structural equation modeling and Item Response Theory to cross-cultural positive psychology research. Oxford handbook of methods in positive psychology. Edited by: Ong AD, Van Dulmen MHM. 2007, New York: Oxford University Press, 126-138.
- Scherbaum CA, Cohen-Charash Y, Kern MJ: Measuring general self-efficacy: A comparison of three measures using Item Response Theory. Educ Psychol Meas. 2006, 66: 1047-1063. 10.1177/0013164406288171.View Article
- Hambleton RK, Swaminathan H, Rogers HJ: Fundamentals of item response theory. 1991, Newbury Park, CA: Sage
- Miyanaka D: An Item Response Theory analysis of the Utrecht Work Engagement Scale among Dutch and Japanese workers. Master thesis. 2009, The University of Tokyo, Graduate School of Medicine
- Heine SJ, Lehman DR, Markus HR, Kitayama S: Is there a universal need for positive self-regard?. Psychol Rev. 1997, 106: 766-794. 10.1037/0033-295X.106.4.766.View Article
- Kitayama S, Markus HR, Matsumoto H, Norasakkunkit V: Indivudual and collective processes in the construction of the self: Self-enhancement in the United States and self-criticism in Japan. J Pers Soc Psychol. 1997, 72: 1245-1267. 10.1037/0022-35220.127.116.115.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.