Development and Validation Study of an Instrument to Measure Work Environment of Nurses in Nursing Homes

Article information

J Korean Gerontol Nurs. 2019;21(3):144-154
Publication date (electronic) : 2019 December 31
doi : https://doi.org/10.17079/jkgn.2019.21.3.144
1Professor, Mo-Im Kim Nursing Research Institute, Yonsei University College of Nursing, Seoul, Korea
2Doctoral Student, College of Nursing, Yonsei University, Seoul, Korea
3Assistant Professor, Department of Nursing, Tongmyong University, Busan, Korea
4Assistant Professor, Department of Nursing, Seoil University, Seoul, Korea
5Assistant Professor, Gangneung-Wonju National University, Wonju, Korea
6Doctoral Student, College of Nursing, Seoul National University, Seoul, Korea
7Doctoral Candidate, The University of North Carolina at Chapel Hill School of Nursing, North Carolina, USA
8Assistant Professor, Red Cross College of Nursing, Chung-Ang University, Seoul, Korea
Corresponding author: Min, Ari Red Cross College of Nursing, Chung-Ang University, 84 Heukseok-ro, Dongjak-gu, Seoul 06974, Korea. Tel: +82-2-820-5642, Fax: +82-2-824-7961, E-mail: amin@cau.ac.kr
Received 2019 June 21; Revised 2019 September 9; Accepted 2019 October 7.

Abstract

Purpose

This study was done to develop an instrument to measure the work environment in nursing homes and to evaluate its psychometric properties.

Methods

Instrument development was conducted in three phases: development of the initial questionnaire, content validity and pilot-testing, and construct validity and reliability testing. Participants were 184 nurses from 62 nursing homes in South Korea. Exploratory factor analysis, confirmatory factor analysis, and examination of internal consistency were used to verify the psychometric properties of the instrument.

Results

The final model derived from the factor analysis yielded 27 items across five domains: nurses’ participation in nursing home affairs; well-defined scope of practice; nurse managers’ ability, leadership, and support of nurses; staff and resource adequacy; and communication and coordination. The fit indices in the confirmatory factor analysis were acceptable. Total Cronbach’s ⍺ was .93 (sub-domains ranged .77~.88).

Conclusion

The results indicate that the selected items are suitable for measuring the work environment of nursing homes in South Korea. This instrument may be useful in nursing home-related research and may be used to improve the health outcomes of older adults in nursing homes.

INTRODUCTION

A work environment that supports professional nursing practice is critical for quality of care, residents’ safety, optimal staff performance, and nurse retention. Several studies have shown that a positive work environment for nurses helps improve nurses’ quality of care, patient safety, and satisfaction [1-3], as well as nurse retention [4,5]. However, most previous studies were conducted in acute care settings and few studies have evaluated the work environment in nursing homes. The characteristics of residents in nursing home are unique and the organizational characteristics are distinguished from those of acute care settings. Most residents are frail older people who have chronic health problems and frequently have multiple co-morbidities [6]. Many residents are unable to perform daily activities independently because of cognitive and/or physical impairments [7]. Therefore, nursing home residents require more complicated and sophisticated physical care than do those in acute care settings. They also have complex and interrelated biopsychosocial problems, and they require multifaceted assessment and care [8].

The importance of nursing home care has been emphasized as the number of aged populations with chronic diseases has increased. Consequently, more studies have examined the impacts of work environment on resident and nurse outcomes in nursing homes. For example, Choi et al. [9] found that a supportive work environment is positively related to registered nurses’ job satisfaction in nursing homes. Tourangeau, Cranley, Laschinger, and Pachis [4] showed that work group cohesion and personal accomplishment, which are parts of work environment characteristics, are inversely associated with nurses’ turnover intention. In other studies, the nursing home work environment was inversely associated with the percentage of pressure ulcer [10] and deficiency citations [10,11]. The Swiss nursing home research team has shown that better work environment is positively correlated with care workers’ mental health, while it is negatively correlated with their intention to leave. They also showed that better quality of care was associated with higher teamwork, safety climate, and adequate staffing [12,13].

Nursing work in nursing homes is centered on nursing care whereas nursing work in acute hospital settings focus more on medical treatment. In addition, most of the work in nursing homes is highly autonomous and is accomplished through delegation and cooperation with other nursing staff [6]. As registered nurses in nursing homes have a directive role and responsibilities in their nursing work, registered nurses are required to have greater participation in decision-making to deliver quality of care, better communication and delegation skills between registered nurses and other staff, and good leadership as nurse managers [8]. These characteristics are very different from the work environment of hospital settings where nursing work is more individual and focuses on direct care for residents.

However, most previous studies conducted in nursing homes used the Practice Environment Scale of the Nursing Work Index [14], which was originally developed to measure the work environment in hospital settings [9,10,12], or they employed a combination of several instruments to measure the attributes of nursing work environments [4,11]. Only one developed instrument measures nursing home work environment [15]. That instrument mainly focused on the psychosocial attributes of nursing work environment (i.e., leadership, collaboration, or conflict management); however, it did not include other crucial attributes of a positive nursing work environment such as nurses’ participation in facility affairs, high standards of nursing care, and sufficient nurse staffing and resources [16]. Owing to the complexities of the healthcare system, a multidimensional assessment should be employed to accurately measure the work environment of nursing homes.

As such, the contributors to nursing work environment in nursing homes could differ from that of other healthcare settings, and the existing instrument may not be suitable to measure the unique work environment in nursing homes. Furthermore, to our knowledge, no instrument exists to measure the work environment of nursing homes in Korea. The lack of a usable instrument is a barrier to measuring and improving the work environment of Korean nursing homes. Given the importance of work environment and its potential impact on nursing care quality, a valid and reliable instrument to assess the work environment of nursing homes is desirable. The purpose of this study was thus to develop such an instrument and to evaluate its psychometric properties.

METHODS

1. Study Design

A cross-sectional study was conducted to develop and determine the psychometric properties of the work environment instrument among registered nurses with direct care responsibilities in nursing homes in South Korea. The development and evaluation processes were performed in three phases (Figure 1): Phase 1, development of the initial questionnaire; Phase 2, content validation and pilot-testing; and Phase 3, validity and reliability testing.

Figure 1.

Processes of instrument development and psychometric evaluation.

2. Process of Instrument Development and Psychometric Evaluation

1) Phase 1: Development of the initial questionnaire

In the first step, we conducted a literature review on the attributes of nursing home work environment and measurement methods using PubMed, Medline, EMBASE, CINAHL, KoreaMed, Korean Medical Database, and Korean Studies Information Service System; key words included “nursing home” OR “long-term care” AND “work environment” OR “practice environment”. The search was conducted from October 1, 2015 to February 22, 2016; was not limited to English-language papers; and no cut-off date was applied. Identified articles (N=45) were screened by title and then by abstract to exclude irrelevant articles, such as studies that used an instrument for hospital settings without modifying it to measure nursing home work environment. Subsequently, we selected four studies and asked permissions from the original authors to analyze the contents of existing instruments [4,15,17,18]. Overall, 160 items were extracted from the selected studies and six items from a qualitative interview with nurses who worked in nursing homes were added to develop the questionnaire.

The 25 items of the Practice Environment Scale of the Nursing Work Index were also included in the analysis of the new instrument because it is still the most commonly used tool to assess nursing practice environment in various healthcare settings [1-3,9,10,12]. Permission was obtained to use the scale from the original developer, Dr. Lake [14], and authors who translated them into Korean [19]. We removed items that did not directly relate to nursing home work environment or those that overlapped in content and/or meaning. All items were refined for clarity until all three of the current investigators agreed. Assessments and modification were repeated to avoid semantic duplication and to improve clarity of expression for each item.

2) Phase 2: content validity and pilot-testing

The initial version of the questionnaire with 60 items was sent to eight experts to evaluate its content validity. The eight experts included one scale development expert, two content experts, one elder care expert, one nursing home administrator, and three practice nurses in nursing home. All experts assessed whether each item was relevant and appropriate using a 4-point Likert scale (1=extremely irrelevant, 2=irrelevant, 3=relevant, and 4=extremely relevant). The content validity index of the individual items was calculated by taking the percentage of respondents that scored either 3 or 4, and the items with a content validity index of .78 or greater were considered adequate for content validity [20].

To evaluate the clarity and comprehensibility, a pilot test survey using 38 items was conducted with three nurses who provided direct resident care in nursing homes. Then, a focus group interview was conducted with two of the survey respondents to detect items and words that were not understood by the participants as intended by the research team.

3) Phase 3: construct validity and reliability testing

(1) Design, setting, and participants.

In August 2015, there were 2,854 nursing homes nationwide; of these, 1,588 were in Seoul, Gyeonggi, and six metropolitan cities. After excluding 1,122 nursing homes with no nurses, 466 facilities remained. Of these, 107 were facilities with more than 100 beds. To examine the validity and reliability of the newly developed instrument, all 107 facilities were requested to participate in this study. Sixty-four nursing homes agreed to participate and distributed questionnaires to 224 nurses. Finally, questionnaires were collected from 219 nurses from 62 nursing homes. Data were collected from April 4 to July 1, 2016.

After reviewing the collected questionnaires, 35 respondents were excluded because they had one or more items which they did not respond to. The final sample included 184 after excluding incomplete questionnaires. Although there are varying guiding rules about the required sample size in factor analysis (e.g., the sample size should be 100 or greater, the case to variable ratio should be at least 10:1, or the variable to expected factors ratio should be at least 3:1), research findings suggest that the accuracy of the factor analysis is dependent on all features of the gathered data such as the magnitudes of communalities or factor loading, rather than focusing on the sample size alone [21]. Therefore, the sample size of this study was appropriate for the factor analysis.

(2) Data analysis

Statistical analyses were performed using IBM SPSS statistics 23.0 (IBM, Armonk, NY, USA) and STATA version 13 (StataCorp LP., College Station, TX, USA). To test the construct validity of the instrument, an exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA) were conducted. Before the EFA, the Kaiser-Meyer-Olkin (KMO) test and the Bartlett’s sphericity test were used to evaluate whether the data was suitable for factor analysis. The number of factors was explored based on a Kaiser’s criteria (eigenvalue >1 rule), scree plots, and Velicer’s Minimum Average Partial (MAP) test. Principal components analysis (PCA) was conducted with varimax rotation. The factors with a communality of more than .40 and a factor loading of more than .30 were used as consideration criteria. The CFA was performed to verify the goodness-of-fit of the model suggested by the EFA, and the quality of model adjustments was made through the following fit indices: x2 (p>.05), the ratio of minimum discrepancy to the degrees of freedom (CMIN/df; <2 as a good fit), the comparative fit index (CFI; ≥.90 as a good fit), the Tucker-Lewis Index (TLI; .90~.94 as an adequate fit or ≥.95 as an excellent fit), and the Root Mean Square Error of Approximation (RMSEA; ≤.05 as a good fit or .05~.08 as an acceptable fit)[22]. Cronbach’s ⍺ coefficient was used to evaluate the internal consistency: ≥.90 indicates excellent, .80~.89 indicates good, and .70~.79 indicates acceptable internal consistency [23]. Item-total correlation coefficients r >.30 are regarded as being acceptable [23].

3. Ethical Considerations

Ethical approval was secured from the Institutional Review Board of a university (approval number: Y-2015-0024-8). All participants were informed about the study aims and method and provided written consent. The work described in this article was conducted in accordance with the Code of Ethics of the World Medical Association (Declaration of Helsinki).

RESULTS

1. Participants' General Characteristics

Nurses' mean age was 47.2±9.10 years and their mean work experience period was 14.84±7.61 years. Nearly all (99.5%) were women, and 42.4% had obtained at least a bachelor's degree. About half (45.7%) the nurses worked shifts (Table 1).

Participants' General Characteristics (N=184)

2. Instrument Development

Owing to the literature review and qualitative interviews, we developed the initial questionnaire, which comprised 60 items assessing five domains: (1) nurses’ participation in nursing home affairs (10 items); (2) well-defined scope of practice (17 items); (3) nurse managers’ ability, leadership, and support of nurses (7 items); (4) staffing and resource adequacy (11 items); and (5) communication and coordination (15 items). Eight experts evaluated the content validity of the initial questionnaire. Thirty-seven of the 60 items received a content validity index score above .78 and were thus retained. Although one item-“nurses working together talk to each other with an open mind”-scored less than .78, we decided to keep the item with revision because the item was necessary to assess the effectiveness of nurse communication. Based on the pilot survey test and focus group interviews, two items were excluded because of ambiguous meaning in most Korean nursing homes: “quality assurance program” and the absence of “appropriate legal protection system”. Through this process, the preliminary version of the 36-item nursing home work environment instrument was confirmed.

3. Psychometric Evaluation

1) Construct validity

(1) Exploratory factor analysis

The factorability of the 36 items was examined. The KMO measure of sampling adequacy was .89-above the recommended value of .50 [24]-and the result of the Bartlett’s sphericity test was significant (x2=3,247.05, p<.001), indicating that the data were appropriate to perform the EFA.

The PCA using orthogonal varimax rotation revealed the presence of eight factors, with eigenvalues exceeding the Kaiser’s criterion of 1. However, 2 of the 8 factors included only one or two items per factor, and the result of the scree test was also less accurate to determine the number of factors. As the Kaiser criterion tends to result in the over-extraction of factors [25], Velicer’s MAP test was performed to determine the optimal number of factors to retain. From the MAP criterion and the scree test, we determined that a 5-factor solution was more appropriate for this analysis. A varimax rotation was then performed again, and 8 items with low communalities (less than .40) were eliminated from the analysis. The remaining 28 items were entered to the factor analysis. The five factors were named as follows: Factor 1, “nurses’ participation in nursing home affairs”; Factor 2, “well-defined scope of practice”; Factor 3, “nurse managers’ ability, leadership, and support of nurses”; Factor 4, “staffing and resource adequacy”; and Factor 5, “communication and coordination”. Factor loading of the items in the instrument ranged between .39 and .78. The five factors accounted for 59.7% of the total variance (Table 2).

Summary of the Exploratory Factor Analysis of the Nursing Home Work Environment Instrument

(2) Confirmatory factor analysis

Based on the initial EFA model, a CFA was conducted on the same dataset to improve the model fit of the factor structure (Table 2). The results concerning Factors 2 and 3 indicated that the model had acceptable fit to data. We were unable to calculate x2 values for Factor 4, and the x2 values of Factor 1 and Factor 5 were unsatisfactory. However, since x2 is sensitive to large sample sizes, we used several goodness-of-fit indices to evaluate model fit.

The model fit was assessed using CMIN/df, RMSEA, CFI, and TLI. Factor 5 did not reach the cut-off value (CMIN/dF=5.47, RMSEA=.156, CFI=.85, and TLI=.79). This suggested that the results of the factor analysis were invalid and examining the correlations among the items can help improve the fit of the model. We found a high correlation (r=.70, p<.001) between two items-“good work relationship between nurses and other professionals” and “collaboration on resident care with other professionals; e.g., social workers, dieticians, physiotherapists, occupational therapists, speech-language therapists”-within Factor 5. The covariance of these two items was 61.65, indicated a strong relationship between them that overlapped. Therefore, “collaboration on resident care with other professionals” was excluded from the instrument. Consequently, Factor 5 had adequate data fitness (Table 3). The final model derived from factor analysis yielded a 27-item, five-factor model that provided the best fit to the data. The model fit index shows that the model was improved to a good fit except for x2 which is sensitive to sample size: x2=529.50 (p<.001), df=314, CMIN/DF=1.67, RMSEA=.061, CFI=.90, and TLI=.89.

Model fit indices of the Final Model from the Confirmatory Factor Analysis

2) Concurrent validity

Participants were asked to rate the work environment of the nursing home where they worked: “very good or good”, “moderate”, or “bad or very bad”. We compared the single question score to the work environment score measured by the newly developed instrument in this study. The correlation between variables was significant (Cramer’s V=0.196, p=.007). Thus, the concurrent validity of the developed instrument was supported.

3) Reliability

The results of the item analysis to verify the convergence validity of the items and the internal structure indicated that the mean of each item ranged from 2.15 to 3.45 with the standard deviations ranging between 0.67 and 0.98 (Table 4). The corrected item total correlation coefficients were r >.40 (range: r=.44~.75). The Cronbach’s ⍺ for the total 27-item instrument was .93, and Cronbach’s ⍺ of the subscales ranged from .77 to .88. Mean scores for each factor are shown in Table 4.

Item Analysis and Reliability Coefficients of the Nursing Home Work Environment Instrument

DISCUSSION

The work environment in the nursing home affects both older adults and the nurses [12,13]. The purpose of this study was to develop and evaluate an instrument that measures the nursing work environment of nursing homes. Initial questionnaires were developed based on a literature review, qualitative interviews, and items from the Practice Environment Scale of the Nursing Work Index. The validity and reliability of the instrument were analyzed through data collected from 184 nurses working at nursing homes. EFA and CFA were conducted. Overall, the devised scale had 27 items across 5 domains.

The five domains of the newly developed instrument evaluate key attributes of the work environment of nursing homes. Domain 1 revealed the participatory role in nursing home affairs. Nurses have opportunities to be involved in the internal governance of the nursing home and chief nurse officers have authority equal to top-level executives. Domain 2 emphasized the autonomy in providing high-standard nursing care using up-to-date nursing care plans, guidelines, and well-defined roles. Domain 3 focused on the critical abilities of a nurse manager including being a good manager and leader, praising a job well done, and supporting nurses with their problems. Domain 4 described the staffing and resource adequacy of nursing homes. Nurses should be able to spend enough time and resources to provide high-quality care to residents. Lastly, domain 5 was characterized by the relationship with residents, families, and other professionals working together. Increased participation by residents and their families and effective communication and coordination between co-workers improved the quality of care in nursing homes.

The newly developed instrument comprised the same 3 domains that were similar to those of the Practice Environment Scale of the Nursing Work Index [14]: “nurses’ participation in nursing home affairs (domain 1)”, “nurse managers’ ability, leadership, and support of nurses (domain 3)” and “staffing and resource adequacy (domain 4)”. A notable difference between the newly developed instrument and the previous Index was that our instrument reflects the unique work environment of nursing homes, where registered nurses work as healthcare providers who primarily interact with residents. For example, items that can assess nurses’ autonomous nursing activities (e.g., “nursing work has autonomy”, “nurse managers provide clear guidance and advice to nurses”, and “nurse managers respect the opinions of nurses when establishing residents’ care plan”) were included in domain 2, “well-defined scope of practice”. In the Practice Environment Scale of the Nursing Work Index, nurse autonomy was not empirically identified owing to the nature of nursing work and the status of nurses within the hierarchy in hospital settings [14].

In addition, the items regarding the relationship between nurse and doctors in the Practice Environment Scale of the Nursing Work Index were deleted from the new instrument. Instead, items reflecting the construct of communication and coordination with families were included as well as communication with other professions including doctors in nursing homes as domain 5, “Communication and coordination”. The included items within domain 5 assess the role of registered nurses in providing nursing care in nursing homes where various professions work together [26,27]. This is consistent with the results of Temkin-Greener et al. [16], who defined staff cohesion as one of the four domains of the work environment in nursing homes. Temkin-Greener et al. [16] highlighted four psychological factors-leadership, staff cohesion, communication/coordination, and conflict management-to show that executives and nurses are expected to share the values and goals of the facilities and work together to improve the quality of the work environment. Furthermore, as our study was designed to develop an instrument to accurately measure the nursing work environment in nursing homes containing multidimensional constructs, our instrument included not only psychological factors but also system and material factors such as nurses’ participation, clear work arrangements and work instructions, and sufficient nurses and assistive personnel.

Our results revealed the new instrument has adequate construct and concurrent validity and high reliability. The reliability was higher than that of the Practice Environment Scale of the Nursing Work Index when it was developed (Cronbach’s ⍺=.82; subscales ranged .74~.84) [14], but lower than that of the Practice Environment Scale of the Nursing Work Index when it was implemented with Asian nurses (Cronbach’s ⍺=.96; subscales ranged .80~.94) [28]. When compared with the reliability of the Practice Environment Scale of the Nursing Work Index in a study of hospital nurses in Korea, the internal consistency was similar (Cronbach’s ⍺=.93, subscales ranged .80~.84) [19].

The score calculation method of the newly developed instrument was the same as the Practice Environment Scale of the Nursing Work Index [14]; that is, the average of the sub-domains was compared with the median, and the number of sub-domains with an average value higher than the median of the entire domain was counted. Consequently, if the number of sub-domains having an average value higher than the median was 4~5, the work environment is “better”, 2~3 is “mixed” and 0~1 is “poor”. Lake and Friese reported that, when the domain score was less than 2.5, nurses agreed that their working conditions were poor [29]. In the current study, most domains exceeded this cut-off; however, “staffing and resource adequacy” was the lowest (i.e., 2.34 points). This is similar to these results of a study of hospital nurses in Korea (i.e., 2.20 points) [19]. This indicates that the nursing shortage in Korea is dire; in fact, the number of practicing nurses per 1,000 inhabitants in Korea was 6.9 in 2017 and 6.8 in 2016, far lower than the Organization for Economic Cooperation and Development average of 8.9 in 2016 [30].

Nursing work, resident characteristics, and organizational characteristics in nursing homes are unique and differ from those of acute care settings. Hence, this newly developed instrument may help nurses, researchers, and policymakers formally and accurately evaluate the nursing work environment specific to nursing homes. Particularly, this instrument measures multidimensional constructs of the working environment including both psychological and organizational factors. The newly developed instrument can also be used to compare the nursing work environment in Korea to those of other countries after it is cross-culturally adapted. Future research using this valid and reliable instrument would help elucidate the antecedents and consequences of the work environment in nursing homes and provide further information to nursing researchers, executives, and policymakers. Ultimately, the results of future studies would help nurses provide better quality of care through an enhanced work environment.

Although we devised a valid and reliable tool, some limitations should be noted. First, this study was developed for nursing homes in Korea. Therefore, further studies with repeated measurements and modifications may be necessary to test the cultural appropriateness of utilizing the tool in other countries. Second, the relationship between the nursing work environment and resident and/or nurse outcomes was not tested. Future studies are needed to examine the convergent and discriminant validity of the novel instrument. Furthermore, examining its test-retest reliability is recommended to determine measurement stability.

CONCLUSION

A strength of this study is that we constructed initial items based on empirical practice like a literature review and qualitative interviews. The selected items were suitable for measuring the nursing work environment in nursing homes by reflecting the organizational characteristics and the characteristics of residents and nursing activities. Findings from this study showed that the newly developed instrument is a reliable and valid tool to measure the nursing work environment in nursing homes. Furthermore, because the analyzed data were collected from nurses working in 62 nursing homes across this country, the instrument can be applied and generalized across the field. Thus, the availability of this instrument will promote research related to the work environment of nursing homes and can improve the health outcomes of the residing older adults.

Notes

The authors declared no conflict of interest.

Contributed to the conception and design of this study - CE, LK, KJ, CS, and KS; Performed the statistical analysis and drafted the manuscript - CE, MD, LK, KJ, CS, KH, KS, and MA; Critically reviewed the manuscript and supervised the whole study process - CE and MA. All authors read and approved the final manuscript.

Acknowledgements

This work was supported by the National Research Foundation of Korea (NRF) funded by the government of the Republic of Korea (grant number NRF-2014R1A1A3049936; Principal Investigator, E. Cho).

References

1. Aiken LH, Sermeus W, ; Van den Heede K, Sloane DM, Busse R, McKee M, et al. Patient safety, satisfaction, and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. British Medical Journal 2012;344e1717. https://doi.org/10.1136/bmj.e1717.
2. Kirwan M, Matthews A, Scott PA. The impact of the work environment of nurses on patient safety outcomes: a multi-level modelling approach. International Journal of Nursing Studies 2013;50(2):253–63. https://doi.org/10.1016/j.ijnurstu.2012.08.020.
3. Van Bogaert P, Kowalski C, Weeks SM, Van Heusden D, Clarke SP. The relationship between nurse practice environment, nurse work characteristics, burnout and job outcome and quality of nursing care: a cross-sectional survey. International Journal of Nursing Studies 2013;50(12):1667–77. https://doi.org/10.1016/j.ijnurstu.2013.05.010.
4. Tourangeau A, Cranley L, Spence Laschinger HK, Pachis J. Relationships among leadership practices, work environments, staff communication and outcomes in long-term care. Journal of Nursing Management 2010;18(8):1060–72. https://doi.org/10.1111/j.1365-2834.2010.01125.x.
5. Chao MC, Jou RC, Liao CC, Kuo CW. Workplace stress, job satisfaction, job performance, and turnover intention of health care workers in rural Taiwan. Asia Pacific Journal of Public Health 2015;27(2):NP1827–36. https://doi.org/10.1177/1010539513506604.
6. Estabrooks CA, Squires JE, Hayduk L, Morgan D, Cummings GG, Ginsburg L, et al. The influence of organizational context on best practice use by care aides in residential long-term care settings. Journal of the American Medical Directors Association 2015;16(6):537. e1-10. https://doi.org/10.1016/j.jamda.2015.03.009.
7. Ulbricht CM, Rothschild AJ, Hunnicutt JN, Lapane KL. Depression and cognitive impairment among newly admitted nursing home residents in the USA. International Journal of Geriatric Psychiatry 2017;32(11):1172–81. https://doi.org/10.1002/gps.4723.
8. Van den Berg TI, Landeweerd JA, Tummers GE, van Merode GG. A comparative study of organisational characteristics, work characteristics and nurses' psychological work reactions in a hospital and nursing home setting. International Journal of Nursing Studies 2006;43(4):491–505. https://doi.org/10.1016/j.ijnurstu.2005.06.007.
9. Choi J, Flynn L, Aiken LH. Nursing practice environment and registered nurses' job satisfaction in nursing homes. The Gerontologist 2012;52(4):484–92. https://doi.org/10.1093/geront/gnr101.
10. Flynn L, Liang Y, Dickson GL, Aiken LH. Effects of nursing practice environments on quality outcomes in nursing homes. Journal of the American Geriatrics Society 2010;58(12):2401–6. https://doi.org/10.1111/j.1532-5415.2010.03162.x.
11. Temkin-Greener H, Zheng NT, Cai S, Zhao H, Mukamel DB. Nursing home environment and organizational performance: association with deficiency citations. Medical Care 2010;48(4):357–64. https://doi.org/10.1097/MLR.0b013e3181ca3d70.
12. Dhaini SR, Zúñiga F, Ausserhofer D, Simon M, Kunz R, De Geest S, et al. Care workers health in Swiss nursing homes and its association with psychosocial work environment: a cross-sectional study. International Journal of Nursing Studies 2016;53:105–15. https://doi.org/10.1016/j.ijnurstu.2015.08.011.
13. Zúñiga F, Ausserhofer D, Hamers JP, Engberg S, Simon M, Schwendimann R. The relationship of staffing and work environment with implicit rationing of nursing care in Swiss nursing homes-a cross-sectional study. International Journal of Nursing Studies 2015;52(9):1463–74. https://doi.org/10.1016/j.ijnurstu.2015.05.005.
14. Lake ET. Development of the practice environment scale of the Nursing Work Index. Research in Nursing & Health 2002;25(3):176–88. https://doi.org/10.1002/nur.10032.
15. Aiken LH, Clarke SP, Sloane DM. Hospital staffing, organization, and quality of care: cross-national findings. International Journal for Quality in Health Care 2002;14(1):5–14. https://doi.org/10.1093/intqhc/14.1.5.
16. Temkin-Greener H, Zheng NT, Katz P, Zhao H, Mukamel DB. Measuring work environment and performance in nursing homes. Medical Care 2009;47(4):482–91. https://doi.org/10.1097/MLR.0b013e318190cfd3.
17. Castle NG. An instrument to measure job satisfaction of nursing home administrators. BMC Medical Research Methodology 2006;6(1):47. https://doi.org/10.1186/1471-2288-6-47.
18. Røssberg JI, Eiring Ø, Friis S. Work environment and job satisfaction: a psychometric evaluation of the Working Environment Scale-10. Social Psychiatry and Psychiatric Epidemiology 2004;39(7):576–80. https://doi.org/10.1007/s00127-004-0791-z.
19. Cho E, Choi M, Kim EY, Yoo IY, Lee NJ. Construct validity and reliability of the Korean version of the Practice Environment Scale of Nursing Work Index for Korean nurses. Journal of Korean Academy of Nursing 2011;41(3):325–32. https://doi.org/10.4040/jkan.2011.41.3.325.
20. Polit DF, Beck CT. Nursing research: Generating and assessing evidence for nursing practice 10th edth ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2017. Chapter 14, Measurement and data quality. p. 337–41.
21. Gaskin CJ, Happell B. On exploratory factor analysis: a review of recent evidence, an assessment of current practice, and recommendations for future use. International Journal of Nursing Studies 2014;51(3):511–21. https://doi.org/10.1016/j.ijnurstu.2013.10.005.
22. Harrington D. Confirmatory factor analysis New York, NY: Oxford University Press; 2009. p. 136.
23. Nunnally JC, Bernstein IH. Psychometric theory 3rd edth ed. New York, NY: McGraw-Hill; 1994. p. 752.
24. Tabachnick BG, Fidell LS. Using multivariate statistics 6th edth ed. Boston, MA: Pearson Education; 2013. p. 619.
25. Henson RK, Roberts JK. Use of exploratory factor analysis in published research: common errors and some comment on improved practice. Educational and Psychological Measurement 2006;66(3):393–416. https://doi.org/10.1177/0013164405282485.
26. Bauer M. Collaboration and control: nurses' constructions of the role of family in nursing home care. Journal of Advanced Nursing 2006;54(1):45–52. https://doi.org/10.1111/j.1365-2648.2006.03789.x.
27. Bedin MG, Droz-Mendelzweig M, Chappuis M. Caring for elders: the role of registered nurses in nursing homes. Nursing Inquiry 2013;20(2):111–20. https://doi.org/10.1111/j.1440-1800.2012.00598.x.
28. Liou SR, Cheng CY. Using the practice environment scale of the nursing work index on Asian nurses. Nursing Research 2009;58(3):218–25. https://doi.org/10.1097/NNR.0b013e3181a308cd.
29. Lake ET, Friese CR. Variations in nursing practice environments: relation to staffing and hospital characteristics. Nursing Research 2006;55(1):1–9.
30. Organization for Economic Cooperation and Development. Nurses [Internet]. Paris: OECD Publishing; 2017. Nov. 10. [updated 2017 Nov 10; cited 2019 Jan 21]. Available from: https://data.oecd.org/healthres/nurses.htm.

Appendices

Appendix. 노 인 요 양 시 설 간 호 근 무 환 경 측 정 도 구

Article information Continued

Figure 1.

Processes of instrument development and psychometric evaluation.

Table 1.

Participants' General Characteristics (N=184)

Variables Categories n (%) or M±SD
Age (year) 47.2±9.10
Working experience as an RN (year) 14.84±7.61
Gender Male 1 (0.5)
Female 183 (99.5)
Education level Diploma 106 (57.6)
≥Bachelor's degree 78 (42.4)
Working shift type 9 a.m. to 6 p.m. 100 (54.3)
12-hour shifts 22 (12.0)
8-hour shifts 49 (26.6)
Other 13 (7.1)

RN=Registered nurse.

Table 2.

Summary of the Exploratory Factor Analysis of the Nursing Home Work Environment Instrument

Item Factor
Communality
1 2 3 4 5
1. Career development/clinical ladder opportunity. .48 .46
2. A chief nurse officer equal in power and authority to other top-level executives. .52 .49
3. Administration that listens and responds to employee concerns. .63 .57
4. Staff nurses are involved in the internal governance of the facility. .76 .63
5. A clear philosophy of nursing that pervades the resident care environment. .64 .42
6. Autonomy in nurses' work is given. .41 .52
7. Written, up-to-date nursing care plans for all residents. .49 .51
8. There is a management system that can cope with emergencies. .77 .68
9. Clear job manuals and guidelines are given. .78 .72
10. Depending on the type of job, there is a clear role assignment. .69 .62
11. (Nurse) managers consult with nurses on daily problems and procedures. .54 .50
12. A supervisory staff that is supportive of the nurses. .76 .70
13. A nurse manager who is a good manager and leader. .75 .66
14. Praise and recognition for a job well done. .74 .63
15. (Nurse) managers provide clear guidance and advice to nurses. .76 .68
16. (Nurse) managers respect the opinion of nurses when establishing residents' care plan. .77 .69
17. Enough time and opportunity to discuss resident care problems with other nurses. .39 .49
18. Enough registered nurses to provide quality resident care. .77 .64
19. Enough staff to get the work done. .74 .74
20. There is enough time to perform nursing. .78 .66
21. High standards of nursing care are expected by the administration. .44 .62
22. Staff from other occupations and nurses have good working relationships. .61 .68
23. Nurses working together talk to each other with an open mind. .66 .64
24. Our facility nurses cooperate when taking care of a resident. .62 .63
25. Communication between shift workers is smooth during handover. .70 .66
26. When residents' condition changes, the correct information can be obtained quickly. .61 .55
27. The rapport with residents and their families is well formed. .49 .51
28. Nurses collaborate on resident care with other professionals (e.g., social workers, dieticians, physiotherapists, occupational therapists, speech-language therapists)* .68 .68
Eigenvalue 10.21 2.12 1.60 1.42 1.38
Proportion of variances (%) 36.5 7.6 5.7 5.1 4.9
Total variances (%) 36.5 44.0 49.7 54.8 59.7
*

Excluded items after the confirmatory factor analysis.

Table 3.

Model fit indices of the Final Model from the Confirmatory Factor Analysis

Variables Goodness-of-fit indices
x2 df p CMIN/DF RMSEA CFI TLI
Factor 1 18.94 9 .026 2.10 .077 0.96 0.93
Factor 2 1.22 2 .543 0.61 .000 1.00 1.01
Factor 3 21.74 14 .084 1.55 .055 0.99 0.98
Factor 4* - - - .000 1.00 1.00
Factor 5 27.84 14 .015 1.99 .073 0.97 0.95
Total 529.50 314 <.001 1.67 .061 0.90 0.89
KMO (Kaiser-Meyer-Olkin)=.89, Bartlett's sphericity test x2=3,247.05 (p<.001), Communality (≥.04)

CMIN/DF=Chi square minimum/degree of freedom; RMSEA=Root mean square; CFI=Comparative fit index; TLI=Tucker-Lewis index.

*

The STATA program does not provide x2 values less than 3 items.

Table 4.

Item Analysis and Reliability Coefficients of the Nursing Home Work Environment Instrument

Subdomain Item M±SD ITC ⍺ if item was deleted Cronbach's ⍺ M±SD
Nurses' participation in nursing home affairs 1 2.34±0.89 .47 .76 .78 2.76±0.77
2 2.81±0.96 .50 .76
3 2.80±0.87 .61 .73
4 2.60±0.95 .57 .74
5 2.85±0.84 .50 .76
6 3.16±0.75 .55 .75
Well-defined professional roles and responsibilities 7 3.07±0.81 .53 .79 .80 3.23±0.62
8 3.42±0.67 .68 .72
9 3.32±0.77 .66 .72
10 3.12±0.88 .59 .76
Nurse managers' ability, leadership, and support of nurses 11 3.39±0.67 .55 .88 .88 3.32±0.55
12 3.28±0.77 .74 .86
13 3.31±0.76 .71 .86
14 3.26±0.71 .69 .86
15 3.34±0.74 .74 .86
16 3.38±0.71 .75 .86
17 3.26±0.82 .53 .89
Staffing and resource adequacy 18 2.15±0.98 .61 .69 .77 2.34±0.79
19 2.32±0.84 .70 .58
20 2.54±0.85 .52 .78
Communication and coordination 21 3.39±0.79 .44 .84 .84 3.32±0.56
22 2.97±0.78 .49 .84
23 3.17±0.77 .71 .80
24 3.40±0.76 .71 .80
25 3.45±0.69 .67 .81
26 3.30±0.73 .58 .82
27 3.22±0.75 .59 .82
Total (range) (2.15~3.45)± (0.67~0.98) (.44~.75) .93 .93 3.06±0.64

ITC=Corrected item total correlation.

문 항 전혀 그렇지 않다 별로 그렇지 않다 약간 그렇다 매우 그렇다
시설 운영에 간호사의 참여
1 경력개발 및 발전의 기회가 제공된다(예: 승진).
2 간호부서의 최고관리자는 다른 부서의 최고관리자들과 동일한 권력과 권위를 가진다.
3 경영진(원장 등)은 간호사의 관심사를 경청하고 그에 반응한다.
4 시설/조직 내부의 운영결정에 간호사가 참여한다.
5 대상자 간호에 밑거름이 되는 명확한 간호철학이 공유된다.
6 간호업무수행에 자율성이 있다.
명확한 직무범위
7 모든 대상자를 위해서 서면화된 간호계획이 업데이트 된다.
8 응급상황 발생 시 대처할 수 있는 관리체계가 있다.
9 명확한 업무 매뉴얼과 지침이 마련되어 있다.
10 명확한 직종별 업무분장이 있다.
간호관리자의 리더십과 간호사에 대한 지지
11 (간호)관리자는 일상의 문제와 업무수행에 대하여 직원과 대화를 나눈다.
12 (간호)관리자는 간호사에게 지지적이다.
13 (간호)관리자는 행정능력과 지도력을 잘 갖추었다.
14 (간호)관리자는 간호사의 우수한 업무수행에 대한 칭찬과 인정을 한다.
15 (간호)관리자는 간호사에게 확실한 지도와 조언을 제공한다.
16 (간호)관리자는 대상자의 케어플랜 수립 시 간호사의 의견을 존중한다.
17 동료간호사들과 함께 대상자 간호와 관련된 문제를 논의할 수 있는 시간과 기회가 주어진다.
충분한 간호사 및 지원 인력
18 양질의 간호를 제공할 수 있도록 간호사의 수가 충분하다.
19 업무수행에 필요한 충분한 지원 인력이 있다.
20 대상자 간호를 수행할 시간이 충분하다.
의사 소통과 협력 관계
21 경영진(원장 등)이 높은 수준의 간호를 기대한다.
22 업무에 있어서 타직종의 직원과 간호사의 관계는 좋다.
23 함께 일하는 간호사들은 서로 마음을 터놓고 이야기 한다.
24 우리 시설은 대상자 간호시 간호사간에 서로 잘 협력한다.
25 인계 때 교대근무자간 의사소통은 원활하다.
26 대상자의 상태가 변화하였을 때, 올바른 정보를 빠르게 얻을 수 있다.
27 대상자나 그들의 가족과 라포(신뢰관계)가 잘 형성되어 있다.