Dataset Information

The promise of open survey questions-The validation of text-based job satisfaction measures.

ABSTRACT: Recent advances in computer-aided text analysis (CATA) have allowed organizational scientists to construct reliable and convenient measures from open texts. As yet, there is a lack of research into using CATA to analyze responses to open survey questions and constructing text-based measures of psychological constructs. In our study, we demonstrated the potential of CATA methods for the construction of text-based job satisfaction measures based on responses to a completely open and semi-open question. To do this, we employed three sentiment analysis techniques: Linguistic Inquiry and Word Count 2015, SentimentR and SentiStrength, and quantified the forms of measurement error they introduced: specific factor error, algorithm error and transient error. We conducted an initial test of the text-based measures' validity, assessing their convergence with closed-question job satisfaction measures. We adopted a time-lagged survey design (Nwave 1 = 996; Nwave 2 = 116) to test our hypotheses. In line with our hypotheses, we found that specific factor error is higher in the open question text-based measure than in the semi-open question text-based measure. As expected, algorithm error was substantial for both the open and semi-open question text-based measures. Transient error in the text-based measures was higher than expected, as it generally exceeded the transient error in the human-coded and the closed job satisfaction question measures. Our initial test of convergent and discriminant validity indicated that the semi-open question text-based measure is especially suitable for measuring job satisfaction. Our article ends with a discussion of limitations and an agenda for future research.

SUBMITTER: Wijngaards I

PROVIDER: S-EPMC6932814 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The promise of open survey questions-The validation of text-based job satisfaction measures.

Wijngaards Indy I Burger Martijn M van Exel Job J

PloS one 20191226 12

Recent advances in computer-aided text analysis (CATA) have allowed organizational scientists to construct reliable and convenient measures from open texts. As yet, there is a lack of research into using CATA to analyze responses to open survey questions and constructing text-based measures of psychological constructs. In our study, we demonstrated the potential of CATA methods for the construction of text-based job satisfaction measures based on responses to a completely open and semi-open ques ...[more]

PMID: 31877156

Similar Datasets

Project description:ObjectiveTo obtain a comprehensive understanding of the job opinions of hospital professionals by conducting qualitative analyses of the open comments included in a job satisfaction survey and combining these results with the quantitative results.DesignA cross-sectional survey targeting all Lausanne University Hospital professionals was performed in the fall of 2013.Material and methodsThe survey considered ten job satisfaction dimensions (e.g. self-fulfilment, workload, management, work-related burnout, organisational commitment, intent to stay) and included an open comment section. Computer-assisted qualitative analyses were conducted on these comments. Satisfaction rates on the included dimensions and professional groups were entered as predictive variables in the qualitative analyses.ParticipantsOf 10 838 hospital professionals, 4978 participated in the survey and 1067 provided open comments. Data from 1045 respondents with usable comments constituted the analytic sample (133 physicians, 393 nurses, 135 laboratory technicians, 247 administrative staff, including researchers, 67 logistic staff, 44 psycho-social workers, and 26 unspecified).ResultsAlmost a third of the comments addressed scheduling issues, mostly related to problems and exhaustion linked to shifts, work-life balance, and difficulties with colleagues' absences and the consequences for quality of care and patient safety. The other two-thirds related to classic themes included in job satisfaction surveys. Although some comments were provided equally by all professional groups, others were group specific: work and hierarchy pressures for physicians, healthcare quality and patient safety for nurses, skill recognition for administrative staff. Overall, respondents' comments were consistent with their job satisfaction ratings.ConclusionOpen comment analysis provides a comprehensive understanding of hospital professionals' job experiences, allowing better consideration of quality initiatives that match the needs of professionals with reality.

Project description:BackgroundJob satisfaction of general practitioners (GPs) is important because of the consequences of low satisfaction for GPs, their patients and the health system, such as higher turnover, health problems for the physicians themselves, less satisfied patients, poor clinical outcomes and suboptimal health care delivery. In this study, we aim to explain differences in the job satisfaction of GPs within and between countries.MethodsWe performed a secondary analysis of cross-sectional survey data, collected between 2010 and 2012 on 7379 GPs in 34 (mostly European) countries, as well as data on country and health system characteristics from public databases. Job satisfaction is measured through a composite score of six items about self-reported job experience. Operationalisation of the theoretical constructs includes variables, such as the range of services GPs provide, working hours, employment status, and feedback from colleagues. Data were analysed using linear multilevel regression analysis, with countries and GPs as levels. We developed hypotheses on the basis of the Social Production Function Theory, assuming that GPs 'produce' job satisfaction through stimulating work that provides a certain level of comfort, adds to their social status and provides behavioural confirmation.ResultsJob satisfaction varies between GPs and countries, with high satisfaction in Denmark and Canada (on average 2.97 and 2.77 on a scale from 1-4, respectively) and low job satisfaction in Spain (mean 2.15) and Hungary (mean 2.17). One-third of the total variance is situated on the country level, indicating large differences between countries, and countries with a higher GDP per capita have more satisfied GPs. Health system characteristics are not related to GP job satisfaction. At the GP and practice level, performing technical procedures and providing preventive care, feedback from colleagues, and patient satisfaction are positively related to GP job satisfaction and working more hours is negatively related GP job satisfaction.ConclusionOverall and in terms of our theoretical approach, we found that GPs are able to 'produce' work-related well-being through activities and resources related to stimulation, comfort and behavioural confirmation, but not to status.

Project description:ObjectivesTo investigate differences in reported open defecation between a question about latrine use or open defecation for every household member and a household-level question.SettingRural India is home to most of the world's open defecation. India's Demographic and Health Survey (DHS) 2015-2016 estimates that 54% of households in rural India defecate in the open. This measure is based on a question asking about the behaviour of all household members in one question. Yet, studies in rural India find substantial open defecation among individuals living in households with latrines, suggesting that household-level questions underestimate true open defecation.ParticipantsIn 2018, we randomly assigned latrine-owning households in rural parts of four Indian states to receive one of two survey modules measuring sanitation behaviour. 1215 households were asked about latrine use or open defecation individually for every household member. 1216 households were asked the household-level question used in India's DHS: what type of facility do members of the household usually use?ResultsWe compare reported open defecation between households asked the individual-level questions and those asked the household-level question. Using two methods for comparing open defecation by question type, the individual-level question found 20-21 (95% CI 16 to 25 for both estimates) percentage points more open defecation than the household-level question, among all households, and 28-29 (95% CI 22 to 35 for both estimates) percentage points more open defecation among households that received assistance to construct their latrines.ConclusionsWe provide the first evidence that individual-level questions find more open defecation than household-level questions. Because reducing open defecation in India is essential to meeting the Sustainable Development Goals, and exposure to open defecation has consequences for child mortality and development, it is essential to accurately monitor its progress.Trial registration numberRegistry for International Development Impact Evaluations (5b55458ca54d1).

Dataset Information

The promise of open survey questions-The validation of text-based job satisfaction measures.

Publications

The promise of open survey questions-The validation of text-based job satisfaction measures.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure