Dataset Information

Response speed measurements on the psychomotor vigilance test: how precise is precise enough?

ABSTRACT:

Study objectives

The psychomotor vigilance test (PVT) is frequently used to measure behavioral alertness in sleep research on various software and hardware platforms. In contrast to many other cognitive tests, PVT response time (RT) shifts of a few milliseconds can be meaningful. It is, therefore, important to use calibrated systems, but calibration standards are currently missing. This study investigated the influence of system latency bias and its variability on two frequently used PVT performance metrics, attentional lapses (RTs ≥500 ms) and response speed, in sleep-deprived and alert participants.

Methods

PVT data from one acute total (N = 31 participants) and one chronic partial (N = 43 participants) sleep deprivation protocol were the basis for simulations in which response bias (±15 ms) and its variability (0-50 ms) were systematically varied and transgressions of predefined thresholds (i.e. ±1 for lapses, ±0.1/s for response speed) recorded.

Results

Both increasing bias and its variability caused deviations from true scores that were higher for the number of lapses in sleep-deprived participants and for response speed in alert participants. Threshold transgressions were typically rare (i.e. <5%) if system latency bias was less than ±5 ms and its standard deviation was ≤10 ms.

Conclusions

A bias of ±5 ms with a standard deviation of ≤10 ms could be considered maximally allowable margins for calibrating PVT systems for timing accuracy. Future studies should report the average system latency and its standard deviation in addition to adhering to published standards for administering and analyzing the PVT.

SUBMITTER: Basner M

PROVIDER: S-EPMC8240655 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:To identify measures derived from baseline psychomotor vigilance task (PVT) performance that can reliably predict vulnerability to sleep deprivation.Subjects underwent total sleep deprivation and completed a 10-min PVT every 1-2 h in a controlled laboratory setting. Participants were categorized as vulnerable or resistant to sleep deprivation, based on a median split of lapses that occurred following sleep deprivation. Standard reaction time, drift diffusion model (DDM), and wavelet metrics were derived from PVT response times collected at baseline. A support vector machine model that incorporated maximum relevance and minimum redundancy feature selection and wrapper-based heuristics was used to classify subjects as vulnerable or resistant using rested data.Two academic sleep laboratories.Independent samples of 135 (69 women, age 18 to 25 y), and 45 (3 women, age 22 to 32 y) healthy adults.In both datasets, DDM measures, number of consecutive reaction times that differ by more than 250 ms, and two wavelet features were selected by the model as features predictive of vulnerability to sleep deprivation. Using the best set of features selected in each dataset, classification accuracy was 77% and 82% using fivefold stratified cross-validation, respectively.In both datasets, DDM measures, number of consecutive reaction times that differ by more than 250 ms, and two wavelet features were selected by the model as features predictive of vulnerability to sleep deprivation. Using the best set of features selected in each dataset, classification accuracy was 77% and 82% using fivefold stratified cross-validation, respectively.Despite differences in experimental conditions across studies, drift diffusion model parameters associated reliably with individual differences in performance during total sleep deprivation. These results demonstrate the utility of drift diffusion modeling of baseline performance in estimating vulnerability to psychomotor vigilance decline following sleep deprivation.

Project description:BackgroundWe compared psychomotor vigilance in female shift workers of the Bergmannsheil University Hospital in Bochum, Germany (N = 74, 94% nurses) after day and night shifts.MethodsParticipants performed a 3-minute Psychomotor Vigilance Task (PVT) test bout at the end of two consecutive day and three consecutive night shifts, respectively. Psychomotor vigilance was analyzed with respect to mean reaction time, percentage of lapses and false starts, and throughput as an overall performance score, combining reaction time and error frequencies. We also determined the reaction time coefficient of variation (RTCV) to assess relative reaction time variability after day and night shifts. Further, we examined the influence of shift type (night vs. day) by mixed linear models with associated 95% confidence intervals (CI), adjusted for age, chronotype, study day, season, and the presence of obstructive sleep apnea (OSA).ResultsAt the end of a night shift, reaction times were increased (β = 7.64; 95% CI 0.94; 14.35) and the number of lapses higher compared to day shifts (exp(β) = 1.55; 95% CI 1.16-2.08). By contrast, we did not observe differences in the number of false starts between day and night shifts. Throughput was reduced after night shifts (β = -15.52; 95% CI -27.49; -3.46). Reaction times improved across consecutive day and night shifts, whereas the frequency of lapses decreased after the third night. RTCV remained unaffected by both, night shifts and consecutive shift blocks.DiscussionOur results add to the growing body of literature demonstrating that night-shift work is associated with decreased psychomotor vigilance. As the analysis of RTCV suggests, performance deficits may selectively be driven by few slow reactions at the lower end of the reaction time distribution function. Comparing intra-individual PVT-performances over three consecutive night and two consecutive day shifts, we observed performance improvements after the third night shift. Although a training effect cannot be ruled out, this finding may suggest better adaptation to the night schedule if avoiding fast-changing shift schedules.