Comparison of online and face-to-face valuation of the EQ-5D-5L using composite time trade-off.
Ontology highlight
ABSTRACT: Objective
The aim of this study was to compare online, unsupervised and face-to-face (F2F), supervised valuation of EQ-5D-5L health states using composite time trade-off (cTTO) tasks.Methods
The official EuroQol experimental design and valuation protocol for the EQ-5D-5L of 86 health states were implemented in interviewer-assisted, F2F and unsupervised, online studies. Validity of preferences was assessed using prevalence of inconsistent valuations and expected patterns of TTO values. Respondent task engagement was measured using number of trade-offs and time per task. Trading patterns such as better-than-dead only was compared between modes. Value sets were generated using linear regression with a random intercept (RILR). Value set characteristics such as range of scale and dimension ranking were evaluated between modes.Results
Five hundred one online and 1,134 F2F respondents completed the surveys. Mean elicited TTO values were higher online than F2F when compared by health state severity. Compared to F2F, a larger proportion of online respondents did not assign the poorest EQ-5D-5L health state (i.e., 55555) the lowest TTO value ([Online] 41.3% [F2F] 12.2%) (p < 0.001). A higher percentage of online cTTO tasks were completed in 3 trade-offs or fewer ([Online] 15.8% [F2F] 3.7%), (p < 0.001). When modeled using the RILR, the F2F range of scale was larger than online ([Online] 0.600 [F2F] 1.307) and the respective dimension rankings differed.Conclusions
Compared to F2F data, TTO tasks conducted online had more inconsistencies and decreased engagement, which contributed to compromised data quality. This study illustrates the challenges of conducting online valuation studies using the TTO approach.
SUBMITTER: Jiang R
PROVIDER: S-EPMC8068705 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:IntroductionInconsistency in the time trade-off (TTO) task in EQ-5D-5L occurs when a respondent gives a higher value to a logically worse health state, the occurrence of inconsistency compromises the quality of the data. It is not yet clear which factors are associated with individual level inconsistency. Relating inconsistency to the characteristics of the respondent, interviewer, and the interview process could be helpful in understanding the causes of inconsistency. The objective of this paper is to discover the factors associated with individual level inconsistencies.MethodsTwenty interviewers interviewed 1,296 respondents and each respondent valued 10 health states using the EQ-VT platform in 5 cities in China. At the respondent level, inconsistency was identified in terms of severity and quantity and related to the respondent's background characteristics, the time and iterations spent on the wheelchair example task, and the formal TTO tasks, using multilevel multinomial regression analyses. Interviewers' impact on inconsistencies was analyzed using single level multinomial regression analyses.ResultsIn the full dataset, slight inconsistency was more related to the interview process (Time spent on TTO task: RRR = 1.246 with 95%CI: 1.076,1.441; time spent on Wheelchair example: RRR = 0.815 with 95%CI:0.699,0.952) while severe inconsistency was more related to respondent's gender (Gender: RRR = 2.347 with 95%CI:1.429,3.855). One Interviewer (Interviewer 7: RRR = 7.335 with 95%CI:1.908,28.195) and interviewer's experience (Sequence: RRR = 0.511 with 95%CI:0.385,0.678) in general showed strong influence over inconsistency in the TTO task.ConclusionIn conclusion, logical inconsistency in the valuation of EQ-5D-5L health states is associated not only with respondents' characteristics but also with interviewers' performance and the interview process. The role of interviewers and the importance of interviewer training may be more crucial than hitherto believed. This finding could be generalizable to other interviewer-administered health-state valuation study.
| S-EPMC5608280 | biostudies-literature
Project description:ObjectivesTo date, a value set for the EQ-5D-5L based on the health state preferences of the general Taiwanese population has not been available. This study aimed to develop a Taiwanese value set for EQ-5D-5L to facilitate health technology assessment for medical products and services.MethodsAn international standardized protocol for EQ-5D-5L valuation studies developed by the EuroQol group was adopted. Adult members of the general public were recruited from six geographic regions in Taiwan. In computer-based face-to-face interviews, each participant completed 10 composite time trade-off (C-TTO) tasks and 7 discrete choice experiment (DCE) tasks. The C-TTO and DCE data were modeled alone or in combination (using hybrid models) with additive models containing 20 dummy variables as main effects. The model performance was assessed both quantitatively and qualitatively (mainly logical consistency and prediction patterns).ResultsOf 1,073 recruited participants, 1,000 completed the study. Approximately 13% of observed utility values were -1 in the C-TTO tasks. The hybrid model, using all available data that assumed C-TTO response values left-censored at -1 and with main effects coefficients with logical consistency (monotonicity), was considered as the most appropriate model. The predicted utility ranged from -1.0259 to 1.ConclusionsAn EQ-5D-5L value set was developed for Taiwan using an established study protocol and a representative sample of the general population. This may facilitate health economic evaluations and decision making on resource allocation under Taiwan's national health insurance program in the future.
| S-EPMC6306233 | biostudies-literature
Project description:PurposeNormative scores (norms) allow for comparisons between population(s) of interest and the general population, which is useful for burden of disease studies and cost-effectiveness analysis. The primary aim of this study was to estimate US visual analogue scale (EQ VAS) and utility-based norms for the EQ-5D-5L using the face-to-face sample. The secondary aim was to compare norms estimated in the face-to-face and online populations.MethodsThis study estimated population norms from two general population surveys: (a) face-to-face and (b) online. In these surveys, respondents provided their health state using the EQ-5D-5L health classifier and the EQ VAS. Descriptive statistics, including mean, standard deviation (SD), 95% confidence interval, and median for the 5L utility and EQ VAS were estimated for each sample and across relevant respondent characteristics to serve as the basis for US EQ-5D-5L norms RESULTS: Face-to-face sample respondents (n = 1134) were representative of the US adult general population. In this sample, mean (SD) utility decreased with increasing age until age 45 or greater (age 45-54: 0.816 (0.249) age 55-64: 0.815 (0.243) age 65-74: 0.824 (0.217) age 75 + : 0.811 (0.218)). With increasing age, more problems were reported on all dimensions except anxiety/depression; a smaller proportion of respondents age 65 and older reported problems with anxiety/depression (23.8%) as compared to the youngest respondents (42.1%). Online (n = 2018) mean utility and EQ VAS values were consistently lower than the face-to-face sample.ConclusionsThe availability of US EQ-5D-5L norms facilitates interpretation and understanding of general population and patient health.
| S-EPMC7952367 | biostudies-literature
Project description:BACKGROUND:The 5-level version of the EQ-5D (EQ-5D-5L) was recently developed. A number of preference-based scoring systems are being developed for several countries around the world. OBJECTIVE:To develop a value set for the EQ-5D-5L based on societal preferences in Canada. METHODS:We used age, sex, and education quota sampling from the general population from 4 cities across Canada. Composite time trade-off (cTTO) and traditional time trade-off (tTTO) were used as the main elicitation technique. A total of 86 EQ-5D-5L health states grouped into 10 blocks were valued using cTTO, whereas a subset of 18 severe states was also valued using tTTO. Participants meeting predefined inconsistency criteria were excluded from the analyses. For the value set development, we used tTTO and positive cTTO values, while censoring negative and zero cTTO values at zero. Models with the main effects presented using linear terms combined with various additional terms were estimated. The preferred model was selected based primarily on logically ordered coefficients, and secondly model fit. RESULTS:Of the 1209 participants who completed the interview, 136 met criteria that excluded them from the primary analyses. The demographics and socioeconomic status of the remaining 1073 participants were similar to the Canadian general population. The preferred model has 5 linear terms for the main effects, a term for level 4 or 5 for each dimension, and a term for the squared total number of level 4 or 5 beyond the first. For this preferred model, the health utilities ranged from -0.148 for the worst (55555) to 0.949 for the best (11111) EQ-5D-5L states. CONCLUSIONS:This is the first TTO-based value set of the EQ-5D-5L for Canada. It can be used to support the health utility estimation in economic evaluations for reimbursement decision making in Canada.
| S-EPMC4674140 | biostudies-literature
Project description:In the valuation of EQ-5D-Y-3L, adult respondents are asked to complete composite time trade-off (cTTO) tasks for a 10-year-old child. Earlier work has shown that cTTO utilities elicited in such a child perspective are generally higher than when adults take their own perspective. We explore how differences in time preference in child and adult perspectives could explain this effect. Furthermore, as cTTO valuation in a child perspective involves explicit consideration of immediate death for a child, we also consider how cTTO utilities could be affected by decision-makers lexicographically avoiding death in children. We report the results of an experiment in which 219 respondents valued 5 health states in both adult and child perspectives with either a standard cTTO or a lead-time TTO only approach, in which immediate death is less focal. Time preferences were measured in both perspectives. Our results suggest that utilities were lower when lead-time TTO, rather than cTTO, was used. We find large heterogeneity in time preference in both perspectives, with predominantly negative time preference. The influence of time preferences on utilities, however, was small, and correcting for time preferences did not reduce differences between utilities elicited in both perspectives. Surprisingly, we found more evidence for differences in utilities between adult and child perspectives when lead-time TTO was used. Overall, these results suggest that time and lexicographic preferences affect time trade-off valuation in child and adult perspectives, but are not the explanation for differences between these perspectives. We discuss the implications of our findings for EQ-5D-Y-3L valuation.
| S-EPMC9123877 | biostudies-literature
Project description:BACKGROUND:The EQ-5D instrument is the most widely used preference-based health-related quality of life questionnaire in cost-effectiveness analysis of health care technologies. Recently, a version called EQ-5D-5L with 5 levels on each dimension was developed. This manuscript explores the performance of a hybrid approach for the modeling of EQ-5D-5L valuation data. METHODS:Two elicitation techniques, the composite time trade-off, and discrete choice experiments, were applied to a sample of the Spanish population (n=1000) using a computer-based questionnaire. The sampling process consisted of 2 stages: stratified sampling of geographic area, followed by systematic sampling in each area. A hybrid regression model combining composite time trade-off and discrete choice data was used to estimate the potential value sets using main effects as starting point. The comparison between the models was performed using the criteria of logical consistency, goodness of fit, and parsimony. RESULTS:Twenty-seven participants from the 1000 were removed following the exclusion criteria. The best-fitted model included 2 significant interaction terms but resulted in marginal improvements in model fit compared to the main effects model. We therefore selected the model results with main effects as a potential value set for this methodological study, based on the parsimony criteria. The results showed that the main effects hybrid model was consistent, with a range of utility values between 1 and -0.224. CONCLUSION:This paper shows the feasibility of using a hybrid approach to estimate a value set for EQ-5D-5L valuation data.
| S-EPMC7659432 | biostudies-literature
Project description:ObjectivesThe EQ-5D-5L and its value sets are widely used internationally. However, in the US and elsewhere, there is growing use of PROMIS, which has a value set (PROPr) based on the stated preferences of the US population. This paper aims to compare the characteristics of EQ-5D-5L and PROPr value sets and to highlight potential implications for users.MethodsUS, Australian and English value sets were used for EQ-5D-5L. PROPr utilities were calculated based on PROMIS-29 + 2. We examined, in each case, (i) the characteristics (e.g. range of values, number of unique values) and distribution of all possible 'theoretical' utilities; (ii) dimension/domain importance ranking by the utility of corner states (i.e. health states with the worst level in one domain and the best in all others); (iii) comparisons of utilities for health states hypothesised to be comparable in terms of severity across EQ-5D-5L descriptive systems and PROMIS-29 + 2 domain scores; (iv) the changes in values of adjacent states (i.e. a one-level change in one dimension for EQ-5D-5L and a four-point change in raw scores for PROMIS-29 + 2, with the other dimensions held constant) for dimensions hypothesised to overlap conceptually or be correlated between the two instruments.ResultsEQ-5D-5L and PROPr utilities differ systematically. First, the US EQ-5D-5L utilities range from - 0.573 to 1, whereas PROPr values for PROMIS-29 + 2 range from - 0.022 to 0.954. Second, in the US (and English) EQ-5D-5L value sets, pain is the most important dimension whereas in PROPr pain is one of the least important (apart from sleep disturbance). Third, classified based on severity across EQ-5D-5L descriptive systems and PROMIS-29 + 2 domain scores, PROPr has substantially lower values than EQ-5D-5L values for comparable 'mild' health states, but higher values for more 'severe' health states. Last, when one dimension is considered across its best to worst levels and all other dimensions are held constant at their best or moderate level, in EQ-5D-5L value sets, the greatest changes in utility occur between levels 3 and 4 (moderate and severe) problems; in PROPr that occurred between the most severe states and their descriptively adjacent health states.ConclusionThere are very considerable differences between US EQ-5D-5L and PROPr utilities, despite both in principle representing utility on the same scale anchored at 0 and 1 and both representing the preferences of the US general public. It is important for decision makers and clinical triallists to be aware of these differences. Further work is needed to assess the impact of these differences in value sets using population and patient data, and in longitudinal settings.
| S-EPMC8866274 | biostudies-literature
Project description:PURPOSE:EQ-5D-Y is a generic measure of health status for children and adolescents aged 8-15 years. Originally, it has three levels of severity in each dimension (3L). This study aimed to develop a descriptive system of EQ-5D-Y with an increased number of severity levels and to test comprehensibility and feasibility. METHODS:The study was conducted in Germany, Spain, Sweden and the UK. In Phase 1, a review of existing instruments and focus group interviews were carried out to create a pool of possible labels for a modified severity classification. Participants aged 8-15 rated the severity of the identified labels in individual sorting and response scaling interviews. In Phase 2, preliminary 4L and 5L versions were constructed for further testing in cognitive interviews with healthy participants aged 8-15 years and children receiving treatment for a health condition. RESULTS:In Phase 1, a total of 233 labels was generated, ranging from 37 (UK) to 79 labels (Germany). Out of these, 7 to 16 possible labels for each dimension in the different languages were rated in 255 sorting and response scaling interviews. Labels covered an appropriate range of severity on the health continuum in all countries. In Phase 2, the 5L version was generally preferred (by 68-88% of the participants per country) over the 4L version. CONCLUSIONS:This multinational study has provided a version of the EQ-5D-Y with 5 severity levels in each dimension. This extended version (EQ-5D-Y-5L) requires testing its psychometric properties and its performance compared to that of the original EQ-5D-Y-3L.
| S-EPMC6571085 | biostudies-other
Project description:ObjectiveTo investigate the responsiveness of and correlation between the EQ-5D-5L and the QOLIE-31P in patients with epilepsy, and develop a mapping function to predict EQ-5D-5L values based on the QOLIE-31P for use in economic evaluations.MethodsThe dataset was derived from two clinical trials, the ZMILE study in the Netherlands and the SMILE study in the UK. In both studies, patients' quality of life using the EQ-5D-5L and QOLIE-31P was measured at baseline and 12 months follow-up. Spearman's correlations, effect sizes (EF) and standardized response means (SRM) were calculated for both the EQ-5D-5L and QOLIE-31P domains and sub scores. Mapping functions were derived using ordinary least square (OLS) and censored least absolute deviations models.ResultsA total of 509 patients were included in this study. Low to moderately strong significant correlations were found between both instruments. The EQ-5D-5L showed high ceiling effects and small EFs and SRMs, whereas the QOLIE-31P did not show ceiling effects and also showed small to moderate EFs and SRMs. Results of the different mapping functions indicate that the highest adjusted R 2 we were able to regress was 0.265 using an OLS model with squared terms, leading to a mean absolute error of 0.103.ConclusionsResults presented in this study emphasize the shortcomings of the EQ-5D-5L in epilepsy and the importance of the development of condition-specific preference-based instruments which can be used within the QALY framework. In addition, the usefulness of the constructed mapping function in economic evaluations is questionable.
| S-EPMC6008365 | biostudies-literature
Project description:ObjectiveCost-utility analyses are becoming increasingly important in Central and Eastern Europe. We aimed to develop a Polish utility tariff for EQ-5D-5L health states.MethodsFace-to-face, computer-assisted interviews were collected in a representative sample. Each respondent followed a standardised protocol to collect ten composite time trade-off and seven discrete choice experiment observations. In the Bayesian approach, several model specifications were compared based on model fit, the usability of the final value set and how they reflect the elicitation procedure (e.g. censoring). A hybrid approach (using composite time trade-off and discrete choice experiment data) was employed in the final set, which was compared with the existing ones: EQ-5D-3L and EQ-5D-5L cross-walk.ResultsData from 1252 respondents (11,480 composite time trade-off valuations and 8764 discrete choice experiment pairs) were collected over the period June to October 2016. The final model accounted for random parameters, error scaling with fat tails, censoring at -?1, unwillingness to trade in time trade-off by the religious people and Cauchy distribution in discrete choice experiments. Pain/discomfort impacts the utility most: the disutility equals 0.575 when at level 5. In the value set, 4.4% of EQ-5D-5L states are worse than dead. The new value set has a comparable range (minimum of -?0.590 compared to -?0.523) and the same ordering of the first three dimensions (pain/discomfort, mobility, self-care) as the EQ-5D-3L value set and the EQ-5D-5L cross-walk value set. Moreover, it is more sensitive to a moderate decline in health.ConclusionsThe new value set supports consistency with past decisions in cost-utility studies, while offering a better assessment of even moderate improvements in health. It could represent an option for Central and Eastern Europe countries lacking their own value sets.
| S-EPMC6830402 | biostudies-literature