Unknown

Dataset Information

0

Q-LEARNING WITH CENSORED DATA.


ABSTRACT: We develop methodology for a multistage-decision problem with flexible number of stages in which the rewards are survival times that are subject to censoring. We present a novel Q-learning algorithm that is adjusted for censored data and allows a flexible number of stages. We provide finite sample bounds on the generalization error of the policy learned by the algorithm, and show that when the optimal Q-function belongs to the approximation space, the expected survival time for policies obtained by the algorithm converges to that of the optimal policy. We simulate a multistage clinical trial with flexible number of stages and apply the proposed censored-Q-learning algorithm to find individualized treatment regimens. The methodology presented in this paper has implications in the design of personalized medicine trials in cancer and in other life-threatening diseases.

SUBMITTER: Goldberg Y 

PROVIDER: S-EPMC3385950 | biostudies-literature | 2012 Feb

REPOSITORIES: biostudies-literature

altmetric image

Publications

Q-LEARNING WITH CENSORED DATA.

Goldberg Yair Y   Kosorok Michael R MR  

Annals of statistics 20120201 1


We develop methodology for a multistage-decision problem with flexible number of stages in which the rewards are survival times that are subject to censoring. We present a novel Q-learning algorithm that is adjusted for censored data and allows a flexible number of stages. We provide finite sample bounds on the generalization error of the policy learned by the algorithm, and show that when the optimal Q-function belongs to the approximation space, the expected survival time for policies obtained  ...[more]

Similar Datasets

| S-EPMC4414056 | biostudies-literature
| S-EPMC2565512 | biostudies-literature
| S-EPMC3312995 | biostudies-literature
| S-EPMC3276276 | biostudies-literature
| S-EPMC5413393 | biostudies-literature
| S-EPMC8251995 | biostudies-literature
| S-EPMC9162957 | biostudies-literature
| S-EPMC4465950 | biostudies-literature
| S-EPMC8260151 | biostudies-literature
| S-EPMC7770078 | biostudies-literature