Treatment Optimisation
What if mathematical models could predict the best treatment for each patient?
In Simple Terms
Treating a long-running disease such as multiple myeloma is a sequence of decisions made over years: when to test, when to change therapy, when to wait. Each decision is taken with incomplete information about what the disease is doing between visits. Mathematics offers a way to reason about this carefully, weighing the benefit of acting now against the cost and uncertainty of acting later. We build models that learn from a patient's own trajectory to suggest when and how to intervene, aiming to personalise follow-up rather than apply one fixed schedule to everyone.
The Science
This programme develops stochastic control and reinforcement-learning methods for medical follow-up optimisation, modelling disease progression as partially observed piecewise-deterministic Markov processes and controlled hidden semi-Markov models. We estimate relapse-time distributions from longitudinal biomarker trajectories, then use Monte-Carlo planning and Bayesian adaptive deep reinforcement learning to derive intervention policies under model uncertainty. Multiple myeloma is our primary clinical application, connecting the molecular RNA and epitranscriptome signatures characterised elsewhere in the group to quantitative decision support for personalised treatment.
Team
Tools & Methods
Key Publications
Deep reinforcement learning for controlled piecewise deterministic Markov process in cancer treatment follow-up
A Cleynen, B de Saporta, O Rossini, R Sabbadin, M Vinyals
PFIA
A Monte-Carlo planning strategy for medical follow-up optimization: Illustration on multiple myeloma data
B de Saporta, A Thierry d’Argenlieu, R Sabbadin, A Cleynen
PloS one 19 (12), e0315661
Controlled Hidden Semi‐Markov Models
A Cleynen, B de Saporta, O Rossini, R Sabbadin, A Vernay
A Comprehensive Guide to HSMM: Theory, Software, and Advanced Extensions …
Estimating relapse time distribution from longitudinal biomarker trajectories using iterative regression and continuous time Markov processes
A Cleynen, B de Saporta, A Vernay
arXiv preprint arXiv:2503.10448


