Clinical trial design enabling {\epsilon}-optimal treatment rules

  title={Clinical trial design enabling \{\epsilon\}-optimal treatment rules},
  author={Charles F. Manski and Aleksey Tetenov},
Medical research has evolved conventions for choosing sample size in randomized clinical trials that rest on the theory of hypothesis testing. Bayesians have argued that trials should be designed to maximize subjective expected utility in settings of clinical interest. This perspective is compelling given a credible prior distribution on treatment response, but Bayesians have struggled to provide guidance on specification of priors. We use the frequentist statistical decision theory of Wald… Expand
Statistical Decision Properties of Imprecise Trials Assessing COVID-19 Drugs
As the COVID-19 pandemic progresses, researchers are reporting findings of randomized trials comparing standard care with care augmented by experimental drugs. The trials have small sample sizes, soExpand
Treatment Choice With Trial Data: Statistical Decision Theory Should Supplant Hypothesis Testing
  • C. Manski
  • Psychology
  • The American Statistician
  • 2019
Abstract A central objective of empirical research on treatment response is to inform treatment choice. Unfortunately, researchers commonly use concepts of statistical inference whose foundations areExpand
Trial Size for Near-Optimal Choice Between Surveillance and Aggressive Treatment: Reconsidering MSLT-II
A refined version of that analysis applicable to trials comparing aggressive treatment of patients with surveillance, based on a trial comparing nodal observation and lymph node dissection when treating patients with cutaneous melanoma, concludes that assigning 244 patients to each option would yield findings that enable suitably near-optimal treatment choice. Expand
Statistical Decision Properties of Imprecise Trials Assessing Coronavirus Disease 2019 (COVID-19) Drugs
It is shown that the empirical success rule yields treatment choices that are much closer to optimal than those generated by prevailing decision criteria based on hypothesis tests. Expand
Reasonable patient care under uncertainty.
  • C. Manski
  • Medicine, Psychology
  • Health economics
  • 2018
How limited ability to predict illness and treatment response may affect the welfare achieved in patient care is discussed and basic decision theory is applied to suggest reasonable decision criteria with well-understood welfare properties. Expand
Evaluating the maximum regret of statistical treatment rules with sample data on treatment response
In this article, we present the wald_tc command, which computes the maximum regret (MR) of a user-specified statistical treatment rule that uses sample data on realized treatment response (andExpand
Understanding and Misunderstanding Randomized Controlled Trials
It is argued that the lay public, and sometimes researchers, put too much trust in RCTs over other methods of investigation, and this is a disadvantage for cumulative scientific progress, where prior knowledge should be built upon, not discarded. Expand
Laboratory experiments can pre-design to address power and selection issues
Using data from two laboratory experiments where subject behavior deviated sharply from theory, it is shown that the ex-post subject allocation to maximize statistical power is closer to these ex-ante calculations relative to traditional designs that balances the number of subjects across treatments. Expand
False Discovery in A/B Testing
We investigate what fraction of all significant results in website A/B testing are actually null effects, i.e., the false discovery rate (FDR). Our data consists of 4,964 effects from 2,766Expand
Asymptotic analysis of statistical decision rules in econometrics
This work discusses heuristics for constructing statistical decision rules, and survey results that characterize the properties of various classes of decision rules. Expand