Trial Size for Near-Optimal Choice Between Surveillance and Aggressive Treatment: Reconsidering MSLT-II

  title={Trial Size for Near-Optimal Choice Between Surveillance and Aggressive Treatment: Reconsidering MSLT-II},
  author={Charles F. Manski and Aleksey Tetenov},
  journal={The American Statistician},
  pages={305 - 311}
Abstract A convention in designing randomized clinical trials has been to choose sample sizes that yield specified statistical power when testing hypotheses about treatment response. Manski and Tetenov recently critiqued this convention and proposed enrollment of sufficiently many subjects to enable near-optimal treatment choices. This article develops a refined version of that analysis applicable to trials comparing aggressive treatment of patients with surveillance. The need for a refined… Expand
Statistical Decision Properties of Imprecise Trials Assessing Coronavirus Disease 2019 (COVID-19) Drugs
It is shown that the empirical success rule yields treatment choices that are much closer to optimal than those generated by prevailing decision criteria based on hypothesis tests. Expand
Probabilistic Prediction for Binary Treatment Choice: with Focus on Personalized Medicine
This paper carries further my research applying statistical decision theory to treatment choice with sample data, using maximum regret to evaluate the performance of treatment rules. The specific newExpand
Treatment Effects with Multiple Outcomes
A notion of treatment preference is developed that is shown to be a feature of standard treatment-effect analysis in the single-outcome case and seven possible characterizations of treatment preferences appropriate to multiple-outcomes contexts are suggested. Expand
The Other Arbitrary Cutoff
While I welcome the call to abandon statistical significance (Wasserstein, Schirm, and Lazar 2019), there is another arbitrary cutoff, power ≥ 80%, that is also quite harmful (Bacchetti 2010).Expand
Evaluating the maximum regret of statistical treatment rules with sample data on treatment response
In this article, we present the wald_tc command, which computes the maximum regret (MR) of a user-specified statistical treatment rule that uses sample data on realized treatment response (andExpand
The A/B Testing Problem with Gaussian Priors
A risk-neutral firm can perform a randomized experiment (A/B test) to learn about the effects of implementing an idea of unknown quality. The firm’s goal is to decide the experiment’s sample size andExpand
Statistically significant? Let us recognize that estimates of tested effects are uncertain
Haven’t all of us dreamt of concluding that our results be statistically significant, that is, characterized by a p-value lying below an arbitrary threshold, most often [Formula: see text]? In thisExpand
Statistical inference for statistical decisions
This paper motivates inference-based SDFs as practical procedures for decision making that may accomplish some of what Wald envisioned and presents specific findings concerning treatment choice and point prediction with sample data. Expand
Econometrics for Decision Making: Building Foundations Sketched by Haavelmo and Wald
This paper proposes statistical decision theory as a framework for evaluation of the performance of models in decision making, and considers the common practice of as-if optimization: specification of a model, point estimation of its parameters, and use of the point estimate to make a decision that would be optimal if the estimate were accurate. Expand
Moving to a World Beyond “p < 0.05”
Some of you exploring this special issue of The American Statistician might be wondering if it’s a scolding from pedantic statisticians lecturing you about what not to do with p-values, withoutExpand


Sufficient trial size to inform clinical practice
  • C. Manski, A. Tetenov
  • Computer Science, Medicine
  • Proceedings of the National Academy of Sciences
  • 2016
This paper develops an alternative principle for trial design that aims to directly benefit medical decision making by choosing a sample size that enables implementation of near-optimal treatment rules. Expand
Clinical trial design enabling {\epsilon}-optimal treatment rules
Medical research has evolved conventions for choosing sample size in randomized clinical trials that rest on the theory of hypothesis testing. Bayesians have argued that trials should be designed toExpand
Completing the Dissection in Melanoma: Increasing Decision Precision
  • M. Faries
  • Medicine
  • Annals of Surgical Oncology
  • 2017
Sentinel node biopsy effectively ended the debate about whether nodal staging was indicated for melanomas, but left the question of completion lymph node dissection among those with sentinel node metastases unanswered. Expand
Treatment Choice With Trial Data: Statistical Decision Theory Should Supplant Hypothesis Testing
  • C. Manski
  • Psychology
  • The American Statistician
  • 2019
Abstract A central objective of empirical research on treatment response is to inform treatment choice. Unfortunately, researchers commonly use concepts of statistical inference whose foundations areExpand
The continuing unethical conduct of underpowered clinical trials.
It is concluded that underpowered trials are ethical in only 2 situations: small trials of interventions for rare diseases in which investigators document explicit plans for including their results with those of similar trials in a prospective meta-analysis, and early-phase trials in the development of drugs or devices, provided they are adequately powered for defined purposes other than randomized treatment comparisons. Expand
Statistical treatment rules for heterogeneous populations
An important objective of empirical research on treatment response is to provide decision makers with information useful in choosing treatments. This paper studies minimax-regret treatment choiceExpand
Focusing Technology Assessment Using Medical Decision Theory
  • C. Phelps, A. Mushlin
  • Medicine
  • Medical decision making : an international journal of the Society for Medical Decision Making
  • 1988
Combining medical decision theory and epidemiologic information, the authors have developed a strategy to assess diagnostic technologies that recommends against their use if the technology is not sufficiently cost-effective, even with this optimistic assumption. Expand
Bayesian Approaches to Randomized Trials
It is argued that a Bayesian approach allows a formal basis for using external evidence and in addition provides a rational way for dealing with issues such as the ethics of randomization, trials to show treatment equivalence, the monitoring of accumulating data and the prediction of the consequences of continuing a study. Expand
Completion Dissection or Observation for Sentinel‐Node Metastasis in Melanoma
Immediate completion lymph‐node dissection increased the rate of regional disease control and provided prognostic information but did not increase melanoma‐specific survival among patients with melanoma and sentinel‐node metastases. Expand
Value of Information on Preference Heterogeneity and Individualized Care
  • A. Basu, D. Meltzer
  • Economics, Medicine
  • Medical decision making : an international journal of the Society for Medical Decision Making
  • 2007
The expected value of individualized care (EVIC), which represents the potential value of providing physicians information on the preferences of individual patients, such as quality-of-life (QOL) weights, so as to make individualized treatment decisions, is calculated. Expand