Patterns, predictions, and actions: A story about machine learning
@article{Hardt2021PatternsPA,
title={Patterns, predictions, and actions: A story about machine learning},
author={Moritz Hardt and Benjamin Recht},
journal={ArXiv},
year={2021},
volume={abs/2102.05242}
}This graduate textbook on machine learning tells a story of how patterns in data support predictions and consequential actions. Starting with the foundations of decision making, we cover representation, optimization, and generalization as the constituents of supervised learning. A chapter on datasets as benchmarks examines their histories and scientific bases. Self-contained introductions to causality, the practice of causal inference, sequential decision making, and reinforcement learning…
Figures and Tables from this paper
figure 1 
table 1 
figure 2 
table 2 
figure 3 
table 3 
figure 4 
table 4 
figure 5 
table 5 
figure 7 
table 7 
figure 8 
table 8 
table 9 
figure 10 
figure 11 
figure 13 
figure 14 
figure 16 
figure 17 
figure 18 
figure 19 
figure 20 
figure 21 
figure 22 
figure 23 
figure 24 
figure 25 
figure 26 
figure 27 
figure 28 
figure 29 
figure 30 
figure 31 
figure 32 
figure 33
9 Citations
Machine learning in the social and health sciences
- Computer ScienceArXiv
- 2021
A meta-mapping of research questions in the social and health sciences to appropriate ML approaches is provided, by incorporating the necessary requirements to statistical analysis in these disciplines, and may help to advance the uptake of ML in social andhealth sciences while also pointing to possible limitations and ways of addressing them.
Are We Learning Yet? A Meta Review of Evaluation Failures Across Machine Learning
- Computer ScienceNeurIPS Datasets and Benchmarks
- 2021
A meta-review of 107 survey papers from computer vision, natural language processing, recommender systems, reinforcement learning, graph processing, metric learning, and more is conducted, organizing a wide range of surprisingly consistent critique into a concrete taxonomy of observed failure modes.
Equivariance Allows Handling Multiple Nuisance Variables When Analyzing Pooled Neuroimaging Datasets
- Computer ScienceArXiv
- 2022
This paper shows how bringing recent results on equivariant representation learning (for studying symmetries in neural networks) in-stantiated on structured spaces together with simple use of classical results on causal inference provides an effective practical solution.
Probabilistic design of optimal sequential decision-making algorithms in learning and control
- Computer ScienceArXiv
- 2022
This survey is focused on certain sequential decision-making problems that involve optimizing over probability functions and revisits popular learning and control algorithms, showing that these naturally arise from suitable variations on the formulation mixed with different resolution methods.
Prospective Learning: Back to the Future
- Computer ScienceArXiv
- 2022
It is argued that a paradigm shift from retrospective to prospective learning will enable the communities that study intelligence to unite and overcome existing bottlenecks to more effectively explain, augment, and engineer intelligences.
Communication-Efficient and Byzantine-Robust Distributed Learning With Error Feedback
- Computer ScienceIEEE Journal on Selected Areas in Information Theory
- 2021
A communication-efficient distributed learning algorithm that is robust against Byzantine worker machines, and a distributed gradient-descent algorithm that performs a simple thresholding based on gradient norms to mitigate Byzantine failures.
Machine Learning for Health: Algorithm Auditing & Quality Control
- Computer Science, MedicineJournal of Medical Systems
- 2021
This editorial gives a summary of ongoing work towards an integrated framework of algorithm auditing and quality control that provides a path towards the effective and reliable application of ML systems in healthcare.
Retiring Adult: New Datasets for Fair Machine Learning
- Computer ScienceNeurIPS
- 2021
A suite of new datasets derived from US Census surveys that extend the existing data ecosystem for research on fair machine learning and create prediction tasks relating to income, employment, health, transportation, and housing are created.
Fundamental Limits of Controlled Stochastic Dynamical Systems: An Information-Theoretic Approach
- Mathematics
- 2020
Generic Lp bounds that hold for any causal (stabilizing) controllers and any stochastic disturbances, by an information-theoretic analysis are derived.