Learning to Speak and Act in a Fantasy Text Adventure Game
- Jack Urbanek, Angela Fan, J. Weston
- Computer ScienceConference on Empirical Methods in Natural…
- 1 March 2019
This work introduces a large-scale crowdsourced text adventure game as a research platform for studying grounded dialogue, and describes the results of training state-of-the-art generative and retrieval models in this setting.
Certified Patch Robustness via Smoothed Vision Transformers
- Hadi Salman, Saachi Jain, Eric Wong, Aleksander Mkadry
- Computer ScienceComputer Vision and Pattern Recognition
- 11 October 2021
This work demonstrates how using vision transformers enables significantly better certified patch robustness that is also more computationally efficient and does not incur a substantial drop in standard accuracy.
Missingness Bias in Model Debugging
- Saachi Jain, Hadi Salman, A. Madry
- Computer ScienceInternational Conference on Learning…
- 19 April 2022
It is shown how transformer-based architectures can enable a more natural implementation of missingness, which side-steps these issues and improves the reliability of model debugging in practice.
Combining Diverse Feature Priors
- Saachi Jain, Dimitris Tsipras, A. Madry
- Computer ScienceInternational Conference on Machine Learning
- 15 October 2021
It is shown that models trained with diverse sets of feature priors have less overlapping failure modes, and can thus be combined more effectively, and that jointly training such models on additional (unlabeled) data allows them to correct each other’s mistakes, which leads to better generalization and resilience to spurious correlations.
Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation
- Joshua Vendrow, Saachi Jain, Logan Engstrom, A. Madry
- Computer ScienceArXiv
- 15 February 2023
This work introduces dataset interfaces: a framework which allows users to scalably synthesize counterfactual examples from a given dataset, and represents each class from the input dataset as a custom token within the text space of a text-to-image diffusion model.
Distilling Model Failures as Directions in Latent Space
- Saachi Jain, Hannah Lawrence, Ankur Moitra, A. Madry
- Computer ScienceArXiv
- 29 June 2022
It is demonstrated that this framework allows us to discover and automatically caption challenging subpopulations within the training dataset and can be used to perform synthetic data augmentation that helps remedy the model’s failure modes.
When does Bias Transfer in Transfer Learning?
- Hadi Salman, Saachi Jain, Andrew Ilyas, Logan Engstrom, Eric Wong, A. Madry
- Computer ScienceArXiv
- 6 July 2022
This work demonstrates that bias transfer, or the tendency for biases of the source model to persist even after adapting the model to the target class, can occur even when the target dataset is explicitly de- biased.
A Data-Based Perspective on Transfer Learning
- Saachi Jain, Hadi Salman, Alaa Khaddaj, Eric Wong, Sung Min Park, A. Madry
- Computer ScienceArXiv
- 12 July 2022
This work takes a closer look at the role of the source dataset’s composition in transfer learning and presents a framework for probing its impact on downstream performance and demonstrates that removing detrimental datapoints identified by this framework improves transfer learning performance from ImageNet on a variety of target tasks.
MASA: Motif-Aware State Assignment in Noisy Time Series Data
- Saachi Jain, David Hallac, R. Sosič, J. Leskovec
- Computer Science
- 6 September 2018
This work develops motif-aware state assignment (MASA), a method to discover common motifs in noisy time series data and leverage those motifs to more robustly assign states to measurements and is scalable to very large datasets.
A Mechanism for Producing Aligned Latent Spaces with Autoencoders
- Saachi Jain, Adityanarayanan Radhakrishnan, Caroline Uhler
- Computer ScienceArXiv
- 29 June 2021
This work proves that linear and nonlinear autoencoders produce aligned latent spaces by stretching along the left singular vectors of the data and provides an initialization scheme to arbitrarily stretch along the top directions using these networks.
...
...