Performative Prediction in a Stateful World
- Gavin Brown, Shlomi Hod, I. Kalemaj
- Computer ScienceInternational Conference on Artificial…
- 8 November 2020
This work generalizes the results of Perdomo et al. (2020), who investigated "performative prediction" in a stateless setting to the case where the response of the population to the deployed classifier depends both on the classifier and the previous distribution of the Population.
Neural Networks are Surprisingly Modular
- Daniel Filan, Shlomi Hod, Cody Wild, Andrew Critch, Stuart J. Russell
- Computer ScienceArXiv
- 10 March 2020
A measurable notion of modularity is introduced for multi-layer perceptrons (MLPs) and it is found that MLPs that undergo training and weight pruning are often significantly more modular than random networks with the same distribution of weights.
Pruned Neural Networks are Surprisingly Modular
- Daniel Filan, Shlomi Hod, Cody Wild, Andrew Critch, Stuart J. Russell
- Computer Science
- 10 March 2020
A measurable notion of modularity for multi-layer perceptrons (MLPs) is introduced, and it is found that training and weight pruning produces MLPs that are more modular than randomly initialized ones, and often significantly more modules than random MLPs with the same (sparse) distribution of weights.
Clusterability in Neural Networks
- Daniel Filan, Stephen Casper, Shlomi Hod, Cody Wild, Andrew Critch, Stuart J. Russell
- Computer ScienceArXiv
- 4 March 2021
The learned weights of a neural network have often been considered devoid of scrutable internal structure. In this paper, however, we look for structure in the form of clusterability: how well a…
Detecting Modularity in Deep Neural Networks
- Shlomi Hod, Stephen Casper, Daniel Filan, Cody Wild, Andrew Critch, Stuart J. Russell
- Computer ScienceArXiv
- 2021
It is suggested that graph-based partitioning can reveal modularity and help us understand how deep neural networks function.
Data science meets law
- Shlomi Hod, Karni Chagal-Feferkorn, N. Elkin-Koren, Avidor Gal
- Computer Science, EducationCommunications of the ACM
- 24 January 2022
Learning Responsible AI together.
Quantifying Local Specialization in Deep Neural Networks
- Shlomi Hod, Daniel Filan, Stephen Casper, Andrew Critch, Stuart J. Russell
- Computer Science
- 13 October 2021
It is suggested that graph-based partitioning can reveal local specialization and that statistical methods can be used to automatedly screen for sets of neurons that can be understood abstractly.
G RAPHICAL C LUSTERABILITY AND L OCAL S PECIALIZATION IN D EEP N EURAL N ETWORKS
- Stephen Casper, Shlomi Hod, Daniel Filan, Cody Wild, Andrew Critch, Stuart Russell
- Computer Science
- 2022
The learned weights of deep neural networks have often been considered devoid of scrutable internal structure, and tools for studying them have not traditionally relied on techniques from network…