Categorical Hopfield Networks
@inproceedings{Marcolli2022CategoricalHN, title={Categorical Hopfield Networks}, author={Matilde Marcolli}, year={2022} }
This paper discusses a simple and explicit toy-model example of the categorical Hopfield equations introduced in previous work of Manin and the author. These describe dynamical assignments of resources to networks, where resources are objects in unital symmetric monoidal categories and assignments are realized by summing functors. The special case discussed here is based on computational resources (computational models of neurons) as objects in a category of DNNs, with a simple choice of the…
References
SHOWING 1-10 OF 18 REFERENCES
Topological Model of Neural Information Networks
- ArtGSI
- 2021
This is a brief overview of an ongoing research project, involving topological models of neural information networks and the development of new versions of associated information measures that can be…
Resource convertibility and ordered commutative monoids
- MathematicsMathematical Structures in Computer Science
- 2015
This work develops a general mathematical toolbox for the convertibility of resources into other ones and the possibility of combining resources, and derives a wealth of results which should have applications to concrete resource theories, such as a formula for rates of conversion.
Backprop as Functor: A compositional perspective on supervised learning
- Computer Science2019 34th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS)
- 2019
A key contribution is the notion of request function, which provides a structural perspective on backpropagation, giving a broad generalisation of neural networks and linking it with structures from bidirectional programming and open games.
Single Cortical Neurons as Deep Artificial Neural Networks
- Computer Science, BiologybioRxiv
- 2019
It is demonstrated that cortical neurons can be conceptualized as multi-layered “deep” processing units, implying that the cortical networks they form have a non-classical architecture and are potentially more computationally powerful than previously assumed.
SYMMETRIC MONOIDAL CATEGORIES MODEL ALL CONNECTIVE SPECTRA
- Mathematics
- 1995
The classical innite loopspace machines in fact induce an equivalence of categories between a localization of the category of symmetric monoidal categories and the stable homotopy category of…
A Koszul duality for props
- Mathematics
- 2007
The notion of prop models the operations with multiple inputs and multiple outputs, acting on some algebraic structures like the bialgebras or the Lie bialgebras. In this paper, we generalize the…
The Algebra of Directed Acyclic Graphs
- Mathematics, Computer ScienceComputation, Logic, Games, and Quantum Foundations
- 2013
We give an algebraic presentation of directed acyclic graph structure, introducing a symmetric monoidal equational theory whose free PROP we characterise as that of finite abstract dags with…
Control and Composability in Deep Learning — Brief Overview by a Learner
- Springer Proceedings in Mathematics & Statistics
- 2020