Singularities of Three-Layered Complex-Valued Neural Networks With Split Activation Function

@article{Kobayashi2018SingularitiesOT,
  title={Singularities of Three-Layered Complex-Valued Neural Networks With Split Activation Function},
  author={Masaki Kobayashi},
  journal={IEEE Transactions on Neural Networks and Learning Systems},
  year={2018},
  volume={29},
  pages={1900-1907}
}
There are three important concepts related to learning processes in neural networks: reducibility, nonminimality, and singularity. Although the definitions of these three concepts differ, they are equivalent in real-valued neural networks. This is also true of complex-valued neural networks (CVNNs) with hidden neurons not employing biases. The situation of CVNNs with hidden neurons employing biases, however, is very complicated. Exceptional reducibility was found, and it was shown that… CONTINUE READING