Skip to Main content Skip to Navigation
Journal articles

The expressive power of analog recurrent neural networks on infinite input streams

Jérémie Cabessa 1, * Alessandro Villa 2, *
* Corresponding author
1 Inserm U836, équipe 7, Nanomédecine et cerveau
GIN - Grenoble Institut des Neurosciences
2 INSERM U836, équipe 7, Nanomédecine et cerveau
GIN - Grenoble Institut des Neurosciences, Department of Information Systems
Abstract : We consider analog recurrent neural networks working on in nite input streams, provide a complete topological characterization of their expressive power, and compare it to the expressive power of classical in nite word reading abstract machines. More precisely, we consider analog recurrent neural networks as language recognizers over the Cantor space, and prove that the classes of !-languages recognized by deterministic and non-deterministic analog networks correspond precisely to the respective classes of 02 -sets and 11 -sets of the Cantor space. Furthermore, we show that the result can be generalized to more expressive analog networks equipped with any kind of Borel accepting condition. Therefore, in the deterministic case, the expressive power of analog neural nets turns out to be comparable to the expressive power of any kind of Buchi abstract machine, whereas in the non-deterministic case, analog recurrent networks turn out to be strictly more expressive than any other kind of Buchi or Muller abstract machine, including the main cases of classical automata, 1-counter automata, k-counter automata, pushdown automata, and Turing machines.
Complete list of metadatas

Cited literature [30 references]  Display  Hide  Download

https://www.hal.inserm.fr/inserm-00851237
Contributor : Jean-Paul Issartel <>
Submitted on : Tuesday, August 13, 2013 - 10:03:07 AM
Last modification on : Friday, November 30, 2018 - 2:18:33 PM
Long-term archiving on: : Wednesday, April 5, 2017 - 8:40:16 PM

Files

Cabessa-2012_The_expressive_AE...
Files produced by the author(s)

Identifiers

Collections

UGA | U836

Citation

Jérémie Cabessa, Alessandro Villa. The expressive power of analog recurrent neural networks on infinite input streams. Theor Compt Sci, 2012, 436, pp.23-34. ⟨10.1016/j.tcs.2012.01.042⟩. ⟨inserm-00851237⟩

Share

Metrics

Record views

277

Files downloads

680