Unknown

Dataset Information

0

Machine learning in spectral domain.


ABSTRACT: Deep neural networks are usually trained in the space of the nodes, by adjusting the weights of existing links via suitable optimization protocols. We here propose a radically new approach which anchors the learning process to reciprocal space. Specifically, the training acts on the spectral domain and seeks to modify the eigenvalues and eigenvectors of transfer operators in direct space. The proposed method is ductile and can be tailored to return either linear or non-linear classifiers. Adjusting the eigenvalues, when freezing the eigenvectors entries, yields performances that are superior to those attained with standard methods restricted to operate with an identical number of free parameters. To recover a feed-forward architecture in direct space, we have postulated a nested indentation of the eigenvectors. Different non-orthogonal basis could be employed to export the spectral learning to other frameworks, as e.g. reservoir computing.

SUBMITTER: Giambagli L 

PROVIDER: S-EPMC7910623 | biostudies-literature | 2021 Feb

REPOSITORIES: biostudies-literature

altmetric image

Publications

Machine learning in spectral domain.

Giambagli Lorenzo L   Buffoni Lorenzo L   Carletti Timoteo T   Nocentini Walter W   Fanelli Duccio D  

Nature communications 20210226 1


Deep neural networks are usually trained in the space of the nodes, by adjusting the weights of existing links via suitable optimization protocols. We here propose a radically new approach which anchors the learning process to reciprocal space. Specifically, the training acts on the spectral domain and seeks to modify the eigenvalues and eigenvectors of transfer operators in direct space. The proposed method is ductile and can be tailored to return either linear or non-linear classifiers. Adjust  ...[more]

Similar Datasets

| S-EPMC8227725 | biostudies-literature
| S-EPMC7706329 | biostudies-literature
| S-EPMC6277435 | biostudies-other
2013-01-01 | E-GEOD-29210 | biostudies-arrayexpress
| S-EPMC10466194 | biostudies-literature
| S-EPMC3381961 | biostudies-literature
| S-EPMC7902724 | biostudies-literature
| S-EPMC6275787 | biostudies-literature
| S-EPMC6403242 | biostudies-other
| S-EPMC8248651 | biostudies-literature