Machine Learning and Neural Networks had a considerable development in the last years. In 1989, K. Hornik, M. Stinchcombe and H. White published a paper named “Multilayer Feed-forward Networks are Universal Approximators” where they proved a theorem of density for feedforward neural networks. What they show is that the space of functions that can be represented as $f(x) = \sum_{i=1}^q = \beta_i G(A_i(x))$ for some special $G : R \mapsto R$ is uniformly dense on compacta in the space of continuous function and dense in measure in the space of measurable functions. In this talk I would like to retrace their work. I will give some basic concepts about Machine Learning and Neural Networks, and I will walk through all proofs the authors presented to get this density result. In the final part I will show some consequences of this theorem.
You are here
A density theorem for Feed-forward Neural Networks
Research Group:
Speaker:
Luca Benatti
Institution:
SISSA
Schedule:
Wednesday, May 30, 2018 - 16:00
Location:
A-136
Abstract:
Openings
- Call of interest for positions in mathematics at SISSA
- Public Calls for Professors
- Temporary Researchers
- Post Doctoral Fellowships
- Open positions in MathLab
- SISSA Mathematical Fellowships
- PhD Scolarships
- SIS Fellowships
- Pre-PhD Fellowships
- MSc in Mathematics
- Master Degree in Data Science and Scientific Computing
- Professional Master Courses
- SISSA Mathematics Medals
Upcoming events
-
Valentina Beorchia, Valeria Chiadò Piat, Maria Strazullo
SISSA Women in Mathematics 2024
Monday, May 13, 2024 - 14:15
-
Antonio De Rosa
Min-max construction of anisotropic CMC surfaces
Thursday, May 16, 2024 - 14:00 to 16:00
-
Mattia Fogagnolo
TBA
Thursday, May 30, 2024 - 14:00 to 16:00
-
Marco Pozzetta
TBA
Thursday, June 13, 2024 - 14:00 to 15:00
Today's Lectures
-
10:15 to 13:00
-
14:00 to 17:00
-
14:15 to 16:00
-
16:30 to 17:15
Recent publications
-
G.P. Leonardi; G. Saracco,Rigidity and trace properties...
-
R. Marchello; A. Colombi; L. Preziosi; C. Giverso,A non local model for cell mig...
-
I. Prusak; D. Torlo; M. Nonino; G. Rozza,Optimisation–Based Coupling of...
-
A.Surya Boiardi; R. Marchello,Breaking the left-right symmet...