Machine Learning and Neural Networks had a considerable development in the last years. In 1989, K. Hornik, M. Stinchcombe and H. White published a paper named “Multilayer Feedforward Networks are Universal Approximators” where they proved a theorem of density for feedforward neural networks. What they show is that the space of functions that can be represented as $f(x) = \sum_{i=1}^q = \beta_i G(A_i(x))$ for some special $G : R \mapsto R$ is uniformly dense on compacta in the space of continuous function and dense in measure in the space of measurable functions. In this talk I would like to retrace their work. I will give some basic concepts about Machine Learning and Neural Networks, and I will walk through all proofs the authors presented to get this density result. In the final part I will show some consequences of this theorem.
You are here
A density theorem for Feedforward Neural Networks
Research Group:
Luca Benatti
Institution:
SISSA
Location:
A136
Schedule:
Wednesday, May 30, 2018  16:00
Abstract:
Openings
 Public Calls for Professors
 Temporary Professors/Researchers/Visiting Professors
 SISSA Mathematical Fellowships
 Marie SklodowskaCurie Grants
 Post Doctoral Fellowships
 PhD Scolarships
 SIS Fellowships
 Undergraduate Fellowships
 Postgraduate Fellowships
 MSc in Mathematics
 MSc in Data Science and Scientific Computing (DSSC)
 Professional Master Courses
Upcoming events

Andrew Kels
Hypergeometric integrals in integrable systems
Wednesday, December 19, 2018  14:00

Mattia Bacca
A model for the contraction of polymer gels created by the activity of molecular motors
Thursday, December 20, 2018  11:00

Andrea Mondino
Some smooth applications of nonsmooth Ricci curvature lower bounds
Tuesday, January 8, 2019  14:30

Lorenzo Mazzieri
Minkowski inequality for mean convex domains
Thursday, January 10, 2019  14:00
Today's Lectures

Giovanni Noselli
11:00 to 13:00

Guido De Philippis
14:00 to 16:00

Alberto Sartori
14:00 to 16:00

Gianni Dal Maso
16:00 to 18:00

Luca Heltai  Gianluigi Rozza
16:00 to 18:00
Recent publications

M. Tezzele; N. Demo; M. Gadalla; A. Mola; G. Rozza,Model Order Reduction by means...

F. Salmoiraghi; A. Scardigli; H. Telib; G. Rozza,Freeform deformation, mesh mo...

A. Michelangeli; A. Ottolini; R. Scandone,Fractional powers and singular...

N. Demo; M. Tezzele; G. Gustin; G. Lavini; G. Rozza,Shape Optimization by means of...