Machine Learning and Neural Networks had a considerable development in the last years. In 1989, K. Hornik, M. Stinchcombe and H. White published a paper named “Multilayer Feedforward Networks are Universal Approximators” where they proved a theorem of density for feedforward neural networks. What they show is that the space of functions that can be represented as $f(x) = \sum_{i=1}^q = \beta_i G(A_i(x))$ for some special $G : R \mapsto R$ is uniformly dense on compacta in the space of continuous function and dense in measure in the space of measurable functions. In this talk I would like to retrace their work. I will give some basic concepts about Machine Learning and Neural Networks, and I will walk through all proofs the authors presented to get this density result. In the final part I will show some consequences of this theorem.
You are here
A density theorem for Feedforward Neural Networks
Research Group:
Luca Benatti
Institution:
SISSA
Location:
A136
Schedule:
Wednesday, May 30, 2018  16:00
Abstract:
Openings
 Public calls for academic personnel (Permanent positions)
 Professors (Temporary/Researchers/Visiting Professors)
 SISSA Mathematical Fellowships
 Post Doctoral Fellowships
 PhD Scholarships
 Call for Applications (PhD)
 Undergraduate Fellowships
 Postgraduate Fellowships
 Master of Science in Mathematics
 Marie SklodowskaCurie Grants
Upcoming events

Mahmoud Gadalla
Shape Optimization and Reduced Order Models for the Hydroacoustic Design of Marine Propellers.
Thursday, September 27, 2018  15:00

Enrico Schlitzer
Moduli spaces of hypersurfaces in P^n
Tuesday, October 2, 2018  11:00

Luca Migliorini
Supports of the Hitchin fibration on the reduced locus
Tuesday, October 2, 2018  14:30

JeanPierre Demailly
Analytic and arithmetic solutions of algebraic equations
Wednesday, October 3, 2018  16:00
Recent publications

G. Dal Maso; G. Franzina; D. Zucco,Transmission conditions obtain...

S. Hijazi; S. Ali; G. Stabile; F. Ballarin; G. Rozza,{The Effort of Increasing Reyn...

M.W. Hess; A. Alla; A. Quaini; G. .Rozza; M. Gunzburger,{ A Localized ReducedOrder Mo...

G. Dal Maso; C.J. Larsen; R. Toader,Existence for elastodynamic Gr...