Friday, February 24, 2012

Basis Functions

Hi... If somebody could answer us this:

"What are basis functions, what is the purpose of using them and how can we learn basis functions from data?"

Thank you.

1 comment:

  1. A basis function is just a function from R^n -> R, and if you combine a bunch of them (each one applied to the same input vector) you get a new space where classification may be easier (see e.g. fig 1 in this wonderful paper: http://cbcl.mit.edu/publications/ps/serre-poggio_%20ANeuromorphicApproachtoComputerVision_CACM_Oct2010.pdf ).

    Can be learnt from data by e.g. neural network (each hidden unit learns a basis function), Boltzmann machines, and others.

    ReplyDelete