Deeplearninginneuralnetworks:AnoverviewInrecentyears,deepartificialneuralnetworks(includingrecurrentones)havewonnumerouscontestsinpatternrecognitionandmachinelearning.Thishistoricalsurveycompactlysummarizesrelevantwork,muchofitfromthepreviousmillennium.ShallowandDeepLearnersaredistinguishedbythedepthoftheircreditassignmentpaths,whicharechainsofpossiblylearnable,causallinksbetweenactionsandeffects.Ireviewdeepsupervisedlearning(alsorecapitulatingthehistoryofbackpropagation),unsupervisedlearning,reinforcementlearning&evolutionarycomputation,andindirectsearchforshortprogramsencodingdeepandlargenetworks.
1