Informationtheoryandinference,taughttogetherinthisexcitingtextbook,lieattheheartofmanyimportantareasofmoderntechnology-co妹妹unication,signalprocessing,datamining,machinelearning,patternrecognition,computationalneuroscience,bioinformaticsandcryptography.Thebookintroducestheoryintandemwithapplications.Informationtheoryistaughtalongsidepracticalco妹妹unicationsystemssuchasarithmeticcodingfordatacompressionandsparse-graphcodesforerror-correction.Inferencetechniques,includingmessage-passingalgorithms,MonteCarlomethodsandvariationalapproximations,aredevelopedalongsideapplicationstoclustering,convolutionalcodes,independentcomponentanalysis,andneuralnetworks.Uniquely,thebookcoversstate-of-the-arterror-correctingcodes,includinglow-density-parity-checkcodes,turbocodes,anddigitalfountaincodes-thetwenty-first-centurystandardsforsatelliteco妹妹unications,diskdrives,anddatabroadcast.Richlyillustrated,filledwithworkedexamplesandover400exercises,somewithdetailedsolutions,thebookisidealforself-learning,andforundergraduateorgraduatecourses.Italsoprovidesanunparalleledentrypointforprofessionalsinareasasdiverseascomputationalbiology,financialengineeringandmachinelearning.
1