Clever Algorithms, Nature-Inspired Programming Recipies - Jason Brownlee Clever Algorithms Nature-Inspired Programming Recipes ii Jason Brownlee PhD

Clever Algorithms, Nature-Inspired Programming Recipies -...

This preview shows page 1 - 6 out of 436 pages.

Jason BrownleeClever AlgorithmsNature-Inspired Programming Recipes
iiJason Brownlee, PhDJason Brownlee studied Applied Science at Swinburne University in Melbourne,Australia, going on to complete a Masters in Information Technology focusing onNiching Genetic Algorithms, and a PhD in the field of Artificial Immune Systems.Jason has worked for a number of years as a Consultant and Software Engineerfor a range of Corporate and Government organizations. When not writing books,Jason likes to compete in Machine Learning competitions.Cover ImageCopyright 2011 Jason Brownlee. All Reserved.Clever Algorithms: Nature-Inspired Programming RecipesCopyright 2011 Jason Brownlee. Some Rights Reserved.First Edition. LuLu. January 2011ISBN: 978-1-4467-8506-5This work is licensed under a Creative CommonsAttribution-Noncommercial-Share Alike 2.5 Australia License.The full terms of the license are located online atWebpageSource code and additional resources can be downloaded from the bookscompanion website online at
ContentsForewordviiPrefaceixIBackground11Introduction31.1What is AI. . . . . . . . . . . . . . . . . . . . . . . . . . .31.2Problem Domains. . . . . . . . . . . . . . . . . . . . . . . .91.3Unconventional Optimization. . . . . . . . . . . . . . . . .131.4Book Organization. . . . . . . . . . . . . . . . . . . . . . .161.5How to Read this Book. . . . . . . . . . . . . . . . . . . .191.6Further Reading. . . . . . . . . . . . . . . . . . . . . . . .201.7Bibliography. . . . . . . . . . . . . . . . . . . . . . . . . .21IIAlgorithms272Stochastic Algorithms292.1Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . .292.2Random Search. . . . . . . . . . . . . . . . . . . . . . . . .302.3Adaptive Random Search. . . . . . . . . . . . . . . . . . .342.4Stochastic Hill Climbing. . . . . . . . . . . . . . . . . . . .392.5Iterated Local Search. . . . . . . . . . . . . . . . . . . . . .432.6Guided Local Search. . . . . . . . . . . . . . . . . . . . . .492.7Variable Neighborhood Search. . . . . . . . . . . . . . . . .552.8Greedy Randomized Adaptive Search. . . . . . . . . . . . .602.9Scatter Search. . . . . . . . . . . . . . . . . . . . . . . . .662.10 Tabu Search. . . . . . . . . . . . . . . . . . . . . . . . . . .732.11 Reactive Tabu Search. . . . . . . . . . . . . . . . . . . . .79iii
ivContents3Evolutionary Algorithms873.1Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . .873.2Genetic Algorithm. . . . . . . . . . . . . . . . . . . . . . .923.3Genetic Programming. . . . . . . . . . . . . . . . . . . . .993.4Evolution Strategies. . . . . . . . . . . . . . . . . . . . . .1083.5Differential Evolution. . . . . . . . . . . . . . . . . . . . .1143.6Evolutionary Programming. . . . . . . . . . . . . . . . . .1203.7Grammatical Evolution. . . . . . . . . . . . . . . . . . . .1263.8Gene Expression Programming. . . . . . . . . . . . . . . .1343.9Learning Classifier System. . . . . . . . . . . . . . . . . . .1413.10 Non-dominated Sorting Genetic Algorithm. . . . . . . . . .1523.11 Strength Pareto Evolutionary Algorithm. . . . . . . . . . .1604Physical Algorithms1674.1Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . .1674.2Simulated Annealing. . . . . . . . . . . . . . . . . . . . . .1694.3Extremal Optimization. . . . . . . . . . . . . . . . . . . . .1754.4Harmony Search. . . . . . . . . . . . . . . . . . . . . . . .1824.5Cultural Algorithm. . . . . . . . . . . . . . . . . . . . . . .1874.6Memetic Algorithm. . . . . . . . . . . . . . . . . . . . . . .1935Probabilistic Algorithms1995.1Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . .1995.2Population-Based Incremental Learning. . . . . . . . . . .2035.3Univariate Marginal Distribution Algorithm. . . . . . . . .2085.4Compact Genetic Algorithm. . . . . . . . . . . . . . . . . .2125.5Bayesian Optimization Algorithm. . . . . . . . . . . . . . .2165.6Cross-Entropy Method. . . . . . . . . . . . . . . . . . . . .2246Swarm Algorithms2296.1Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . .2296.2Particle Swarm Optimization. . . . . . . . . . . . . . . . .2326.3Ant System. . . . . . . . . . . . . . . . . . . . . . . . . . .2386.4Ant Colony System. . . . . . . . . . . . . . . . . . . . . . .2456.5Bees Algorithm. . . . . . . . . . . . . . . . . . . . . . . . .2526.6Bacterial Foraging Optimization Algorithm. . . . . . . . .2577Immune Algorithms2657.1Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . .2657.2Clonal Selection Algorithm. . . . . . . . . . . . . . . . . .2707.3Negative Selection Algorithm. . . . . . . . . . . . . . . . .2777.4Artificial Immune Recognition System. . . . . . . . . . . .2847.5Immune Network Algorithm. . . . . . . . . . . . . . . . . .2927.6Dendritic Cell Algorithm. . . . . . . . . . . . . . . . . . . .299
v8Neural Algorithms3078.1Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . .3078.2Perceptron. . . . . . . . . . . . . . . . . . . . . . . . . . .3118.3Back-propagation. . . . . . . . . . . . . . . . . . . . . . . .3168.4Hopfield Network. . . . . . . . . . . . . . . . . . . . . . . .3248.5Learning Vector Quantization. . . . . . . . . . . . . . . . .3308.6Self-Organizing Map. . . . . . . . . . . . . . . . . . . . . .336IIIExtensions3439Advanced Topics3459.1Programming Paradigms. . . . . . . . . . . . . . . . . . . .3469.2Devising New Algorithms. . . . . . . . . . . . . . . . . . .3569.3Testing Algorithms. . . . . . . . . . . . . . . . . . . . . . .3679.4Visualizing Algorithms

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture