A quantitative analysis of estimation of distribution algorithms based on Bayesian networks

A quantitative analysis of estimation of distribution algorithms based on Bayesian networks” by C. Echegoyen, A. Mendiburu, R. Santana, and J. A. Lozano, Department of Computer Science and Artificial Intelligence. University of the Basque Country technical report EHU-KZAA-IK-3, Oct. 2009.


The successful application of estimation of distribution algorithms (EDAs) to solve different kinds of problems has reinforced their candidature as promising black-box optimization tools. However, their internal behavior is still not completely understood and therefore it is necessary to work in this direction in order to advance their development. This paper presents a new methodology of analysis which provides new information about the behavior of EDAs by quantitatively analyzing the probabilistic models learned during the search. We particularly focus on calculating the probabilities of the optimal solutions, the most probable solution given by the model and the best individual of the population at each step of the algorithm. We carry out the analysis by optimizing functions of different nature such as Trap5, two variants of Ising spin glass and Max-SAT. By using different structures in the probabilistic models, we also analyze the influence of the structural model accuracy in the quantitative behavior of EDAs. In addition, the objective function values of our analyzed key solutions are contrasted with their probability values in order to study the connection between function and probabilistic models. The results not only show information about the EDA behavior, but also about the quality of the optimization process and setup of the parameters, the relationship between the probabilistic model and the fitness function, and even about the problem itself. Furthermore, the results allow us to discover common patterns of behavior in EDAs and propose new ideas in the development of this type of algorithms.

BibTeX entry:

   author = {C. Echegoyen and A. Mendiburu and R. Santana and J. A. Lozano},
   title = {A quantitative analysis of estimation of distribution
	algorithms based on {B}ayesian networks},
   institution = {Department of Computer Science and Artificial
	Intelligence, University of the Basque Country},
   number = {EHU-KZAA-IK-3},
   month = oct,
   year = {2009},
   url = {https://addi.ehu.es/handle/10810/4626}

(This webpage was created with bibtex2web.)

Back to Roberto Santana publications.