Mid Sweden University

miun.sePublications
Operational message
There are currently operational disruptions. Troubleshooting is in progress.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Recent Development in Automatic Parameter Tuning for Metaheuristics
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information Technology and Media.ORCID iD: 0000-0001-9372-3416
2010 (English)In: Proceedings of the 19th Annual Conference of Doctoral Students - WDS 2010 / [ed] J. Safrankova and J. Pavlu, 2010, p. -10Conference paper, Published paper (Refereed)
Abstract [en]

Parameter tuning is an optimization problem with the objective of finding good static pa-rameter settings before the execution of a metaheuristic on a problem at hand. The requirementof tuning multiple control parameters, combined with the stochastic nature of the algorithms,make parameter tuning a non-trivial problem. To make things worse, one parameter vector allowing the algorithm to solve all optimization problems to the best of its potential is verifiable non-existent, as can be inferred from the no free lunch theorem of optimization. Manual tuning can be conducted, with the drawback of being very time consuming and failure prone. Hence, means for automated parameter tuning are required. This paper serves as an overview about recent work within the field of automated parameter tuning.

Place, publisher, year, edition, pages
2010. p. -10
Keywords [en]
Parameter tuning, metaheuristics, optimization
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:miun:diva-12173OAI: oai:DiVA.org:miun-12173DiVA, id: diva2:360019
Conference
Proceedings of the 19th Annual Conference of Doctoral Students - WDS 2010
Available from: 2010-11-01 Created: 2010-11-01 Last updated: 2025-09-25Bibliographically approved
In thesis
1. Automatic Instance-based Tailoring of Parameter Settings for Metaheuristics
Open this publication in new window or tab >>Automatic Instance-based Tailoring of Parameter Settings for Metaheuristics
2011 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Many industrial problems in various fields, such as logistics, process management, orproduct design, can be formalized and expressed as optimization problems in order tomake them solvable by optimization algorithms. However, solvers that guarantee thefinding of optimal solutions (complete) can in practice be unacceptably slow. Thisis one of the reasons why approximative (incomplete) algorithms, producing near-optimal solutions under restrictions (most dominant time), are of vital importance.

Those approximative algorithms go under the umbrella term metaheuristics, each of which is more or less suitable for particular optimization problems. These algorithmsare flexible solvers that only require a representation for solutions and an evaluation function when searching the solution space for optimality.What all metaheuristics have in common is that their search is guided by certain control parameters. These parameters have to be manually set by the user andare generally problem and interdependent: A setting producing near-optimal resultsfor one problem is likely to perform worse for another. Automating the parameter setting process in a sophisticated, computationally cheap, and statistically reliable way is challenging and a significant amount of attention in the artificial intelligence and operational research communities. This activity has not yet produced any major breakthroughs concerning the utilization of problem instance knowledge or the employment of dynamic algorithm configuration.

The thesis promotes automated parameter optimization with reference to the inverse impact of problem instance diversity on the quality of parameter settings with respect to instance-algorithm pairs. It further emphasizes the similarities between static and dynamic algorithm configuration and related problems in order to show how they relate to each other. It further proposes two frameworks for instance-based algorithm configuration and evaluates the experimental results. The first is a recommender system for static configurations, combining experimental design and machine learning. The second framework can be used for static or dynamic configuration,taking advantage of the iterative nature of population-based algorithms, which is a very important sub-class of metaheuristics.

A straightforward implementation of framework one did not result in the expected improvements, supposedly because of pre-stabilization issues. The second approach shows competitive results in the scenario when compared to a state-of-the-art model-free configurator, reducing the training time by in excess of two orders of magnitude.

Place, publisher, year, edition, pages
Östersund: Mid Sweden University, 2011. p. 62
Series
Mid Sweden University licentiate thesis, ISSN 1652-8948 ; 67
Keywords
Algorithm Configuration, Parameter Tuning, Parameter Control, Metaheuristics
National Category
Engineering and Technology
Identifiers
urn:nbn:se:miun:diva-14613 (URN)978-91-86694-48-7 (ISBN)
Presentation
2011-10-14, Q221, Akademigatan 1, Östersund, 22:41 (English)
Opponent
Supervisors
Available from: 2011-10-17 Created: 2011-10-16 Last updated: 2025-09-25Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

http://www.mff.cuni.cz/veda/konference/wds/proc/proc-contents.php?year=2010

Authority records

Dobslaw, Felix

Search in DiVA

By author/editor
Dobslaw, Felix
By organisation
Department of Information Technology and Media
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 1337 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf