We just published a paper on a Methodology for Comparing Optimization Algorithms for Auto-Tuning. Highly recommended if you work on any kind of optimization. This is the result of a community effort that started with a Lorentz Center workshop led by Ben van Werkhoven. First author of the paper is our PhD student Floris-Jan Willemsen. Great work Floris-Jan!