How experimental algorithmics can benefit from Mayo's extensions to Neyman-Pearson theory of testing.