A thorough and convincing evaluation is a core part of every systems paper, and generally involves some form of benchmarking. In my experience as a reviewer of hundreds of papers, there are a number of things people frequently get wrong in their evaluation. I have distilled those into a list of systems benchmarking crimes, most of which are sufficient reason to reject a paper. I will discuss those crimes and how to avoid them.
slides - BM_crimes.pdf