Differences

This shows you the differences between two versions of the page.

--- appendix:guidebook_authoring:benchmarks [2018/08/15 16:53]
jguerin Added notes about rerunning all tests after a change.
+++ appendix:guidebook_authoring:benchmarks [2018/08/15 17:01] (current)
jguerin Added information about presentation of results.
@@ Line 15: / Line 15: @@
 ==== Present Results in Seconds ====
+  * Consistency means little chance of misreading.
+  * Stick to the convention of displaying 3 places after the decimal.
+  * Avoid results that would be //time limit exceeded// wherever possible.
+    * 1s is a good cutoff for many purposes, 2s for some others.
+    * For a single column a ''-'' will suffice.
+    * Entire rows can be omitted when warranted.
+    * Ignore this rule if it will mislead the reader.
+      * E.g., If the last row is 10<sup>5</sup> at .030s, one would likely expect 10<sup>6</sup> to be .300 if the trend otherwise appears linear. If 10<sup>6</sup> is //actually// 2 seconds (for reasons we cannot control), this is important information for the reader.
+    * Ignore this rule if insufficient data would otherwise be presented.
+      * A table with a single row is not typically useful. A table with a row at 0s, a row at //almost// 0s, and no other rows is also likely to be misleading.
 ==== Make a Change -> Rerun All Tests ====

UT Martin Competitive Programming Guidebook