UT Martin Competitive Programming Guidebook

User Tools

Site Tools

Trace: • hello • benchmarks
appendix:guidebook_authoring:benchmarks

This is an old revision of the document!

Table of Contents

Guidebook Benchmarks

Standards

5 Is the Number

  • Each test case should be run 5 times, and averaged.
    • 5 may seem somewhat arbitrary because it is.
    • We needed a standard, so we selected one.
    • 5 tests can be easily run by hand, and averaged by hand.
      • Automation scripts will create many additional files to be maintained to ensure completeness.
    • For many examples, > 5 test will not change results significantly.1)2)
  • Only display the average.

Present Results in Seconds

Make a Change -> Rerun All Tests

1)
In our own tests this appears to hold true.
2)
If your own tests for a particular example vary wildly, it is possible that your source/tests should be adjusted to compensate and hone in on what you are trying to tests.
appendix/guidebook_authoring/benchmarks.1534367817.txt.gz · Last modified: 2018/08/15 16:16 by jguerin

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial-Share Alike 4.0 International
CC Attribution-Noncommercial-Share Alike 4.0 International Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki