appendix:guidebook_authoring:benchmarks

This is an old revision of the document!

Table of Contents

Guidebook Benchmarks
- Standards

Guidebook Benchmarks

Standards

5 Is the Number

Each test case should be run 5 times, and averaged.
- 5 may seem somewhat arbitrary because it is.
- We needed a standard, so we selected one.
- 5 tests can be easily run by hand, and averaged by hand.
  - Automation scripts will create many additional files to be maintained to ensure completeness.
- For many examples, >5 test will not change results significantly.¹⁾
Only display the average.

Present Results in Seconds

Make a Change -> Rerun All Tests

¹⁾

In our own tests this

appendix/guidebook_authoring/benchmarks.1534367713.txt.gz · Last modified: 2018/08/15 16:15 by kericson