Commit Graph

27 Commits

Author SHA1 Message Date
Jędrzej Boczar a27841199b test: option to print heartbeat during benchmarks to avoid Travis timeouts 2020-02-19 13:08:04 +01:00
Jędrzej Boczar d14254124a test: run benchmarks in Travis CI and deploy the results 2020-02-17 14:46:50 +01:00
Jędrzej Boczar b7ed91d9f0 test: suppress info log messages in benchmark runner 2020-02-17 13:14:52 +01:00
Jędrzej Boczar c6cc0e068d test: keep benchmark failures in data frame and filter out when needed 2020-02-17 09:07:13 +01:00
Jędrzej Boczar bba49f2df8 test: add generation of html benchmarks summary 2020-02-17 09:07:13 +01:00
Jędrzej Boczar dd12a78587 test: reduce disk usage when running benchmarks in parallel 2020-02-13 10:30:48 +01:00
Jędrzej Boczar 4f613b5b00 test: add number of generators/checkers to benchmark runner, update metrics 2020-02-12 14:40:33 +01:00
Jędrzej Boczar 6744cf649c test: add handling of alternating write/read to benchmark runner 2020-02-11 13:10:04 +01:00
Jędrzej Boczar e16118abfd test: fix: use of undeclared variable 2020-02-11 12:13:37 +01:00
Jędrzej Boczar 9148400ef5 test: fix typo, add note about limitations 2020-02-07 12:20:43 +01:00
Jędrzej Boczar 2825c080a9 test: fix problem with plot labels overlapping for large number of benchmarks 2020-02-07 09:52:31 +01:00
Jędrzej Boczar 77541c3670 test: avoid instantiating LiteDRAMBenchmarkSoC to speed up summary generation 2020-02-06 15:08:01 +01:00
Jędrzej Boczar 027034db49 test: add option to run benchmarks as parallel jobs 2020-02-06 15:07:55 +01:00
Jędrzej Boczar 1702e2ad7c test: update summary to work for all configurations (use pandas) 2020-02-05 18:39:06 +01:00
Jędrzej Boczar f9f86d507f test: update benchmark configuration to account for access pattern 2020-02-05 12:54:33 +01:00
Jędrzej Boczar bae046f143 test: add read/write latency benchmarks 2020-02-03 16:59:12 +01:00
Jędrzej Boczar a584923f1c test: use JSON instead of pickle for storing benchmarks cache 2020-02-03 12:17:41 +01:00
Florent Kermarrec 736723cc98 test/run_benchmarks: change YAML config file argument 2020-02-03 10:38:10 +01:00
Florent Kermarrec 7e95ecc9a9 test/run_benchmark: avoid Python 3.7+ dependency 2020-02-03 10:37:10 +01:00
Jędrzej Boczar 811c73254b test: benchmark script exits with error on any checker error 2020-01-31 15:16:37 +01:00
Jędrzej Boczar 1a517a308d test: cache benchmark results to be able to produce multiple summaries 2020-01-31 14:39:41 +01:00
Jędrzej Boczar a40817f3a8 test: add plotting of benchmark results 2020-01-31 14:39:41 +01:00
Jędrzej Boczar f6973aa9d7 test: load benchmark configurations from YAML file 2020-01-30 15:39:29 +01:00
Jędrzej Boczar 096de78c63 test: fix `setup.py test` failing due to import error
because of relative import the script has to be run as:
    python -m test.run_benchmarks
2020-01-30 14:11:52 +01:00
Jędrzej Boczar bb4f6106ee test: print benchmarks summary 2020-01-30 10:50:08 +01:00
Jędrzej Boczar e822e6be9f test: calculate benchmark bandwidth and efficiency 2020-01-30 10:19:17 +01:00
Jędrzej Boczar 804a9b3727 test: add script for running multiple benchmarks and parsing results 2020-01-29 17:03:20 +01:00