Jędrzej Boczar
|
c8423a08a3
|
test: exit with failure when no benchmarks succeeded
|
2020-03-12 14:16:21 +01:00 |
Karol Gugala
|
2ce64bd5fb
|
Fix copyrights
Signed-off-by: Karol Gugala <kgugala@antmicro.com>
Signed-off-by: Mateusz Holenko <mholenko@antmicro.com>
|
2020-03-05 17:40:21 +01:00 |
enjoy-digital
|
87578dd2e3
|
Merge pull request #153 from antmicro/jboc/issue-151
test/benchmarks: add memtype to summary (#151)
|
2020-02-20 14:00:27 +01:00 |
|
Jędrzej Boczar
|
19cbf7d967
|
test/benchmarks: add memtype to summary (#151)
|
2020-02-20 13:36:49 +01:00 |
|
Jędrzej Boczar
|
a5d2c09e8f
|
test: add benchmark timeout parameter
|
2020-02-20 09:33:09 +01:00 |
|
Jędrzej Boczar
|
a27841199b
|
test: option to print heartbeat during benchmarks to avoid Travis timeouts
|
2020-02-19 13:08:04 +01:00 |
|
Jędrzej Boczar
|
d14254124a
|
test: run benchmarks in Travis CI and deploy the results
|
2020-02-17 14:46:50 +01:00 |
|
Jędrzej Boczar
|
b7ed91d9f0
|
test: suppress info log messages in benchmark runner
|
2020-02-17 13:14:52 +01:00 |
|
Jędrzej Boczar
|
c6cc0e068d
|
test: keep benchmark failures in data frame and filter out when needed
|
2020-02-17 09:07:13 +01:00 |
|
Jędrzej Boczar
|
bba49f2df8
|
test: add generation of html benchmarks summary
|
2020-02-17 09:07:13 +01:00 |
|
Jędrzej Boczar
|
dd12a78587
|
test: reduce disk usage when running benchmarks in parallel
|
2020-02-13 10:30:48 +01:00 |
|
Jędrzej Boczar
|
4f613b5b00
|
test: add number of generators/checkers to benchmark runner, update metrics
|
2020-02-12 14:40:33 +01:00 |
|
Jędrzej Boczar
|
6744cf649c
|
test: add handling of alternating write/read to benchmark runner
|
2020-02-11 13:10:04 +01:00 |
|
Jędrzej Boczar
|
e16118abfd
|
test: fix: use of undeclared variable
|
2020-02-11 12:13:37 +01:00 |
|
Jędrzej Boczar
|
9148400ef5
|
test: fix typo, add note about limitations
|
2020-02-07 12:20:43 +01:00 |
|
Jędrzej Boczar
|
2825c080a9
|
test: fix problem with plot labels overlapping for large number of benchmarks
|
2020-02-07 09:52:31 +01:00 |
|
Jędrzej Boczar
|
77541c3670
|
test: avoid instantiating LiteDRAMBenchmarkSoC to speed up summary generation
|
2020-02-06 15:08:01 +01:00 |
|
Jędrzej Boczar
|
027034db49
|
test: add option to run benchmarks as parallel jobs
|
2020-02-06 15:07:55 +01:00 |
|
Jędrzej Boczar
|
1702e2ad7c
|
test: update summary to work for all configurations (use pandas)
|
2020-02-05 18:39:06 +01:00 |
|
Jędrzej Boczar
|
f9f86d507f
|
test: update benchmark configuration to account for access pattern
|
2020-02-05 12:54:33 +01:00 |
|
Jędrzej Boczar
|
bae046f143
|
test: add read/write latency benchmarks
|
2020-02-03 16:59:12 +01:00 |
|
Jędrzej Boczar
|
a584923f1c
|
test: use JSON instead of pickle for storing benchmarks cache
|
2020-02-03 12:17:41 +01:00 |
|
Florent Kermarrec
|
736723cc98
|
test/run_benchmarks: change YAML config file argument
|
2020-02-03 10:38:10 +01:00 |
|
Florent Kermarrec
|
7e95ecc9a9
|
test/run_benchmark: avoid Python 3.7+ dependency
|
2020-02-03 10:37:10 +01:00 |
|
Jędrzej Boczar
|
811c73254b
|
test: benchmark script exits with error on any checker error
|
2020-01-31 15:16:37 +01:00 |
|
Jędrzej Boczar
|
1a517a308d
|
test: cache benchmark results to be able to produce multiple summaries
|
2020-01-31 14:39:41 +01:00 |
|
Jędrzej Boczar
|
a40817f3a8
|
test: add plotting of benchmark results
|
2020-01-31 14:39:41 +01:00 |
|
Jędrzej Boczar
|
f6973aa9d7
|
test: load benchmark configurations from YAML file
|
2020-01-30 15:39:29 +01:00 |
|
Jędrzej Boczar
|
096de78c63
|
test: fix `setup.py test` failing due to import error
because of relative import the script has to be run as:
python -m test.run_benchmarks
|
2020-01-30 14:11:52 +01:00 |
|
Jędrzej Boczar
|
bb4f6106ee
|
test: print benchmarks summary
|
2020-01-30 10:50:08 +01:00 |
|
Jędrzej Boczar
|
e822e6be9f
|
test: calculate benchmark bandwidth and efficiency
|
2020-01-30 10:19:17 +01:00 |
|
Jędrzej Boczar
|
804a9b3727
|
test: add script for running multiple benchmarks and parsing results
|
2020-01-29 17:03:20 +01:00 |