Commit Graph

159 Commits

Author SHA1 Message Date
Jędrzej Boczar c8423a08a3 test: exit with failure when no benchmarks succeeded 2020-03-12 14:16:21 +01:00
Jędrzej Boczar 92daf53ea2 test: fix with_uart parameter (see litex/b29f443f) 2020-03-12 14:16:21 +01:00
Jędrzej Boczar b89ecdf919 test: add _LiteDRAMBISTGenerator tests 2020-03-11 15:38:13 +01:00
Karol Gugala 2ce64bd5fb Fix copyrights
Signed-off-by: Karol Gugala <kgugala@antmicro.com>
Signed-off-by: Mateusz Holenko <mholenko@antmicro.com>
2020-03-05 17:40:21 +01:00
Florent Kermarrec 8fee3c7edf test/reference: update kc705 ddr3_init.h. 2020-03-05 11:35:12 +01:00
enjoy-digital 87578dd2e3
Merge pull request #153 from antmicro/jboc/issue-151
test/benchmarks: add memtype to summary (#151)
2020-02-20 14:00:27 +01:00
enjoy-digital 4f9d6e413f
Merge pull request #152 from antmicro/jboc/benchmark
Benchmarks: add timeout parameter
2020-02-20 14:00:06 +01:00
Jędrzej Boczar 19cbf7d967 test/benchmarks: add memtype to summary (#151) 2020-02-20 13:36:49 +01:00
Jędrzej Boczar a5d2c09e8f test: add benchmark timeout parameter 2020-02-20 09:33:09 +01:00
Jędrzej Boczar 247722d97e test: fix wrong sorting in benchmarks summary 2020-02-20 09:20:38 +01:00
Jędrzej Boczar a27841199b test: option to print heartbeat during benchmarks to avoid Travis timeouts 2020-02-19 13:08:04 +01:00
enjoy-digital 5fb2b011d8
Merge pull request #146 from antmicro/jboc/benchmark
Benchmarks: Generate HTML summary and deploy it from Travis
2020-02-18 13:26:20 +01:00
Jędrzej Boczar d14254124a test: run benchmarks in Travis CI and deploy the results 2020-02-17 14:46:50 +01:00
Piotr Binkowski f0be039a34 test: add option to use sdram timing verifier in benchmarks 2020-02-17 14:35:15 +01:00
Jędrzej Boczar b7ed91d9f0 test: suppress info log messages in benchmark runner 2020-02-17 13:14:52 +01:00
Jędrzej Boczar c6cc0e068d test: keep benchmark failures in data frame and filter out when needed 2020-02-17 09:07:13 +01:00
Jędrzej Boczar bba49f2df8 test: add generation of html benchmarks summary 2020-02-17 09:07:13 +01:00
Jędrzej Boczar dd12a78587 test: reduce disk usage when running benchmarks in parallel 2020-02-13 10:30:48 +01:00
Jędrzej Boczar 5cd33f490f test: update benchmark configuration generator 2020-02-12 15:42:50 +01:00
Jędrzej Boczar 4f613b5b00 test: add number of generators/checkers to benchmark runner, update metrics 2020-02-12 14:40:33 +01:00
Jędrzej Boczar edf4ddb2f2 test: add option to use multiple BIST generators/checkers 2020-02-12 14:40:33 +01:00
Jędrzej Boczar 45633e55b5 test: update BIST generator and checker tests 2020-02-11 14:24:02 +01:00
Jędrzej Boczar 409b9922ea test: add random address generation in benchmarks 2020-02-11 13:11:06 +01:00
Jędrzej Boczar 6744cf649c test: add handling of alternating write/read to benchmark runner 2020-02-11 13:10:04 +01:00
Jędrzej Boczar e16118abfd test: fix: use of undeclared variable 2020-02-11 12:13:37 +01:00
Jędrzej Boczar ff435fd26e test: add option to run benchmarks with alternating write/read 2020-02-11 12:06:45 +01:00
Jędrzej Boczar 9148400ef5 test: fix typo, add note about limitations 2020-02-07 12:20:43 +01:00
Jędrzej Boczar 2825c080a9 test: fix problem with plot labels overlapping for large number of benchmarks 2020-02-07 09:52:31 +01:00
Jędrzej Boczar 77541c3670 test: avoid instantiating LiteDRAMBenchmarkSoC to speed up summary generation 2020-02-06 15:08:01 +01:00
Jędrzej Boczar 027034db49 test: add option to run benchmarks as parallel jobs 2020-02-06 15:07:55 +01:00
Jędrzej Boczar 62a5473ecd test: update script for generating benchmark configurations 2020-02-06 13:35:34 +01:00
Jędrzej Boczar 8ba3cced60 test: add new benchmark configuratiosns to example configuration file 2020-02-05 18:58:49 +01:00
Jędrzej Boczar 1702e2ad7c test: update summary to work for all configurations (use pandas) 2020-02-05 18:39:06 +01:00
Jędrzej Boczar f9f86d507f test: update benchmark configuration to account for access pattern 2020-02-05 12:54:33 +01:00
Jędrzej Boczar 7e0515c477 test: fix problem with helper scripts being executed by `setup.py test` 2020-02-04 16:37:26 +01:00
Jędrzej Boczar fcd3d4ff6c test: helper scripts for generating benchmark configurations/access patterns 2020-02-04 16:26:57 +01:00
Jędrzej Boczar fcbcd4d3fe test: add option to benchmark predefined access patterns 2020-02-04 16:26:57 +01:00
Jędrzej Boczar bae046f143 test: add read/write latency benchmarks 2020-02-03 16:59:12 +01:00
Jędrzej Boczar a584923f1c test: use JSON instead of pickle for storing benchmarks cache 2020-02-03 12:17:41 +01:00
Florent Kermarrec 736723cc98 test/run_benchmarks: change YAML config file argument 2020-02-03 10:38:10 +01:00
Florent Kermarrec 7e95ecc9a9 test/run_benchmark: avoid Python 3.7+ dependency 2020-02-03 10:37:10 +01:00
Jędrzej Boczar 811c73254b test: benchmark script exits with error on any checker error 2020-01-31 15:16:37 +01:00
Jędrzej Boczar 1a517a308d test: cache benchmark results to be able to produce multiple summaries 2020-01-31 14:39:41 +01:00
Jędrzej Boczar a40817f3a8 test: add plotting of benchmark results 2020-01-31 14:39:41 +01:00
Jędrzej Boczar f6973aa9d7 test: load benchmark configurations from YAML file 2020-01-30 15:39:29 +01:00
Jędrzej Boczar 096de78c63 test: fix `setup.py test` failing due to import error
because of relative import the script has to be run as:
    python -m test.run_benchmarks
2020-01-30 14:11:52 +01:00
Jędrzej Boczar bb4f6106ee test: print benchmarks summary 2020-01-30 10:50:08 +01:00
Jędrzej Boczar e822e6be9f test: calculate benchmark bandwidth and efficiency 2020-01-30 10:19:17 +01:00
Jędrzej Boczar 804a9b3727 test: add script for running multiple benchmarks and parsing results 2020-01-29 17:03:20 +01:00
Jędrzej Boczar 502e6c663c test: add command line arguments for BIST base/length/random 2020-01-28 15:03:36 +01:00