Commit Graph

150 Commits

Author SHA1 Message Date
Jędrzej Boczar 247722d97e test: fix wrong sorting in benchmarks summary 2020-02-20 09:20:38 +01:00
Jędrzej Boczar a27841199b test: option to print heartbeat during benchmarks to avoid Travis timeouts 2020-02-19 13:08:04 +01:00
enjoy-digital 5fb2b011d8
Merge pull request #146 from antmicro/jboc/benchmark
Benchmarks: Generate HTML summary and deploy it from Travis
2020-02-18 13:26:20 +01:00
Jędrzej Boczar d14254124a test: run benchmarks in Travis CI and deploy the results 2020-02-17 14:46:50 +01:00
Piotr Binkowski f0be039a34 test: add option to use sdram timing verifier in benchmarks 2020-02-17 14:35:15 +01:00
Jędrzej Boczar b7ed91d9f0 test: suppress info log messages in benchmark runner 2020-02-17 13:14:52 +01:00
Jędrzej Boczar c6cc0e068d test: keep benchmark failures in data frame and filter out when needed 2020-02-17 09:07:13 +01:00
Jędrzej Boczar bba49f2df8 test: add generation of html benchmarks summary 2020-02-17 09:07:13 +01:00
Jędrzej Boczar dd12a78587 test: reduce disk usage when running benchmarks in parallel 2020-02-13 10:30:48 +01:00
Jędrzej Boczar 5cd33f490f test: update benchmark configuration generator 2020-02-12 15:42:50 +01:00
Jędrzej Boczar 4f613b5b00 test: add number of generators/checkers to benchmark runner, update metrics 2020-02-12 14:40:33 +01:00
Jędrzej Boczar edf4ddb2f2 test: add option to use multiple BIST generators/checkers 2020-02-12 14:40:33 +01:00
Jędrzej Boczar 45633e55b5 test: update BIST generator and checker tests 2020-02-11 14:24:02 +01:00
Jędrzej Boczar 409b9922ea test: add random address generation in benchmarks 2020-02-11 13:11:06 +01:00
Jędrzej Boczar 6744cf649c test: add handling of alternating write/read to benchmark runner 2020-02-11 13:10:04 +01:00
Jędrzej Boczar e16118abfd test: fix: use of undeclared variable 2020-02-11 12:13:37 +01:00
Jędrzej Boczar ff435fd26e test: add option to run benchmarks with alternating write/read 2020-02-11 12:06:45 +01:00
Jędrzej Boczar 9148400ef5 test: fix typo, add note about limitations 2020-02-07 12:20:43 +01:00
Jędrzej Boczar 2825c080a9 test: fix problem with plot labels overlapping for large number of benchmarks 2020-02-07 09:52:31 +01:00
Jędrzej Boczar 77541c3670 test: avoid instantiating LiteDRAMBenchmarkSoC to speed up summary generation 2020-02-06 15:08:01 +01:00
Jędrzej Boczar 027034db49 test: add option to run benchmarks as parallel jobs 2020-02-06 15:07:55 +01:00
Jędrzej Boczar 62a5473ecd test: update script for generating benchmark configurations 2020-02-06 13:35:34 +01:00
Jędrzej Boczar 8ba3cced60 test: add new benchmark configuratiosns to example configuration file 2020-02-05 18:58:49 +01:00
Jędrzej Boczar 1702e2ad7c test: update summary to work for all configurations (use pandas) 2020-02-05 18:39:06 +01:00
Jędrzej Boczar f9f86d507f test: update benchmark configuration to account for access pattern 2020-02-05 12:54:33 +01:00
Jędrzej Boczar 7e0515c477 test: fix problem with helper scripts being executed by `setup.py test` 2020-02-04 16:37:26 +01:00
Jędrzej Boczar fcd3d4ff6c test: helper scripts for generating benchmark configurations/access patterns 2020-02-04 16:26:57 +01:00
Jędrzej Boczar fcbcd4d3fe test: add option to benchmark predefined access patterns 2020-02-04 16:26:57 +01:00
Jędrzej Boczar bae046f143 test: add read/write latency benchmarks 2020-02-03 16:59:12 +01:00
Jędrzej Boczar a584923f1c test: use JSON instead of pickle for storing benchmarks cache 2020-02-03 12:17:41 +01:00
Florent Kermarrec 736723cc98 test/run_benchmarks: change YAML config file argument 2020-02-03 10:38:10 +01:00
Florent Kermarrec 7e95ecc9a9 test/run_benchmark: avoid Python 3.7+ dependency 2020-02-03 10:37:10 +01:00
Jędrzej Boczar 811c73254b test: benchmark script exits with error on any checker error 2020-01-31 15:16:37 +01:00
Jędrzej Boczar 1a517a308d test: cache benchmark results to be able to produce multiple summaries 2020-01-31 14:39:41 +01:00
Jędrzej Boczar a40817f3a8 test: add plotting of benchmark results 2020-01-31 14:39:41 +01:00
Jędrzej Boczar f6973aa9d7 test: load benchmark configurations from YAML file 2020-01-30 15:39:29 +01:00
Jędrzej Boczar 096de78c63 test: fix `setup.py test` failing due to import error
because of relative import the script has to be run as:
    python -m test.run_benchmarks
2020-01-30 14:11:52 +01:00
Jędrzej Boczar bb4f6106ee test: print benchmarks summary 2020-01-30 10:50:08 +01:00
Jędrzej Boczar e822e6be9f test: calculate benchmark bandwidth and efficiency 2020-01-30 10:19:17 +01:00
Jędrzej Boczar 804a9b3727 test: add script for running multiple benchmarks and parsing results 2020-01-29 17:03:20 +01:00
Jędrzej Boczar 502e6c663c test: add command line arguments for BIST base/length/random 2020-01-28 15:03:36 +01:00
Florent Kermarrec 586eb39b1d test: add initial benchmark test 2020-01-28 12:07:22 +01:00
Florent Kermarrec bb1b431184 test/test_init: use max_sdram_size of 1GB 2020-01-24 10:46:29 +01:00
Florent Kermarrec 1d2bc922b8 frontend/fifo: get back to original simple design and add test 2020-01-07 15:40:09 +01:00
Florent Kermarrec ac4b339a6f test/reference: update init headers 2019-11-15 19:45:39 +01:00
Florent Kermarrec f861d99903 core/refresher: improve naming/parameters of refresh postponing 2019-09-11 08:38:22 +02:00
Florent Kermarrec 40b4c62889 test/test_init: fix 2019-09-09 15:17:43 +02:00
Florent Kermarrec 5b48eb278a test/test_init: delete generated file 2019-09-09 15:08:01 +02:00
Florent Kermarrec 188b6a8feb add ZQ periodic short calibration support (default to 1s) 2019-09-09 15:07:38 +02:00
Florent Kermarrec 0b24b817e3 test: add test_init with sdr/ddr3/ddr4 references 2019-09-09 11:45:10 +02:00