157 commits

Author	SHA1	Message	Date
Jędrzej Boczar	b89ecdf919	test: add _LiteDRAMBISTGenerator tests	2020-03-11 15:38:13 +01:00
Karol Gugala	2ce64bd5fb	Fix copyrights ... Signed-off-by: Karol Gugala <kgugala@antmicro.com> Signed-off-by: Mateusz Holenko <mholenko@antmicro.com>	2020-03-05 17:40:21 +01:00
Florent Kermarrec	8fee3c7edf	test/reference: update kc705 ddr3_init.h.	2020-03-05 11:35:12 +01:00
enjoy-digital	87578dd2e3	Merge pull request #153 from antmicro/jboc/issue-151 ... test/benchmarks: add memtype to summary (#151)	2020-02-20 14:00:27 +01:00
enjoy-digital	4f9d6e413f	Merge pull request #152 from antmicro/jboc/benchmark ... Benchmarks: add timeout parameter	2020-02-20 14:00:06 +01:00
Jędrzej Boczar	19cbf7d967	test/benchmarks: add memtype to summary (#151)	2020-02-20 13:36:49 +01:00
Jędrzej Boczar	a5d2c09e8f	test: add benchmark timeout parameter	2020-02-20 09:33:09 +01:00
Jędrzej Boczar	247722d97e	test: fix wrong sorting in benchmarks summary	2020-02-20 09:20:38 +01:00
Jędrzej Boczar	a27841199b	test: option to print heartbeat during benchmarks to avoid Travis timeouts	2020-02-19 13:08:04 +01:00
enjoy-digital	5fb2b011d8	Merge pull request #146 from antmicro/jboc/benchmark ... Benchmarks: Generate HTML summary and deploy it from Travis	2020-02-18 13:26:20 +01:00
Jędrzej Boczar	d14254124a	test: run benchmarks in Travis CI and deploy the results	2020-02-17 14:46:50 +01:00
Piotr Binkowski	f0be039a34	test: add option to use sdram timing verifier in benchmarks	2020-02-17 14:35:15 +01:00
Jędrzej Boczar	b7ed91d9f0	test: suppress info log messages in benchmark runner	2020-02-17 13:14:52 +01:00
Jędrzej Boczar	c6cc0e068d	test: keep benchmark failures in data frame and filter out when needed	2020-02-17 09:07:13 +01:00
Jędrzej Boczar	bba49f2df8	test: add generation of html benchmarks summary	2020-02-17 09:07:13 +01:00
Jędrzej Boczar	dd12a78587	test: reduce disk usage when running benchmarks in parallel	2020-02-13 10:30:48 +01:00
Jędrzej Boczar	5cd33f490f	test: update benchmark configuration generator	2020-02-12 15:42:50 +01:00
Jędrzej Boczar	4f613b5b00	test: add number of generators/checkers to benchmark runner, update metrics	2020-02-12 14:40:33 +01:00
Jędrzej Boczar	edf4ddb2f2	test: add option to use multiple BIST generators/checkers	2020-02-12 14:40:33 +01:00
Jędrzej Boczar	45633e55b5	test: update BIST generator and checker tests	2020-02-11 14:24:02 +01:00
Jędrzej Boczar	409b9922ea	test: add random address generation in benchmarks	2020-02-11 13:11:06 +01:00
Jędrzej Boczar	6744cf649c	test: add handling of alternating write/read to benchmark runner	2020-02-11 13:10:04 +01:00
Jędrzej Boczar	e16118abfd	test: fix: use of undeclared variable	2020-02-11 12:13:37 +01:00
Jędrzej Boczar	ff435fd26e	test: add option to run benchmarks with alternating write/read	2020-02-11 12:06:45 +01:00
Jędrzej Boczar	9148400ef5	test: fix typo, add note about limitations	2020-02-07 12:20:43 +01:00
Jędrzej Boczar	2825c080a9	test: fix problem with plot labels overlapping for large number of benchmarks	2020-02-07 09:52:31 +01:00
Jędrzej Boczar	77541c3670	test: avoid instantiating LiteDRAMBenchmarkSoC to speed up summary generation	2020-02-06 15:08:01 +01:00
Jędrzej Boczar	027034db49	test: add option to run benchmarks as parallel jobs	2020-02-06 15:07:55 +01:00
Jędrzej Boczar	62a5473ecd	test: update script for generating benchmark configurations	2020-02-06 13:35:34 +01:00
Jędrzej Boczar	8ba3cced60	test: add new benchmark configuratiosns to example configuration file	2020-02-05 18:58:49 +01:00
Jędrzej Boczar	1702e2ad7c	test: update summary to work for all configurations (use pandas)	2020-02-05 18:39:06 +01:00
Jędrzej Boczar	f9f86d507f	test: update benchmark configuration to account for access pattern	2020-02-05 12:54:33 +01:00
Jędrzej Boczar	7e0515c477	test: fix problem with helper scripts being executed by setup.py test	2020-02-04 16:37:26 +01:00
Jędrzej Boczar	fcd3d4ff6c	test: helper scripts for generating benchmark configurations/access patterns	2020-02-04 16:26:57 +01:00
Jędrzej Boczar	fcbcd4d3fe	test: add option to benchmark predefined access patterns	2020-02-04 16:26:57 +01:00
Jędrzej Boczar	bae046f143	test: add read/write latency benchmarks	2020-02-03 16:59:12 +01:00
Jędrzej Boczar	a584923f1c	test: use JSON instead of pickle for storing benchmarks cache	2020-02-03 12:17:41 +01:00
Florent Kermarrec	736723cc98	test/run_benchmarks: change YAML config file argument	2020-02-03 10:38:10 +01:00
Florent Kermarrec	7e95ecc9a9	test/run_benchmark: avoid Python 3.7+ dependency	2020-02-03 10:37:10 +01:00
Jędrzej Boczar	811c73254b	test: benchmark script exits with error on any checker error	2020-01-31 15:16:37 +01:00
Jędrzej Boczar	1a517a308d	test: cache benchmark results to be able to produce multiple summaries	2020-01-31 14:39:41 +01:00
Jędrzej Boczar	a40817f3a8	test: add plotting of benchmark results	2020-01-31 14:39:41 +01:00
Jędrzej Boczar	f6973aa9d7	test: load benchmark configurations from YAML file	2020-01-30 15:39:29 +01:00
Jędrzej Boczar	096de78c63	test: fix setup.py test failing due to import error ... because of relative import the script has to be run as: python -m test.run_benchmarks	2020-01-30 14:11:52 +01:00
Jędrzej Boczar	bb4f6106ee	test: print benchmarks summary	2020-01-30 10:50:08 +01:00
Jędrzej Boczar	e822e6be9f	test: calculate benchmark bandwidth and efficiency	2020-01-30 10:19:17 +01:00
Jędrzej Boczar	804a9b3727	test: add script for running multiple benchmarks and parsing results	2020-01-29 17:03:20 +01:00
Jędrzej Boczar	502e6c663c	test: add command line arguments for BIST base/length/random	2020-01-28 15:03:36 +01:00
Florent Kermarrec	586eb39b1d	test: add initial benchmark test	2020-01-28 12:07:22 +01:00
Florent Kermarrec	bb1b431184	test/test_init: use max_sdram_size of 1GB	2020-01-24 10:46:29 +01:00