summaryrefslogtreecommitdiff
path: root/scripts/run-tests.sh
AgeCommit message (Collapse)Author
2022-03-21scripts/run-tests.sh: add code coverage supportMauro Carvalho Chehab
When the Kernel is built with GCOV_KERNEL and one or more drivers are built with GCOV_PROFILE enabled[1], the Kernel will collect code coverage usage at the same time as a test runs. Add support at run-tests.sh to collect usage data and store them on .info files. That actually require two new options: -c <test_name>: will store the tests under test_name.info; -k <kernel_tree>: Points to the source code of the built Kernel. The Kernel tree can be a partial tree, provided that it contains at least all *.h files used by the drivers, plus the *.c files that were built with gcov support enabled. [1] See https://01.org/linuxgraphics/gfx-docs/drm/dev-tools/gcov.html Reviewed-by: Petri Latvala <petri.latvala@intel.com> Signed-off-by: Mauro Carvalho Chehab <mchehab@kernel.org>
2020-06-12scripts/run-tests.sh: also search path for runner binariesStefan Agner
To make the script also useful when igt_runner/igt_resume binarires are installed, also search PATH for the binaries. Signed-off-by: Stefan Agner <stefan@agner.ch> Reviewed-by: Petri Latvala <petri.latvala@intel.com>
2019-11-29scripts/run-tests.sh: Use the filter flag values when listing testsPetri Latvala
Testcase: scripts/run-tests.sh -l -T fast-feedback.testlist -x vgem_basic Previously the filters (-T for testlist, -t/-x for regex include/exclude) were silently dropped when listing tests. Actually use them for listing, since that works properly when using igt_runner. Warning for those using piglit (the -p flag): The -x flag for listing with piglit is the same as -t at this time: https://gitlab.freedesktop.org/mesa/piglit/issues/29 v2: Remember to git add after removing debug echos instead of breaking CI Signed-off-by: Petri Latvala <petri.latvala@intel.com> Cc: Arkadiusz Hiler <arkadiusz.hiler@intel.com> Cc: Tomi Sarvela <tomi.p.sarvela@intel.com> Reviewed-by: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
2019-09-17run-tests.sh: Use igt_runner instead of piglit by defaultPetri Latvala
The old behaviour of running everything with piglit with the script is now behind the flag -p. When using igt_runner and its pals, -b now takes a blacklist file á la tests/intel-ci/blacklist.txt. Additional useful command line flags for igt_runner, like the various forms of --abort-on-monitored-error or --dmesg-warning-level are not supported. The main supported form of running tests is igt_runner directly. Signed-off-by: Petri Latvala <petri.latvala@intel.com> Cc: Tomi Sarvela <tomi.p.sarvela@intel.com> Cc: Arkadiusz Hiler <arkadiusz.hiler@intel.com> Reviewed-by: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
2018-04-17scripts: Use https URL to download piglitSouza, Jose
This makes life easier for users behind network proxies. A simple 'export https_proxy=<proxy url>' will make this works, today user needs to do a more complicated setup in ssh/git with proxy information. Signed-off-by: José Roberto de Souza <jose.souza@intel.com> Reviewed-by: Petri Latvala <petri.latvala@intel.com>
2018-03-21run-tests.sh: use meson build by defaultLucas De Marchi
This makes scripts/run-tests.sh to look into a build dir by default, looking for the test lists. With this we can run the script after building i-g-t with meson without having to resort to the environment variable. Signed-off-by: Lucas De Marchi <lucas.demarchi@intel.com> Reviewed-by: Petri Latvala <petri.latvala@intel.com>
2018-03-21run-tests.sh: allow relative IGT_TEST_ROOT and IGT_CONFIG_PATHLucas De Marchi
When piglit runs it chdir() to its own directory, so passing a relative path doesn't work. E.g.: Fatal Error: IGT directory does not exist. Missing: build/tests Make sure path is absolute throughout the script. Signed-off-by: Lucas De Marchi <lucas.demarchi@intel.com> Reviewed-by: Petri Latvala <petri.latvala@intel.com>
2018-03-21run-tests.sh: allow to run without sudoLucas De Marchi
If the script is already running as root, it doens't need to be executed through sudo. This also moves the calls to exec piglit to a common function. Signed-off-by: Lucas De Marchi <lucas.demarchi@intel.com> Reviewed-by: Petri Latvala <petri.latvala@intel.com>
2018-01-11run-tests.sh: Allow users to override IGT_TEST_ROOTPetri Latvala
Signed-off-by: Petri Latvala <petri.latvala@intel.com> Cc: Arkadiusz Hiler <arkadiusz.hiler@intel.com> Reviewed-by: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
2017-11-06run-tests.sh: Use piglit names when listing available testsPetri Latvala
List the available tests with piglit instead of by hand. This solves naming inconsistencies (piglit throwing caps away) as seen by cibuglog, and makes the listing code simpler. The format of the listing changes from test-binary/subtest-name to igt@test-binary@subtest-name but so far nothing has been able to directly consume run-tests.sh -l output. The piglit format is directly consumable by piglit --test-list, and thus by run-tests.sh -T. Signed-off-by: Petri Latvala <petri.latvala@intel.com> Cc: Tomi Sarvela <tomi.p.sarvela@intel.com> Cc: Arkadiusz Hiler <arkadiusz.hiler@intel.com> Acked-by: Arkadiusz Hiler <arkadiusz.hiler@intel.com> Acked-by: Tomi Sarvela <tomi.p.sarvela@intel.com> Acked-by: Martin Peres <martin.peres@linux.intel.com>
2017-09-04scripts/run-tests.sh: Use piglit's --ignore-missingArkadiusz Hiler
Recently we added a number of chamelium tests to the fast-feedback testlist. Chemelium is build-optional - requires `./configure --enable-chamelium`. To mitigate issue with piglit exiting abruptly due to the (possibly) missing test binaries, this makes it behave more gracefuly, considering those as simply "notrun". Cc: Petri Latvala <petri.latvala@intel.com> Signed-off-by: Arkadiusz Hiler <arkadiusz.hiler@intel.com> Reviewed-by: Daniel Vetter <daniel.vetter@ffwll.ch>
2017-03-13scripts/run-tests.sh: Support testlist filesTomi Sarvela
This patch passes igt scripts/run-tests.sh -T option to piglit runner as --test-list. Restrictions to the option usage come from the piglit side: - only last --test-list is processed - no test regex inclusions or exclusions are processed if --test-list exists Signed-off-by: Tomi Sarvela <tomi.p.sarvela@intel.com> Reviewed-by: Petri Latvala <petri.latvala@intel.com>
2017-02-01scripts: Set IGT_CONFIG_PATH in run-tests.shLyude
Since we run igt under sudo, the home directory changes to that of the root account. This causes the chamelium tests to incorrectly search the root's home directory for the .igtrc file instead of the current user's home directory. So set IGT_CONFIG_PATH to default to $HOME/.igtrc. Signed-off-by: Lyude <lyude@redhat.com>
2016-04-19scripts: Adapt run-tests.sh to the piglit changesFeceoru, Gabriel
Piglit changed its behaviour to prevent overwriting the results directory unless explicitly specified with -o Added -o flag in run-tests.sh to keep user experience. Signed-off-by: Gabriel Feceoru <gabriel.feceoru@intel.com> Acked-by: Rodrigo Vivi <rodrigo.vivi@intel.com> Signed-off-by: Marius Vlad <marius.c.vlad@intel.com>
2015-12-02docs: remove references to tests/NAMING-CONVENTIONThomas Wood
The tests/NAMING-CONVENTION file has been removed and its contents is now included in the API documentation. Reported-by: Joonas Lahtinen <joonas.lahtinen@linux.intel.com> Signed-off-by: Thomas Wood <thomas.wood@intel.com>
2015-05-28scripts/run-tests.sh: add option to not retry incomplete tests on resumeMike Mason
This patch utilizes piglit's new --no-retry option. That option prevents incomplete tests from being retried when resuming a test run. This is necessary because retrying tests that cause a crash or reboot prevents a test run from being resumed. This patch also adds -s to the piglit command line. The -s option forces test logs to be synced to disk after every test. Without it, some logs can be lost if a test causes a crash or reboot, making it impossible to resume the test run at the correct point. Signed-off-by: Mike Mason <michael.w.mason@intel.com> Signed-off-by: Thomas Wood <thomas.wood@intel.com>
2015-05-12scripts/run-tests.sh: use single combined test listMike Mason
i-g-t now creates a single combined test list for tests with and without subtests. This patch adapts run-tests.sh to that change. Signed-off-by: Mike Mason <michael.w.mason@intel.com> Signed-off-by: Thomas Wood <thomas.wood@intel.com>
2014-08-29scripts: Add capability to resume interrupted run-tests.sh sessionMike Mason
Piglit provides a 'resume' feature that can restart an interrupted test run at the point where it stopped. This patch adds that feature to run_tests.sh. Signed-off-by: Mike Mason <michael.w.mason@intel.com> [Thomas: remove additional new line from end of file] Signed-off-by: Thomas Wood <thomas.wood@intel.com>
2014-08-19scripts: Allow multiple -t and -x regular expressions for run-tests.shMike Mason
Piglit allows multiple -t and -x regular expressions to be given on the command line. This patch enables run-tests.sh to support that as well. Signed-off-by: Mike Mason <michael.w.mason@intel.com> Signed-off-by: Thomas Wood <thomas.wood@intel.com>
2014-07-11scripts: add a script to help run tests with PiglitThomas Wood
Add a script to facilitate running the tests with Piglit by providing simplified options for listing, filtering and creating summaries of test runs. Signed-off-by: Thomas Wood <thomas.wood@intel.com>