diff options
| author | Petri Latvala <petri.latvala@intel.com> | 2018-12-17 15:07:40 +0200 |
|---|---|---|
| committer | Petri Latvala <petri.latvala@intel.com> | 2018-12-20 14:10:31 +0200 |
| commit | 321fe77d32fef32ef820f53924045fe6ef0cf6ed (patch) | |
| tree | 2387bd5733f6c7a3932866276e76dc5debe68334 /runner/json_tests_data/aborted-on-boot | |
| parent | 47f5a57a81b66c21d06695e263a22b87f5a33009 (diff) | |
runner: Add explicit "notrun" results for tests that were not executed
When possible, all tests we know we were going to attempt to execute
now appear in the results as "notrun". The only known case where it's
not possible to add an explicit "notrun" is when running in
multiple-mode, because "no subtests" and "run all subtests, we didn't
list them beforehand" are represented the same.
v2: Rebase and adjust to already landed json changes
Signed-off-by: Petri Latvala <petri.latvala@intel.com>
Cc: Martin Peres <martin.peres@linux.intel.com>
Cc: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
Acked-by: Martin Peres <martin.peres@linux.intel.com>
Reviewed-by: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
Diffstat (limited to 'runner/json_tests_data/aborted-on-boot')
| -rw-r--r-- | runner/json_tests_data/aborted-on-boot/reference.json | 70 |
1 files changed, 68 insertions, 2 deletions
diff --git a/runner/json_tests_data/aborted-on-boot/reference.json b/runner/json_tests_data/aborted-on-boot/reference.json index 0a8723eb..d354fbac 100644 --- a/runner/json_tests_data/aborted-on-boot/reference.json +++ b/runner/json_tests_data/aborted-on-boot/reference.json @@ -9,6 +9,36 @@ "end":1539953735.1723731 }, "tests":{ + "igt@successtest@first-subtest":{ + "out":"", + "err":"", + "dmesg":"", + "result":"notrun" + }, + "igt@successtest@second-subtest":{ + "out":"", + "err":"", + "dmesg":"", + "result":"notrun" + }, + "igt@no-subtests":{ + "out":"", + "err":"", + "dmesg":"", + "result":"notrun" + }, + "igt@skippers@skip-one":{ + "out":"", + "err":"", + "dmesg":"", + "result":"notrun" + }, + "igt@skippers@skip-two":{ + "out":"", + "err":"", + "dmesg":"", + "result":"notrun" + }, "igt@runner@aborted":{ "out":"Aborted after: startup\n\nKernel tainted (0x200)\n", "result":"fail", @@ -25,7 +55,7 @@ "skip":0, "incomplete":0, "timeout":0, - "notrun":0, + "notrun":5, "fail":1, "warn":0 }, @@ -37,10 +67,46 @@ "skip":0, "incomplete":0, "timeout":0, - "notrun":0, + "notrun":5, "fail":1, "warn":0 }, + "igt@successtest":{ + "crash":0, + "pass":0, + "dmesg-fail":0, + "dmesg-warn":0, + "skip":0, + "incomplete":0, + "timeout":0, + "notrun":2, + "fail":0, + "warn":0 + }, + "igt@no-subtests":{ + "crash":0, + "pass":0, + "dmesg-fail":0, + "dmesg-warn":0, + "skip":0, + "incomplete":0, + "timeout":0, + "notrun":1, + "fail":0, + "warn":0 + }, + "igt@skippers":{ + "crash":0, + "pass":0, + "dmesg-fail":0, + "dmesg-warn":0, + "skip":0, + "incomplete":0, + "timeout":0, + "notrun":2, + "fail":0, + "warn":0 + }, "igt@runner":{ "crash":0, "pass":0, |