summaryrefslogtreecommitdiff
path: root/tests/intel-ci/blacklist-pre-merge.txt
blob: d4e5ef66eccde230c9dcd402f1068993656e54e4 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
###############################################################################
# These 4 tests catching a lot of unrelated issues and are responsible for a
# significant portion of our execution time:
#
# - shard-skl: 1.6% (~4 minutes)
# - shard-kbl: 0.4% (30 seconds)
# - shard-apl: 0.2% (20 seconds)
# - shard-glk: 0.2% (30 seconds)
# - shard-icl: 6% (~12 minutes)
# - shard-tgl: 6% (~12 minutes)
#
# Issue: https://gitlab.freedesktop.org/drm/intel/issues/1281
#
# Data acquired on 2020-02-19 by Martin Peres
###############################################################################
igt@i915_pm_rpm@legacy-planes(-dpms)?
igt@i915_pm_rpm@universal-planes(-dpms)?


###############################################################################
# These tests are checking the obj->mm.get_page cache which is used for all
# page lookups in the driver by using a rather outdated method (pwrite) because
# it is harder to predictably exercise the cache from userspace.
#
# Until these 8 tests are replaced with a kernel selftest and removed from IGT,
# let's blacklist them for pre-merge testing as they are responsible for a
# significant portion of our execution time:
#
# - shard-skl: 0.1% (~15 seconds)
# - shard-kbl: 3.5% (~4.5 minutes)
# - shard-apl: 10% (~18 minutes)
# - shard-glk: 6.3% (~14 minutes)
# - shard-icl: 1.7% (~3.5 minutes)
# - shard-tgl: 1.6% (~3 minutes)
#
# Issue: https://gitlab.freedesktop.org/drm/intel/issues/1283
#
# Data acquired on 2020-02-19 by Martin Peres
###############################################################################
igt@gem_pwrite@big-.*


###############################################################################
# This test checks some edge cases of the execbuf API, which is quite time
# consuming and rarely changes. Very unlikely to be affected by any code
# outside of drm_mm and i915_gem_execbuffer, for which the authors assure us
# that they are making deliberate and well tested changes.
###############################################################################
igt@gem_exec_alignment@.*


###############################################################################
# This test is reading one file at a time while being suspended, which makes
# testing extremelly slow. This is a developer-only feature which is also used
# by IGT extensively so removing it may make it harder for developers to
# understand what they regressed, but given the amount of time we can save, I
# this is an acceptable trade-off (easy-to-read report vs CI exec time):
#
# - shard-skl: 0.5% (~1 minute)
# - shard-kbl: 0.1% (~2 seconds)
# - shard-apl: 0.1% (~2 seconds)
# - shard-glk: 0.1% (~2 seconds)
# - shard-icl: 0.6% (~1.5 minutes)
# - shard-tgl: 0.7% (~1.5 minutes)
#
# Issue: https://gitlab.freedesktop.org/drm/intel/issues/1279
#
# Data acquired on 2020-02-20 by Martin Peres
###############################################################################
igt@i915_pm_rpm@debugfs-read


###############################################################################
# Modern userspace does not depend on the GTT anymore, so let's drop the
# slowest tests from pre-merge testing:
#
# - shard-skl: 2.7% (~6.5 minutes)
# - shard-kbl: 2% (~2.5 minutes)
# - shard-apl: 4.7% (~8.5 minutes)
# - shard-glk: 3.5% (~8 minutes)
# - shard-icl: 4.2% (~8.5 minutes)
# - shard-tgl: 2.5% (~4.5 minutes)
#
# Issue: https://gitlab.freedesktop.org/drm/intel/issues/1286
#
# Data acquired on 2020-02-20 by Martin Peres
###############################################################################
igt@gem_fence_thrash@bo-write-verify-threaded-[xy]
igt@gem_tiled_blits@interruptible
igt@gem_tiled_fence_blits@normal
igt@gem_tiled_blits@normal
igt@gem_tiled_wc


###############################################################################
# This test is doing nothing more than waiting for the driver to be suspended
# before issueing a modeset. However, it never failed while testing for this
# in the past year, so we probably just want to drop the amount of rounds to
# reduce the runtime, but let's just blacklist it in pre-merge for now:
#
# - shard-skl: 1% (~2.5 minute)
# - shard-kbl: 0.9% (~1 minute)
# - shard-apl: 0.6% (~1 minute)
# - shard-glk: 0.5% (~1 minute)
# - shard-icl: 1.1% (~2.5 minutes)
# - shard-tgl: 1.4% (~2.5 minutes)
#
# Issue: https://gitlab.freedesktop.org/drm/intel/issues/1288
#
# Data acquired on 2020-02-20 by Martin Peres
###############################################################################
igt@i915_pm_rpm@modeset-stress-extra-wait