Skip to content

Create new test type aamtest for accessibility API testing #57696

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
spectranaut wants to merge 38 commits into
base: master
Choose a base branch
from

Fix tables and links

d4fca40
Select commit
Loading
Failed to load commit list.
Open

Create new test type aamtest for accessibility API testing #57696

Fix tables and links
d4fca40
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-chrome-dev-stability succeeded Apr 28, 2026 in 11m 29s

Community-TC (pull_request)

Verify that all tests affected by a pull request are stable when executed in chrome.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-04-28T20:14:33.652Z
Resolved: 2026-04-28T20:19:45.635Z
Task Execution Time: 5 minutes, 11 seconds, 983 milliseconds
Task Status: completed
Reason Resolved: completed
TaskId: LyJWey42RDOhOYEKV2luOw
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md

WPT Command: python3 ./wpt run --channel=dev --verify --verify-no-chaos-mode --verify-repeat-loop=0 --verify-repeat-restart=10 --github-checks-text-file=/home/test/artifacts/checkrun.md --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --enable-swiftshader --install-browser --install-webdriver chrome

[taskcluster 2026-04-28 20:14:33.734Z] Task ID: LyJWey42RDOhOYEKV2luOw
[taskcluster 2026-04-28 20:14:33.734Z] Worker ID: 2987697490328598310
[taskcluster 2026-04-28 20:14:33.734Z] Worker Group: us-east4-a
[taskcluster 2026-04-28 20:14:33.734Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-04-28 20:14:33.734Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-04-28 20:14:33.734Z] Worker Version: 46.1.0
[taskcluster 2026-04-28 20:14:33.734Z] Public IP: 35.236.229.37
[taskcluster 2026-04-28 20:14:33.734Z] Hostname: proj-wpt-ci-tg-0bbfqro-s5e4fljm8uq

66587c81b81a - Started downloading
5b82b858ea7e - Started downloading
b1e71f63927a - Started downloading
b1e71f63927a - Downloaded in 0.006 seconds
08c7e224535e - Started downloading
08c7e224535e - Downloaded in 0.008 seconds
66587c81b81a - Downloaded in 0.174 seconds
32bbaaf98e4c - Started downloading
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0.002 seconds
dd5257950bd4 - Started downloading

...(2288 lines hidden)...

 2:20.06 INFO STDOUT: platform linux -- Python 3.10.12, pytest-8.2.1, pluggy-unknown -- /usr/bin/python3
 2:20.06 INFO STDOUT: rootdir: /home/test/web-platform-tests
 2:20.06 INFO STDOUT: plugins: asyncio-0.19.0
 2:20.06 INFO STDOUT: asyncio: mode=strict
 2:20.06 INFO STDOUT: collecting ... 
 2:20.11 INFO STDOUT: collected 1 item
 2:20.11 INFO STDOUT: core-aam/aamtests/attribute/aria_error_message.py::test_atspi 
 2:20.29 pid:16041 [16511:16511:0428/201936.249173:WARNING:sandbox/policy/linux/sandbox_linux.cc:404] InitializeSandbox() called with multiple threads in process gpu-process.
 2:20.29 pid:16041 [16511:16511:0428/201936.254381:WARNING:ui/gfx/linux/gbm_support_x11.cc:48] dri3 extension not supported.
 2:20.33 pid:16041 [1777407576.292][WARNING]: You are using an unsupported command-line switch: --disable-build-check. Please don't report bugs that cannot be reproduced with this switch removed.
 2:20.45 pid:16041 [16476:16476:0428/201936.407382:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.Properties.GetAll: object_path= /org/freedesktop/UPower/devices/DisplayDevice: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
 2:20.45 pid:16041 [16476:16476:0428/201936.407393:WARNING:dbus/property.cc:174] GetAll request failed for: org.freedesktop.UPower.Device
 2:20.46 pid:16041 [16476:16476:0428/201936.420383:WARNING:ui/base/idle/idle_linux.cc:111] None of the known D-Bus ScreenSaver services could be used.
 2:20.91 INFO STDOUT: PASSED
 2:20.98 INFO STDOUT: ============================== 1 passed in 0.92s ===============================
 2:20.98 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
 2:20.98 TEST_START: /core-aam/aamtests/role/blockquote.py
 2:21.02 INFO STDOUT: ============================= test session starts ==============================
 2:21.02 INFO STDOUT: platform linux -- Python 3.10.12, pytest-8.2.1, pluggy-unknown -- /usr/bin/python3
 2:21.02 INFO STDOUT: rootdir: /home/test/web-platform-tests
 2:21.02 INFO STDOUT: plugins: asyncio-0.19.0
 2:21.02 INFO STDOUT: asyncio: mode=strict
 2:21.02 INFO STDOUT: collecting ... 
 2:21.07 INFO STDOUT: collected 3 items
 2:21.07 INFO STDOUT: core-aam/aamtests/role/blockquote.py::test_atspi 
 2:21.25 pid:16041 [16717:16717:0428/201937.212269:WARNING:sandbox/policy/linux/sandbox_linux.cc:404] InitializeSandbox() called with multiple threads in process gpu-process.
 2:21.26 pid:16041 [16717:16717:0428/201937.219190:WARNING:ui/gfx/linux/gbm_support_x11.cc:48] dri3 extension not supported.
 2:21.29 pid:16041 [1777407577.250][WARNING]: You are using an unsupported command-line switch: --disable-build-check. Please don't report bugs that cannot be reproduced with this switch removed.
 2:21.40 pid:16041 [16681:16681:0428/201937.359164:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.Properties.GetAll: object_path= /org/freedesktop/UPower/devices/DisplayDevice: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
 2:21.40 pid:16041 [16681:16681:0428/201937.359411:WARNING:dbus/property.cc:174] GetAll request failed for: org.freedesktop.UPower.Device
 2:21.43 pid:16041 [16681:16681:0428/201937.384566:WARNING:ui/base/idle/idle_linux.cc:111] None of the known D-Bus ScreenSaver services could be used.
 2:21.87 INFO STDOUT: PASSED
 2:21.88 INFO STDOUT: core-aam/aamtests/role/blockquote.py::test_axapi 
 2:21.89 INFO STDOUT: SKIPPED
 2:21.91 INFO STDOUT: core-aam/aamtests/role/blockquote.py::test_ia2 
 2:21.92 INFO STDOUT: SKIPPED
 2:21.92 INFO STDOUT:  (NOT_APPLICABLE)
 2:21.99 INFO STDOUT: ========================= 1 passed, 2 skipped in 0.97s =========================
 2:21.99 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
 2:21.99 TEST_START: /core-aam/aamtests/role/button.py
 2:22.03 INFO STDOUT: ============================= test session starts ==============================
 2:22.03 INFO STDOUT: platform linux -- Python 3.10.12, pytest-8.2.1, pluggy-unknown -- /usr/bin/python3
 2:22.03 INFO STDOUT: rootdir: /home/test/web-platform-tests
 2:22.03 INFO STDOUT: plugins: asyncio-0.19.0
 2:22.03 INFO STDOUT: asyncio: mode=strict
 2:22.03 INFO STDOUT: collecting ... 
 2:22.08 INFO STDOUT: collected 4 items
 2:22.08 INFO STDOUT: core-aam/aamtests/role/button.py::test_atspi[no-attributes] 
 2:22.26 pid:16041 [16923:16923:0428/201938.220165:WARNING:sandbox/policy/linux/sandbox_linux.cc:404] InitializeSandbox() called with multiple threads in process gpu-process.
 2:22.26 pid:16041 [16923:16923:0428/201938.223621:WARNING:ui/gfx/linux/gbm_support_x11.cc:48] dri3 extension not supported.
 2:22.38 pid:16041 [1777407578.344][WARNING]: You are using an unsupported command-line switch: --disable-build-check. Please don't report bugs that cannot be reproduced with this switch removed.
 2:22.39 pid:16041 [16886:16886:0428/201938.347586:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.Properties.GetAll: object_path= /org/freedesktop/UPower/devices/DisplayDevice: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
 2:22.39 pid:16041 [16886:16886:0428/201938.347866:WARNING:dbus/property.cc:174] GetAll request failed for: org.freedesktop.UPower.Device
 2:22.42 pid:16041 [16886:16886:0428/201938.382296:WARNING:ui/base/idle/idle_linux.cc:111] None of the known D-Bus ScreenSaver services could be used.
 2:22.87 INFO STDOUT: PASSED
 2:22.88 INFO STDOUT: core-aam/aamtests/role/button.py::test_atspi[aria-pressed-undefined] 
 2:23.01 INFO STDOUT: PASSED
 2:23.03 INFO STDOUT: core-aam/aamtests/role/button.py::test_atspi[aria-haspopup-undefined] 
 2:23.07 INFO STDOUT: PASSED
 2:23.08 INFO STDOUT: core-aam/aamtests/role/button.py::test_atspi[aria-haspopup-false] 
 2:23.13 INFO STDOUT: PASSED
 2:23.20 INFO STDOUT: ============================== 4 passed in 1.17s ===============================
 2:23.20 TEST_END: Test OK. Subtests passed 4/4. Unexpected 0
 2:23.20 TEST_START: /core-aam/aamtests/role/button_haspopup.py
 2:23.24 INFO STDOUT: ============================= test session starts ==============================
 2:23.24 INFO STDOUT: platform linux -- Python 3.10.12, pytest-8.2.1, pluggy-unknown -- /usr/bin/python3
 2:23.24 INFO STDOUT: rootdir: /home/test/web-platform-tests
 2:23.24 INFO STDOUT: plugins: asyncio-0.19.0
 2:23.24 INFO STDOUT: asyncio: mode=strict
 2:23.24 INFO STDOUT: collecting ... 
 2:23.29 INFO STDOUT: collected 6 items
 2:23.29 INFO STDOUT: core-aam/aamtests/role/button_haspopup.py::test_atspi[true] 
 2:23.48 pid:16041 [17130:17130:0428/201939.438741:WARNING:sandbox/policy/linux/sandbox_linux.cc:404] InitializeSandbox() called with multiple threads in process gpu-process.
 2:23.48 pid:16041 [17130:17130:0428/201939.443638:WARNING:ui/gfx/linux/gbm_support_x11.cc:48] dri3 extension not supported.
 2:23.51 pid:16041 [1777407579.466][WARNING]: You are using an unsupported command-line switch: --disable-build-check. Please don't report bugs that cannot be reproduced with this switch removed.
 2:23.62 pid:16041 [17093:17093:0428/201939.579585:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.Properties.GetAll: object_path= /org/freedesktop/UPower/devices/DisplayDevice: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
 2:23.62 pid:16041 [17093:17093:0428/201939.579635:WARNING:dbus/property.cc:174] GetAll request failed for: org.freedesktop.UPower.Device
 2:23.65 pid:16041 [17093:17093:0428/201939.606280:WARNING:ui/base/idle/idle_linux.cc:111] None of the known D-Bus ScreenSaver services could be used.
 2:24.10 INFO STDOUT: PASSED
 2:24.11 INFO STDOUT: core-aam/aamtests/role/button_haspopup.py::test_atspi[menu] 
 2:24.23 INFO STDOUT: PASSED
 2:24.25 INFO STDOUT: core-aam/aamtests/role/button_haspopup.py::test_atspi[listbox] 
 2:24.30 INFO STDOUT: PASSED
 2:24.32 INFO STDOUT: core-aam/aamtests/role/button_haspopup.py::test_atspi[tree] 
 2:24.38 INFO STDOUT: PASSED
 2:24.39 INFO STDOUT: core-aam/aamtests/role/button_haspopup.py::test_atspi[grid] 
 2:24.44 INFO STDOUT: PASSED
 2:24.46 INFO STDOUT: core-aam/aamtests/role/button_haspopup.py::test_atspi[dialog] 
 2:24.51 INFO STDOUT: PASSED
 2:24.58 INFO STDOUT: ============================== 6 passed in 1.34s ===============================
 2:24.58 TEST_END: Test OK. Subtests passed 6/6. Unexpected 0
 2:24.58 TEST_START: /core-aam/aamtests/role/button_pressed.py
 2:24.62 INFO STDOUT: ============================= test session starts ==============================
 2:24.62 INFO STDOUT: platform linux -- Python 3.10.12, pytest-8.2.1, pluggy-unknown -- /usr/bin/python3
 2:24.62 INFO STDOUT: rootdir: /home/test/web-platform-tests
 2:24.62 INFO STDOUT: plugins: asyncio-0.19.0
 2:24.62 INFO STDOUT: asyncio: mode=strict
 2:24.62 INFO STDOUT: collecting ... 
 2:24.67 INFO STDOUT: collected 2 items
 2:24.67 INFO STDOUT: core-aam/aamtests/role/button_pressed.py::test_atspi[true] 
 2:24.85 pid:16041 [17333:17333:0428/201940.809629:WARNING:sandbox/policy/linux/sandbox_linux.cc:404] InitializeSandbox() called with multiple threads in process gpu-process.
 2:24.88 pid:16041 [17333:17333:0428/201940.817174:WARNING:ui/gfx/linux/gbm_support_x11.cc:48] dri3 extension not supported.
 2:24.97 pid:16041 [1777407580.929][WARNING]: You are using an unsupported command-line switch: --disable-build-check. Please don't report bugs that cannot be reproduced with this switch removed.
 2:24.97 pid:16041 [17298:17298:0428/201940.932430:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.Properties.GetAll: object_path= /org/freedesktop/UPower/devices/DisplayDevice: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
 2:24.97 pid:16041 [17298:17298:0428/201940.932896:WARNING:dbus/property.cc:174] GetAll request failed for: org.freedesktop.UPower.Device
 2:25.01 pid:16041 [17298:17298:0428/201940.972952:WARNING:ui/base/idle/idle_linux.cc:111] None of the known D-Bus ScreenSaver services could be used.
 2:25.45 INFO STDOUT: PASSED
 2:25.46 INFO STDOUT: core-aam/aamtests/role/button_pressed.py::test_atspi[false] 
 2:25.60 INFO STDOUT: PASSED
 2:25.66 INFO STDOUT: ============================== 2 passed in 1.04s ===============================
 2:25.66 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
 2:25.66 INFO No more tests
 2:25.66 INFO Closing logging queue
 2:25.66 INFO queue closed
 2:25.75 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 250 checks (180 subtests, 70 tests)
Expected results: 250
Unexpected results: 0
OK
 2:25.75 INFO Got 0 unexpected results, with 0 unexpected passes
 2:25.75 wptserve INFO Stopped http server on 127.0.0.1:8000
 2:25.75 wptserve INFO Stopped http server on 127.0.0.1:8001
 2:25.75 wptserve INFO Stopped http server on 127.0.0.1:8002
 2:25.75 wptserve INFO Stopped http server on 127.0.0.1:8443
 2:25.75 wptserve INFO Stopped http server on 127.0.0.1:8444
 2:25.75 wptserve INFO Stopped http server on 127.0.0.1:8445
 2:25.77 wptserve INFO Stopped http server on 127.0.0.1:8446
 2:25.77 wptserve INFO Stopped http server on 127.0.0.1:8003
 2:25.77 wptserve INFO Stopped http server on 127.0.0.1:9000
 2:25.77 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 2:26.02 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 2:26.03 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 2:26.06 INFO Removed font: Ahem.ttf
 2:26.08 INFO Closing logging queue
 2:26.09 INFO queue closed
 2:26.10 INFO ::: Ran 10 of expected 10 iterations.
 2:26.10 INFO ## All results ##

 2:26.10 INFO ### /core-aam/aamtests/attribute/aria_autocomplete_inline_list_both.py ###
 2:26.10 INFO |       Subtest        | Results | Messages |
 2:26.10 INFO |----------------------|---------|----------|
 2:26.10 INFO |                      | OK      |          |
 2:26.10 INFO | `test_atspi[both]`   | PASS    |          |
 2:26.10 INFO | `test_atspi[inline]` | PASS    |          |
 2:26.10 INFO | `test_atspi[list]`   | PASS    |          |
 2:26.10 INFO 
 2:26.10 INFO ### /core-aam/aamtests/attribute/aria_braillelabel.py ###
 2:26.10 INFO |   Subtest    | Results | Messages |
 2:26.10 INFO |--------------|---------|----------|
 2:26.10 INFO |              | OK      |          |
 2:26.10 INFO | `test_atspi` | PASS    |          |
 2:26.10 INFO 
 2:26.10 INFO ### /core-aam/aamtests/attribute/aria_error_message.py ###
 2:26.10 INFO |   Subtest    | Results | Messages |
 2:26.11 INFO |--------------|---------|----------|
 2:26.11 INFO |              | OK      |          |
 2:26.11 INFO | `test_atspi` | PASS    |          |
 2:26.11 INFO 
 2:26.11 INFO ### /core-aam/aamtests/role/blockquote.py ###
 2:26.11 INFO |   Subtest    | Results | Messages |
 2:26.11 INFO |--------------|---------|----------|
 2:26.11 INFO |              | OK      |          |
 2:26.11 INFO | `test_atspi` | PASS    |          |
 2:26.11 INFO 
 2:26.11 INFO ### /core-aam/aamtests/role/button.py ###
 2:26.11 INFO |                Subtest                | Results | Messages |
 2:26.11 INFO |---------------------------------------|---------|----------|
 2:26.11 INFO |                                       | OK      |          |
 2:26.11 INFO | `test_atspi[no-attributes]`           | PASS    |          |
 2:26.11 INFO | `test_atspi[aria-pressed-undefined]`  | PASS    |          |
 2:26.11 INFO | `test_atspi[aria-haspopup-undefined]` | PASS    |          |
 2:26.11 INFO | `test_atspi[aria-haspopup-false]`     | PASS    |          |
 2:26.11 INFO 
 2:26.11 INFO ### /core-aam/aamtests/role/button_haspopup.py ###
 2:26.11 INFO |        Subtest        | Results | Messages |
 2:26.11 INFO |-----------------------|---------|----------|
 2:26.11 INFO |                       | OK      |          |
 2:26.11 INFO | `test_atspi[true]`    | PASS    |          |
 2:26.11 INFO | `test_atspi[menu]`    | PASS    |          |
 2:26.11 INFO | `test_atspi[listbox]` | PASS    |          |
 2:26.11 INFO | `test_atspi[tree]`    | PASS    |          |
 2:26.11 INFO | `test_atspi[grid]`    | PASS    |          |
 2:26.11 INFO | `test_atspi[dialog]`  | PASS    |          |
 2:26.11 INFO 
 2:26.11 INFO ### /core-aam/aamtests/role/button_pressed.py ###
 2:26.11 INFO |       Subtest       | Results | Messages |
 2:26.11 INFO |---------------------|---------|----------|
 2:26.11 INFO |                     | OK      |          |
 2:26.11 INFO | `test_atspi[true]`  | PASS    |          |
 2:26.11 INFO | `test_atspi[false]` | PASS    |          |
 2:26.11 INFO 
 2:26.11 INFO ::: Running tests in a loop with restarts 10 times : PASS
 2:26.11 INFO :::
 2:26.11 INFO ::: Test verification PASS
 2:26.11 INFO :::
[taskcluster 2026-04-28 20:19:44.508Z] === Task Finished ===
[taskcluster 2026-04-28 20:19:44.881Z] Successful task run with exit code: 0 completed in 311.148 seconds
View more details on Community-TC Integration