Extend testdriver.js and wptrunner to test AAMs (platform accessibility APIs) #53733
Community-TC Integration / wpt-firefox-nightly-results
succeeded
Jan 22, 2026 in 13m 46s
Community-TC (pull_request)
Collect results for all tests affected by a pull request in firefox.
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2026-01-22T20:00:48.547Z
Resolved: 2026-01-22T20:11:23.001Z
Task Execution Time: 10 minutes, 34 seconds, 454 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wpt_report.json.gz
- public/results/wpt_screenshot.txt.gz
WPT Command: python3 ./wpt run --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --binary=/home/test/build/firefox/firefox firefox
[taskcluster 2026-01-22 20:00:48.642Z] Task ID: NYF3XjqsT_aArh2Tyrv-XQ
[taskcluster 2026-01-22 20:00:48.643Z] Worker ID: 6106037407308529450
[taskcluster 2026-01-22 20:00:48.643Z] Worker Group: us-east4-c
[taskcluster 2026-01-22 20:00:48.643Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-01-22 20:00:48.643Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-01-22 20:00:48.643Z] Worker Version: 46.1.0
[taskcluster 2026-01-22 20:00:48.643Z] Public IP: 35.188.242.85
[taskcluster 2026-01-22 20:00:48.643Z] Hostname: proj-wpt-ci-bknpw1kwt4a83i849j1plg
b1e71f63927a - Started downloading
b1e71f63927a - Downloaded in 0.004 seconds
66587c81b81a - Started downloading
5b82b858ea7e - Started downloading
08c7e224535e - Started downloading
08c7e224535e - Downloaded in 0.007 seconds
32bbaaf98e4c - Started downloading
66587c81b81a - Downloaded in 0.191 seconds
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0.002 seconds
dd5257950bd4 - Started downloading
...(1115 lines hidden)...
8:01.29 TEST_END: ERROR, expected OK - Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 966, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1093, in do_testharness
rv = protocol.testdriver.run(url, self.script_resume, test_window=test_window)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 510, in run
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
result = action_handler(params)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
return self.impl.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
self.__poll_for_tab_if_necessary(url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
raise Exception(
Exception: Couldn't find browser firefox in accessibility API ATSPI. Did you turn on accessibility?
8:01.29 INFO No more tests
8:01.29 pid:5428 1769112678154 Marionette INFO Stopped listening on port 60539
8:02.07 INFO Browser exited with return code -15
8:01.91 INFO Closing logging queue
8:01.91 INFO queue closed
8:02.08 SUITE_END
web-platform-test
~~~~~~~~~~~~~~~~~
Ran 7 checks (7 tests)
Expected results: 0
Unexpected results: 7
test: 7 (7 error)
Unexpected Results
------------------
ERROR /core-aam/attribute/aria-autocomplete.tentative.html - Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 966, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1093, in do_testharness
rv = protocol.testdriver.run(url, self.script_resume, test_window=test_window)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 510, in run
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
result = action_handler(params)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
return self.impl.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
self.__poll_for_tab_if_necessary(url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
raise Exception(
Exception: Couldn't find browser firefox in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/attribute/aria-braillelabel.tentative.html - Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 966, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1093, in do_testharness
rv = protocol.testdriver.run(url, self.script_resume, test_window=test_window)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 510, in run
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
result = action_handler(params)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
return self.impl.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
self.__poll_for_tab_if_necessary(url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
raise Exception(
Exception: Couldn't find browser firefox in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/attribute/aria-errormessage.tentative.html - Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 966, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1093, in do_testharness
rv = protocol.testdriver.run(url, self.script_resume, test_window=test_window)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 510, in run
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
result = action_handler(params)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
return self.impl.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
self.__poll_for_tab_if_necessary(url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
raise Exception(
Exception: Couldn't find browser firefox in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/role/blockquote.tentative.html - Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 966, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1093, in do_testharness
rv = protocol.testdriver.run(url, self.script_resume, test_window=test_window)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 510, in run
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
result = action_handler(params)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
return self.impl.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
self.__poll_for_tab_if_necessary(url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
raise Exception(
Exception: Couldn't find browser firefox in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/role/button_with_default_values_for_aria-pressed_and_aria-haspopup.tentative.html - Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 966, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1093, in do_testharness
rv = protocol.testdriver.run(url, self.script_resume, test_window=test_window)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 510, in run
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
result = action_handler(params)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
return self.impl.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
self.__poll_for_tab_if_necessary(url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
raise Exception(
Exception: Couldn't find browser firefox in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/role/button_with_defined_value_for_aria-pressed.tentative.html - Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 966, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1093, in do_testharness
rv = protocol.testdriver.run(url, self.script_resume, test_window=test_window)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 510, in run
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
result = action_handler(params)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
return self.impl.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
self.__poll_for_tab_if_necessary(url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
raise Exception(
Exception: Couldn't find browser firefox in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/role/button_with_non_false_value_for_aria-haspopup.tentative.html - Traceback (most recent call last):
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 966, in run_func
self.result = True, self.func(self.protocol, self.url, self.timeout)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 1093, in do_testharness
rv = protocol.testdriver.run(url, self.script_resume, test_window=test_window)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executormarionette.py", line 510, in run
done, rv = handler(result)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
return callback(url, payload)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
result = action_handler(params)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
return self.impl.test_accessibility_api(dom_id, test, api, url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
self.__poll_for_tab_if_necessary(url)
File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
raise Exception(
Exception: Couldn't find browser firefox in accessibility API ATSPI. Did you turn on accessibility?
8:02.08 INFO Got 7 unexpected results, with 0 unexpected passes
8:02.08 wptserve INFO Stopped http server on 127.0.0.1:8000
8:02.08 wptserve INFO Stopped http server on 127.0.0.1:8001
8:02.09 wptserve INFO Stopped http server on 127.0.0.1:8002
8:02.10 wptserve INFO Stopped http server on 127.0.0.1:8445
8:02.10 wptserve INFO Stopped http server on 127.0.0.1:8444
8:02.12 wptserve INFO Stopped http server on 127.0.0.1:9000
8:02.12 wptserve INFO Stopped http server on 127.0.0.1:8443
8:02.12 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
8:02.12 wptserve INFO Stopped http server on 127.0.0.1:8446
8:02.12 wptserve INFO Stopped http server on 127.0.0.1:8003
8:02.31 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
8:02.31 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
8:02.37 INFO Removed font: Ahem.ttf
8:02.40 INFO Closing logging queue
8:02.40 INFO queue closed
8:02.40 INFO Tolerating 7 unexpected results
/usr/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 18 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
[taskcluster 2026-01-22 20:11:21.224Z] === Task Finished ===
[taskcluster 2026-01-22 20:11:22.241Z] Successful task run with exit code: 0 completed in 633.601 seconds
Loading