Skip to content

Extend testdriver.js and wptrunner to test AAMs (platform accessibility APIs) #53733

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
spectranaut wants to merge 38 commits into from

Fix flake8 errors

09f8115
Select commit
Loading
Failed to load commit list.
Closed

Extend testdriver.js and wptrunner to test AAMs (platform accessibility APIs) #53733

Fix flake8 errors
09f8115
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-chrome-dev-results succeeded Jan 22, 2026 in 4m 6s

Community-TC (pull_request)

Collect results for all tests affected by a pull request in chrome.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-01-22T19:58:24.723Z
Resolved: 2026-01-22T20:01:44.089Z
Task Execution Time: 3 minutes, 19 seconds, 366 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wpt_report.json.gz
- public/results/wpt_screenshot.txt.gz

WPT Command: python3 ./wpt run --channel=dev --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --enable-swiftshader --install-browser --install-webdriver chrome

[taskcluster 2026-01-22 19:58:24.808Z] Task ID: S2zJcLWwRFKz3N0W4e9UUQ
[taskcluster 2026-01-22 19:58:24.808Z] Worker ID: 3903389688984977367
[taskcluster 2026-01-22 19:58:24.808Z] Worker Group: us-east4-c
[taskcluster 2026-01-22 19:58:24.808Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-01-22 19:58:24.808Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-01-22 19:58:24.808Z] Worker Version: 46.1.0
[taskcluster 2026-01-22 19:58:24.808Z] Public IP: 34.11.20.165
[taskcluster 2026-01-22 19:58:24.808Z] Hostname: proj-wpt-ci-hp-724cltmiqyemhobltka

5b82b858ea7e - Started downloading
b1e71f63927a - Started downloading
b1e71f63927a - Downloaded in 0.008 seconds
66587c81b81a - Started downloading
08c7e224535e - Started downloading
08c7e224535e - Downloaded in 0.007 seconds
32bbaaf98e4c - Started downloading
66587c81b81a - Downloaded in 0.318 seconds
32bbaaf98e4c - Downloaded in 0.296 seconds
dd5257950bd4 - Started downloading
af9ac786cec1 - Started downloading

...(943 lines hidden)...

  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
    raise Exception(

Exception: Couldn't find browser chrome in accessibility API ATSPI. Did you turn on accessibility?

 0:39.89 TEST_END: ERROR, expected OK - Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1171, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1268, in do_testharness
    raw_results = protocol.testdriver.run(url, self.script_resume, test_window)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 696, in run
    done, rv = handler(test_driver_message)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
    result = action_handler(params)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
    return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
    return self.impl.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
    self.__poll_for_tab_if_necessary(url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
    raise Exception(
Exception: Couldn't find browser chrome in accessibility API ATSPI. Did you turn on accessibility?

 0:39.89 INFO No more tests
 0:39.94 INFO Closing logging queue
 0:39.94 INFO queue closed
 0:40.00 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 7 checks (7 tests)
Expected results: 0
Unexpected results: 7
  test: 7 (7 error)

Unexpected Results
------------------
ERROR /core-aam/attribute/aria-autocomplete.tentative.html - Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1171, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1268, in do_testharness
    raw_results = protocol.testdriver.run(url, self.script_resume, test_window)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 696, in run
    done, rv = handler(test_driver_message)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
    result = action_handler(params)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
    return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
    return self.impl.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
    self.__poll_for_tab_if_necessary(url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
    raise Exception(
Exception: Couldn't find browser chrome in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/attribute/aria-braillelabel.tentative.html - Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1171, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1268, in do_testharness
    raw_results = protocol.testdriver.run(url, self.script_resume, test_window)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 696, in run
    done, rv = handler(test_driver_message)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
    result = action_handler(params)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
    return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
    return self.impl.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
    self.__poll_for_tab_if_necessary(url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
    raise Exception(
Exception: Couldn't find browser chrome in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/attribute/aria-errormessage.tentative.html - Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1171, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1268, in do_testharness
    raw_results = protocol.testdriver.run(url, self.script_resume, test_window)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 696, in run
    done, rv = handler(test_driver_message)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
    result = action_handler(params)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
    return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
    return self.impl.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
    self.__poll_for_tab_if_necessary(url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
    raise Exception(
Exception: Couldn't find browser chrome in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/role/blockquote.tentative.html - Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1171, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1268, in do_testharness
    raw_results = protocol.testdriver.run(url, self.script_resume, test_window)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 696, in run
    done, rv = handler(test_driver_message)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
    result = action_handler(params)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
    return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
    return self.impl.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
    self.__poll_for_tab_if_necessary(url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
    raise Exception(
Exception: Couldn't find browser chrome in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/role/button_with_default_values_for_aria-pressed_and_aria-haspopup.tentative.html - Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1171, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1268, in do_testharness
    raw_results = protocol.testdriver.run(url, self.script_resume, test_window)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 696, in run
    done, rv = handler(test_driver_message)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
    result = action_handler(params)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
    return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
    return self.impl.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
    self.__poll_for_tab_if_necessary(url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
    raise Exception(
Exception: Couldn't find browser chrome in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/role/button_with_defined_value_for_aria-pressed.tentative.html - Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1171, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1268, in do_testharness
    raw_results = protocol.testdriver.run(url, self.script_resume, test_window)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 696, in run
    done, rv = handler(test_driver_message)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
    result = action_handler(params)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
    return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
    return self.impl.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
    self.__poll_for_tab_if_necessary(url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
    raise Exception(
Exception: Couldn't find browser chrome in accessibility API ATSPI. Did you turn on accessibility?
ERROR /core-aam/role/button_with_non_false_value_for_aria-haspopup.tentative.html - Traceback (most recent call last):
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1171, in run_func
    self.result = True, self.func(self.protocol, self.url, self.timeout)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 1268, in do_testharness
    raw_results = protocol.testdriver.run(url, self.script_resume, test_window)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 696, in run
    done, rv = handler(test_driver_message)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 805, in __call__
    return callback(url, payload)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/base.py", line 823, in process_action
    result = action_handler(params)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/actions.py", line 609, in __call__
    return self.protocol.platform_accessibility.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/executorplatformaccessibility.py", line 98, in test_accessibility_api
    return self.impl.test_accessibility_api(dom_id, test, api, url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 170, in test_accessibility_api
    self.__poll_for_tab_if_necessary(url)
  File "/home/test/web-platform-tests/tools/wptrunner/wptrunner/executors/platformaccessibility/executoratspi.py", line 152, in __poll_for_tab_if_necessary
    raise Exception(
Exception: Couldn't find browser chrome in accessibility API ATSPI. Did you turn on accessibility?
 0:40.00 INFO Got 7 unexpected results, with 0 unexpected passes
 0:40.00 wptserve INFO Stopped http server on 127.0.0.1:8000
 0:40.00 wptserve INFO Stopped http server on 127.0.0.1:8001
 0:40.00 wptserve INFO Stopped http server on 127.0.0.1:8003
 0:40.00 wptserve INFO Stopped http server on 127.0.0.1:8002
 0:40.00 wptserve INFO Stopped http server on 127.0.0.1:8443
 0:40.01 wptserve INFO Stopped http server on 127.0.0.1:8445
 0:40.01 wptserve INFO Stopped http server on 127.0.0.1:8444
 0:40.02 wptserve INFO Stopped http server on 127.0.0.1:8446
 0:40.02 wptserve INFO Stopped http server on 127.0.0.1:9000
 0:40.02 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 0:40.25 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:40.26 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:40.30 INFO Removed font: Ahem.ttf
 0:40.32 INFO Closing logging queue
 0:40.32 INFO queue closed
 0:40.32 INFO Tolerating 7 unexpected results
[taskcluster 2026-01-22 20:01:42.359Z] === Task Finished ===
[taskcluster 2026-01-22 20:01:43.337Z] Successful task run with exit code: 0 completed in 198.532 seconds
View more details on Community-TC Integration