Skip to content

Extend testdriver.js and wptrunner to test AAMs (platform accessibility APIs) #53733

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
spectranaut wants to merge 38 commits into from

Fix flake8 errors

09f8115
Select commit
Loading
Failed to load commit list.
Closed

Extend testdriver.js and wptrunner to test AAMs (platform accessibility APIs) #53733

Fix flake8 errors
09f8115
Select commit
Loading
Failed to load commit list.
Community-TC Integration / infrastructure/ tests (chrome) succeeded Jan 22, 2026 in 6m 15s

Community-TC (pull_request)

Smoketests for wptrunner in chrome.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-01-22T19:58:38.953Z
Resolved: 2026-01-22T20:03:55.658Z
Task Execution Time: 5 minutes, 16 seconds, 705 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wptreport-chrome.json.gz

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-chrome.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --enable-swiftshader --install-browser --install-webdriver chrome

[taskcluster 2026-01-22 19:58:39.087Z] Task ID: Q3R2HGLYSKqBcFRwzr6n-Q
[taskcluster 2026-01-22 19:58:39.087Z] Worker ID: 82823091564003287
[taskcluster 2026-01-22 19:58:39.087Z] Worker Group: us-east1-b
[taskcluster 2026-01-22 19:58:39.087Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-01-22 19:58:39.087Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-01-22 19:58:39.087Z] Worker Version: 46.1.0
[taskcluster 2026-01-22 19:58:39.087Z] Public IP: 34.26.162.222
[taskcluster 2026-01-22 19:58:39.087Z] Hostname: proj-wpt-ci-ub5oxo5aqhubw-jjuznnpa

b1e71f63927a - Started downloading
b1e71f63927a - Downloaded in 0.033 seconds
66587c81b81a - Started downloading
5b82b858ea7e - Started downloading
08c7e224535e - Started downloading
08c7e224535e - Downloaded in 0.043 seconds
66587c81b81a - Downloaded in 0.206 seconds
32bbaaf98e4c - Started downloading
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0.002 seconds
dd5257950bd4 - Started downloading

...(2555 lines hidden)...

TEST-PASS | /infrastructure/testdriver/bless.html | no action function provided 
TEST-PASS | /infrastructure/testdriver/bless.html | synchronous return value 
TEST-PASS | /infrastructure/testdriver/bless.html | synchronous error 
TEST-PASS | /infrastructure/testdriver/bless.html | asynchronous return value 
TEST-PASS | /infrastructure/testdriver/bless.html | asynchronous error 
 2:28.85 TEST_END: Test OK. Subtests passed 7/7. Unexpected 0
TEST-OK | /infrastructure/testdriver/bless.html | took 1389ms
 2:28.85 TEST_START: /infrastructure/testdriver/click-multiple.html
TEST-START | /infrastructure/testdriver/click-multiple.html
TEST-PASS | /infrastructure/testdriver/click-multiple.html | TestDriver multiple consecutive clicks 
 2:29.45 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click-multiple.html | took 599ms
 2:29.45 TEST_START: /infrastructure/testdriver/click.html
TEST-START | /infrastructure/testdriver/click.html
TEST-PASS | /infrastructure/testdriver/click.html | TestDriver click method 
 2:29.92 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click.html | took 473ms
 2:29.92 TEST_START: /infrastructure/testdriver/click_iframe.html
TEST-START | /infrastructure/testdriver/click_iframe.html
TEST-PASS | /infrastructure/testdriver/click_iframe.html | TestDriver click on a document in an iframe 
 2:30.55 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click_iframe.html | took 629ms
 2:30.55 TEST_START: /infrastructure/testdriver/click_iframe_crossorigin.sub.html
TEST-START | /infrastructure/testdriver/click_iframe_crossorigin.sub.html
TEST-PASS | /infrastructure/testdriver/click_iframe_crossorigin.sub.html | TestDriver click on a document in an iframe 
 2:31.17 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click_iframe_crossorigin.sub.html | took 618ms
 2:31.17 TEST_START: /infrastructure/testdriver/click_nested.html
TEST-START | /infrastructure/testdriver/click_nested.html
TEST-PASS | /infrastructure/testdriver/click_nested.html | TestDriver click method with multiple windows and nested iframe 
 2:32.27 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click_nested.html | took 1095ms
 2:32.27 TEST_START: /infrastructure/testdriver/click_nested_crossorigin.sub.html
TEST-START | /infrastructure/testdriver/click_nested_crossorigin.sub.html
 2:33.17 pid:5966 [6013:6013:0122/200339.718182:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:252] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
PID 5966 | [6013:6013:0122/200339.718182:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:252] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
 2:33.18 pid:5966 [6013:6013:0122/200339.721430:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:252] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
PID 5966 | [6013:6013:0122/200339.721430:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:252] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
TEST-PASS | /infrastructure/testdriver/click_nested_crossorigin.sub.html | TestDriver click method with multiple windows and nested iframe 
 2:33.20 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click_nested_crossorigin.sub.html | took 930ms
 2:33.20 TEST_START: /infrastructure/testdriver/click_window.html
TEST-START | /infrastructure/testdriver/click_window.html
TEST-PASS | /infrastructure/testdriver/click_window.html | TestDriver click method in window 
 2:33.99 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click_window.html | took 791ms
 2:33.99 TEST_START: /infrastructure/testdriver/delete_all_cookies.html
TEST-START | /infrastructure/testdriver/delete_all_cookies.html
TEST-PASS | /infrastructure/testdriver/delete_all_cookies.html | DOM-set cookies get deleted 
TEST-PASS | /infrastructure/testdriver/delete_all_cookies.html | HTTP-set cookies get deleted 
 2:34.63 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/delete_all_cookies.html | took 647ms
 2:34.63 TEST_START: /infrastructure/testdriver/file_upload.sub.html
TEST-START | /infrastructure/testdriver/file_upload.sub.html
TEST-PASS | /infrastructure/testdriver/file_upload.sub.html | File upload using testdriver 
 2:35.19 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/file_upload.sub.html | took 559ms
 2:35.19 TEST_START: /infrastructure/testdriver/generate_test_report.html
TEST-START | /infrastructure/testdriver/generate_test_report.html
TEST-PASS | /infrastructure/testdriver/generate_test_report.html | TestDriver generate_test_report method 
 2:35.68 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/generate_test_report.html | took 489ms
 2:35.69 TEST_START: /infrastructure/testdriver/get_all_cookies.sub.html
TEST-START | /infrastructure/testdriver/get_all_cookies.sub.html
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.html | Get all HTTP cookies 
 2:36.16 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.html | took 477ms
 2:36.16 TEST_START: /infrastructure/testdriver/get_all_cookies.sub.https.html
TEST-START | /infrastructure/testdriver/get_all_cookies.sub.https.html
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.https.html | Get all HTTPS cookies 
 2:36.90 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.https.html | took 734ms
 2:36.90 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.html
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.html | Get Named HTTP cookie 
 2:37.54 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.html | took 646ms
 2:37.54 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.https.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.https.html
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.https.html | Get Named HTTPS cookie 
 2:38.18 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.https.html | took 630ms
 2:38.18 TEST_START: /infrastructure/testdriver/send_keys.html
TEST-START | /infrastructure/testdriver/send_keys.html
TEST-PASS | /infrastructure/testdriver/send_keys.html | TestDriver send keys method 
 2:38.87 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/send_keys.html | took 694ms
 2:38.87 TEST_START: /infrastructure/testdriver/set_get_window_rect.html
TEST-START | /infrastructure/testdriver/set_get_window_rect.html
 2:38.87 pid:5966 [6013:6013:0122/200345.420991:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:252] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
PID 5966 | [6013:6013:0122/200345.420991:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:252] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
TEST-PASS | /infrastructure/testdriver/set_get_window_rect.html | Window Position 
TEST-PASS | /infrastructure/testdriver/set_get_window_rect.html | Window Size 
 2:39.67 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_get_window_rect.html | took 799ms
 2:39.67 TEST_START: /infrastructure/testdriver/set_permission.https.html
TEST-START | /infrastructure/testdriver/set_permission.https.html
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Grant Permission 
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Deny Permission 
 2:40.49 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_permission.https.html | took 816ms
 2:40.49 TEST_START: /infrastructure/testdriver/virtual_authenticator.html
TEST-START | /infrastructure/testdriver/virtual_authenticator.html
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can create an authenticator 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can add a credential 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can get the credentials 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a credential 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove all credentials 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can set user verified 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a virtual authenticator 
 2:41.65 TEST_END: Test OK. Subtests passed 7/7. Unexpected 0
TEST-OK | /infrastructure/testdriver/virtual_authenticator.html | took 1164ms
 2:41.65 TEST_START: /infrastructure/testharness/full.stop/full-stop.html
TEST-START | /infrastructure/testharness/full.stop/full-stop.html
TEST-PASS | /infrastructure/testharness/full.stop/full-stop.html | full-stop 
 2:42.05 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testharness/full.stop/full-stop.html | took 399ms
 2:42.05 TEST_START: /infrastructure/testharness/lone-surrogates.html
TEST-START | /infrastructure/testharness/lone-surrogates.html
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate U+d800 in name 
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate U+d800 in name - assert_true: expected true got false
    at Test.<anonymous> (http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:14)
    at Test.step (http://web-platform.test:8000/resources/testharness.js:2869:25)
    at test (http://web-platform.test:8000/resources/testharness.js:633:30)
    at http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:3
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate in assert 
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate in assert - assert_true: lone U+d800 surrogate expected true got false
    at Test.<anonymous> (http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:14)
    at Test.step (http://web-platform.test:8000/resources/testharness.js:2869:25)
    at test (http://web-platform.test:8000/resources/testharness.js:633:30)
    at http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:3
 2:42.38 TEST_END: Test OK. Subtests passed 2/4. Unexpected 0
TEST-OK | /infrastructure/testharness/lone-surrogates.html | took 334ms
 2:42.38 TEST_START: /infrastructure/window/minimize-1.html
TEST-START | /infrastructure/window/minimize-1.html
 2:42.51 pid:5966 [5983:5998:0122/200349.064564:ERROR:google_apis/gcm/engine/registration_request.cc:291] Registration response error message: DEPRECATED_ENDPOINT
PID 5966 | [5983:5998:0122/200349.064564:ERROR:google_apis/gcm/engine/registration_request.cc:291] Registration response error message: DEPRECATED_ENDPOINT
 2:42.51 pid:5966 [5983:5998:0122/200349.066062:ERROR:google_apis/gcm/engine/mcs_client.cc:700]   Error code: 401  Error message: Authentication Failed: wrong_secret
PID 5966 | [5983:5998:0122/200349.066062:ERROR:google_apis/gcm/engine/mcs_client.cc:700]   Error code: 401  Error message: Authentication Failed: wrong_secret
 2:42.51 pid:5966 [5983:5998:0122/200349.066081:ERROR:google_apis/gcm/engine/mcs_client.cc:702] Failed to log in to GCM, resetting connection.
PID 5966 | [5983:5998:0122/200349.066081:ERROR:google_apis/gcm/engine/mcs_client.cc:702] Failed to log in to GCM, resetting connection.
TEST-PASS | /infrastructure/window/minimize-1.html | Minimize a window 
 2:43.15 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-1.html | took 761ms
 2:43.15 TEST_START: /infrastructure/window/minimize-2.html
TEST-START | /infrastructure/window/minimize-2.html
TEST-PASS | /infrastructure/window/minimize-2.html | Use testdriver to check window is not minimized 
 2:43.75 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-2.html | took 599ms
 2:43.75 INFO No more tests
No more tests
 2:43.86 INFO Closing logging queue
Closing logging queue
 2:43.86 INFO queue closed
queue closed
 2:43.95 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 439 checks (252 subtests, 187 tests)
Expected results: 437
Skipped: 2 tests
Unexpected results: 0
OK
SUITE-END | took 149s
 2:43.96 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
 2:43.96 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
 2:43.96 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
 2:43.98 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
 2:43.99 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
 2:44.00 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
 2:44.00 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
 2:44.00 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
 2:44.01 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 2:44.01 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
 2:44.04 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
wptserve Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 2:44.10 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
 2:44.29 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 2:44.34 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
 2:44.37 INFO Closing logging queue
Closing logging queue
 2:44.37 INFO queue closed
queue closed
[taskcluster 2026-01-22 20:03:52.845Z] === Task Finished ===
[taskcluster 2026-01-22 20:03:53.564Z] Successful task run with exit code: 0 completed in 314.48 seconds
View more details on Community-TC Integration