Skip to content

Extend testdriver.js and wptrunner to test AAMs (platform accessibility APIs) #53733

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
spectranaut wants to merge 38 commits into from

Fix flake8 errors

09f8115
Select commit
Loading
Failed to load commit list.
Closed

Extend testdriver.js and wptrunner to test AAMs (platform accessibility APIs) #53733

Fix flake8 errors
09f8115
Select commit
Loading
Failed to load commit list.
Community-TC Integration / infrastructure/ tests (firefox) succeeded Jan 22, 2026 in 52m 7s

Community-TC (pull_request)

Smoketests for wptrunner in firefox.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-01-22T19:59:37.851Z
Resolved: 2026-01-22T20:49:45.834Z
Task Execution Time: 50 minutes, 7 seconds, 983 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wptreport-firefox.json.gz

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --binary=/home/test/build/firefox/firefox firefox

[taskcluster 2026-01-22 19:59:37.965Z] Task ID: KCNzMOy4Sj2zAQL0kEGOLw
[taskcluster 2026-01-22 19:59:37.965Z] Worker ID: 2429388493892304786
[taskcluster 2026-01-22 19:59:37.965Z] Worker Group: us-central1-f
[taskcluster 2026-01-22 19:59:37.965Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-01-22 19:59:37.965Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-01-22 19:59:37.965Z] Worker Version: 46.1.0
[taskcluster 2026-01-22 19:59:37.965Z] Public IP: 34.56.88.95
[taskcluster 2026-01-22 19:59:37.965Z] Hostname: proj-wpt-ci-fry4rtxtro2ng9eizpum4w

b1e71f63927a - Started downloading
66587c81b81a - Started downloading
5b82b858ea7e - Started downloading
b1e71f63927a - Downloaded in 0.034 seconds
08c7e224535e - Started downloading
66587c81b81a - Downloaded in 0.21 seconds
08c7e224535e - Downloaded in 0.046 seconds
32bbaaf98e4c - Started downloading
32bbaaf98e4c - Downloaded in 0.405 seconds
dd5257950bd4 - Started downloading
dd5257950bd4 - Downloaded in 0.083 seconds

...(5224 lines hidden)...

Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.html | Get all HTTP cookies 
47:08.27 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.html | took 193ms
47:08.27 TEST_START: /infrastructure/testdriver/get_all_cookies.sub.https.html
TEST-START | /infrastructure/testdriver/get_all_cookies.sub.https.html
47:08.28 INFO Closing window ac8c8500-ccb9-43bd-a416-be49fbb97bb0
Closing window ac8c8500-ccb9-43bd-a416-be49fbb97bb0
47:08.65 INFO Getting all cookies
Getting all cookies
47:08.66 INFO Deleting all cookies
Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.https.html | Get all HTTPS cookies 
47:08.67 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.https.html | took 398ms
47:08.67 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.html
47:08.67 INFO Closing window 5f73cf94-0476-4d52-b610-7a0fccc08983
Closing window 5f73cf94-0476-4d52-b610-7a0fccc08983
47:08.85 INFO Getting cookie named test0
Getting cookie named test0
47:08.86 INFO Getting cookie named test1
Getting cookie named test1
47:08.86 INFO Getting cookie named test2
Getting cookie named test2
47:08.86 INFO Getting cookie named test3
Getting cookie named test3
47:08.87 INFO Getting cookie named test4
Getting cookie named test4
47:08.88 INFO Getting cookie named test5
Getting cookie named test5
47:08.88 INFO Getting cookie named test6
Getting cookie named test6
47:08.89 INFO Getting cookie named test7
Getting cookie named test7
47:08.90 INFO Deleting all cookies
Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.html | Get Named HTTP cookie 
47:08.90 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.html | took 235ms
47:08.90 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.https.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.https.html
47:08.91 INFO Closing window 5730e96d-77f7-4d24-aaf9-d64985493e8f
Closing window 5730e96d-77f7-4d24-aaf9-d64985493e8f
mem avail: 13886 of 15806 MiB (87.85%), swap free:    0 of    0 MiB ( 0.00%)
47:09.17 INFO Getting cookie named test0
Getting cookie named test0
47:09.17 INFO Getting cookie named test1
Getting cookie named test1
47:09.18 INFO Getting cookie named test2
Getting cookie named test2
47:09.18 INFO Getting cookie named test3
Getting cookie named test3
47:09.19 INFO Getting cookie named test4
Getting cookie named test4
47:09.20 INFO Getting cookie named test5
Getting cookie named test5
47:09.20 INFO Getting cookie named test6
Getting cookie named test6
47:09.21 INFO Getting cookie named test7
Getting cookie named test7
47:09.21 INFO Getting cookie named test8
Getting cookie named test8
47:09.22 INFO Deleting all cookies
Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.https.html | Get Named HTTPS cookie 
47:09.23 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.https.html | took 322ms
47:09.23 TEST_START: /infrastructure/testdriver/send_keys.html
TEST-START | /infrastructure/testdriver/send_keys.html
47:09.23 INFO Closing window 883410f4-bed1-4a91-a6ec-a5a69ebf882a
Closing window 883410f4-bed1-4a91-a6ec-a5a69ebf882a
TEST-PASS | /infrastructure/testdriver/send_keys.html | TestDriver send keys method 
47:09.54 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/send_keys.html | took 311ms
47:09.54 TEST_START: /infrastructure/testdriver/set_get_window_rect.html
TEST-START | /infrastructure/testdriver/set_get_window_rect.html
47:09.54 INFO Closing window d355e300-62b3-4a58-b41e-c7dde667cb47
Closing window d355e300-62b3-4a58-b41e-c7dde667cb47
TEST-PASS | /infrastructure/testdriver/set_get_window_rect.html | Window Position 
TEST-PASS | /infrastructure/testdriver/set_get_window_rect.html | Window Size 
47:09.74 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_get_window_rect.html | took 206ms
47:09.74 TEST_START: /infrastructure/testdriver/set_permission.https.html
TEST-START | /infrastructure/testdriver/set_permission.https.html
47:09.75 INFO Closing window 60e33ff4-c053-41de-b7d8-a2c799705a58
Closing window 60e33ff4-c053-41de-b7d8-a2c799705a58
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Grant Permission 
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Deny Permission 
47:10.02 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_permission.https.html | took 272ms
47:10.02 TEST_START: /infrastructure/testdriver/virtual_authenticator.html
TEST-START | /infrastructure/testdriver/virtual_authenticator.html
47:10.02 INFO Closing window 4bc7c5a0-67af-428e-a396-ec5335e9b207
Closing window 4bc7c5a0-67af-428e-a396-ec5335e9b207
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can create an authenticator 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can add a credential 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can get the credentials 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a credential 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove all credentials 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can set user verified 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a virtual authenticator 
47:10.33 TEST_END: Test OK. Subtests passed 7/7. Unexpected 0
TEST-OK | /infrastructure/testdriver/virtual_authenticator.html | took 315ms
47:10.33 TEST_START: /infrastructure/testharness/full.stop/full-stop.html
TEST-START | /infrastructure/testharness/full.stop/full-stop.html
47:10.33 INFO Closing window 1b54e145-2c82-4bee-8743-7c56c73fc901
Closing window 1b54e145-2c82-4bee-8743-7c56c73fc901
TEST-PASS | /infrastructure/testharness/full.stop/full-stop.html | full-stop 
47:10.50 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testharness/full.stop/full-stop.html | took 171ms
47:10.50 TEST_START: /infrastructure/testharness/lone-surrogates.html
TEST-START | /infrastructure/testharness/lone-surrogates.html
47:10.51 INFO Closing window 7a80ce29-36f0-4cbc-b739-2b92176bf3cf
Closing window 7a80ce29-36f0-4cbc-b739-2b92176bf3cf
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate U+d800 in name 
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate U+d800 in name - assert_true: expected true got false
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:25
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2869:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:7
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate in assert 
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate in assert - assert_true: lone U+d800 surrogate expected true got false
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:25
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2869:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:7
47:10.66 TEST_END: Test OK. Subtests passed 2/4. Unexpected 0
TEST-OK | /infrastructure/testharness/lone-surrogates.html | took 159ms
47:10.66 TEST_START: /infrastructure/window/minimize-1.html
TEST-START | /infrastructure/window/minimize-1.html
47:10.66 INFO Closing window 68238ca7-51ec-4e5f-b39f-72bc06c7add0
Closing window 68238ca7-51ec-4e5f-b39f-72bc06c7add0
TEST-PASS | /infrastructure/window/minimize-1.html | Minimize a window 
47:11.82 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-1.html | took 1156ms
47:11.82 TEST_START: /infrastructure/window/minimize-2.html
TEST-START | /infrastructure/window/minimize-2.html
47:11.82 INFO Closing window 8944b7c8-9de3-47a2-a3d7-1827b830ad95
Closing window 8944b7c8-9de3-47a2-a3d7-1827b830ad95
TEST-PASS | /infrastructure/window/minimize-2.html | Use testdriver to check window is not minimized 
47:12.19 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-2.html | took 372ms
47:12.19 INFO No more tests
No more tests
47:12.19 pid:27467 1769114982287	Marionette	INFO	Stopped listening on port 45819
PID 27467 | 1769114982287	Marionette	INFO	Stopped listening on port 45819
47:12.88 INFO Browser exited with return code -15
Browser exited with return code -15
47:12.75 INFO Closing logging queue
Closing logging queue
47:12.75 INFO queue closed
queue closed
47:12.89 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 411 checks (224 subtests, 187 tests)
Expected results: 409
Skipped: 2 tests
Unexpected results: 0
OK
SUITE-END | took 2773s
47:12.89 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
47:12.89 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
47:12.89 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
47:12.89 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
47:12.89 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
47:12.89 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
47:12.91 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
47:12.91 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
47:12.92 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
47:12.92 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
47:12.92 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
wptserve Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
47:12.96 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
47:13.17 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
47:13.21 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
47:13.24 INFO Closing logging queue
Closing logging queue
47:13.24 INFO queue closed
queue closed
/usr/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 93 leaked semaphore objects to clean up at shutdown
  warnings.warn('resource_tracker: There appear to be %d '
[taskcluster 2026-01-22 20:49:44.369Z] === Task Finished ===
[taskcluster 2026-01-22 20:49:45.045Z] Successful task run with exit code: 0 completed in 3007.083 seconds
View more details on Community-TC Integration