[taskcluster 2026-07-08T14:44:13.088Z] Worker Type (scriptworker-1/images) settings:
[taskcluster 2026-07-08T14:44:13.088Z]   {
[taskcluster 2026-07-08T14:44:13.088Z]     "generic-worker": {
[taskcluster 2026-07-08T14:44:13.088Z]       "config": {
[taskcluster 2026-07-08T14:44:13.088Z]         "headlessTasks": true
[taskcluster 2026-07-08T14:44:13.088Z]       },
[taskcluster 2026-07-08T14:44:13.088Z]       "engine": "multiuser",
[taskcluster 2026-07-08T14:44:13.088Z]       "go-arch": "amd64",
[taskcluster 2026-07-08T14:44:13.088Z]       "go-os": "linux",
[taskcluster 2026-07-08T14:44:13.088Z]       "go-version": "go1.26.2",
[taskcluster 2026-07-08T14:44:13.088Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v99.2.1",
[taskcluster 2026-07-08T14:44:13.088Z]       "revision": "ddb9ce7efdb98ae2d0917b69778e9f3cd125e07f",
[taskcluster 2026-07-08T14:44:13.088Z]       "source": "https://github.com/taskcluster/taskcluster/commits/ddb9ce7efdb98ae2d0917b69778e9f3cd125e07f",
[taskcluster 2026-07-08T14:44:13.088Z]       "version": "99.2.1"
[taskcluster 2026-07-08T14:44:13.088Z]     },
[taskcluster 2026-07-08T14:44:13.088Z]     "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-2404-amd64-headless-googlecompute-2026-05-04",
[taskcluster 2026-07-08T14:44:13.088Z]     "instance-id": "288632370945580860",
[taskcluster 2026-07-08T14:44:13.088Z]     "instance-type": "projects/887720501152/machineTypes/c2-standard-4",
[taskcluster 2026-07-08T14:44:13.088Z]     "local-ipv4": "10.138.2.0",
[taskcluster 2026-07-08T14:44:13.088Z]     "project-id": "fxci-production-level1-workers",
[taskcluster 2026-07-08T14:44:13.088Z]     "public-hostname": "scriptworker-1-images-fds35pqstsy13aw-k3cfba.c.fxci-production-level1-workers.internal",
[taskcluster 2026-07-08T14:44:13.088Z]     "public-ipv4": "136.66.228.124",
[taskcluster 2026-07-08T14:44:13.088Z]     "region": "us-west1",
[taskcluster 2026-07-08T14:44:13.088Z]     "zone": "us-west1-c"
[taskcluster 2026-07-08T14:44:13.088Z]   }
[taskcluster 2026-07-08T14:44:13.088Z] Task ID: R77xY3sSRm-DcJIDW01B6A
[taskcluster 2026-07-08T14:44:13.088Z] === Task Starting ===
[taskcluster 2026-07-08T14:44:14.788Z] [mounts] No existing writable directory cache 'scriptworker-level-1-uv-v3-5ddaa3ce44d7548e0d3c-VHD49SYgTjWq79v2dB1Cyg' - creating /home/generic-worker/caches/dwb2DLRiTPmibX55ql4aQA
[taskcluster 2026-07-08T14:44:14.789Z] [mounts] Creating directory /home/task_178352185217939/cache0
[taskcluster 2026-07-08T14:44:14.799Z] [mounts] Successfully mounted writable directory cache '/home/task_178352185217939/cache0'
[taskcluster 2026-07-08T14:44:14.799Z] [mounts] No existing writable directory cache 'scriptworker-level-1-checkouts-v3-5ddaa3ce44d7548e0d3c-VHD49SYgTjWq79v2dB1Cyg' - creating /home/generic-worker/caches/EUKocFCkQ-muw7rbE0j4-w
[taskcluster 2026-07-08T14:44:14.799Z] [mounts] Creating directory /home/task_178352185217939/cache1
[taskcluster 2026-07-08T14:44:14.812Z] [mounts] Successfully mounted writable directory cache '/home/task_178352185217939/cache1'
[taskcluster 2026-07-08T14:44:14.812Z] [mounts] Downloading task VHD49SYgTjWq79v2dB1Cyg artifact public/image.tar.zst to /home/generic-worker/downloads/co-HEH0KQuaW7t6qC0NqCQ
[taskcluster 2026-07-08T14:44:17.249Z] [mounts] Downloaded 100715714 bytes with SHA256 1396e4e30e3f28ef858140b4ca48d4871805ecde764665d7badb004e50322f25 from task VHD49SYgTjWq79v2dB1Cyg artifact public/image.tar.zst to /home/generic-worker/downloads/co-HEH0KQuaW7t6qC0NqCQ
[taskcluster:warn 2026-07-08T14:44:17.249Z] [mounts] Download /home/generic-worker/downloads/co-HEH0KQuaW7t6qC0NqCQ of task VHD49SYgTjWq79v2dB1Cyg artifact public/image.tar.zst has SHA256 1396e4e30e3f28ef858140b4ca48d4871805ecde764665d7badb004e50322f25 but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2026-07-08T14:44:17.249Z] [mounts] File mount "dockerimage" handled by registered handler (cache: /home/generic-worker/downloads/co-HEH0KQuaW7t6qC0NqCQ, SHA256: 1396e4e30e3f28ef858140b4ca48d4871805ecde764665d7badb004e50322f25)
[taskcluster 2026-07-08T14:44:17.249Z] [d2g] Loading docker image
[taskcluster 2026-07-08T14:44:21.445Z] [d2g] Loaded docker image "python3.12:latest"
[taskcluster 2026-07-08T14:44:21.446Z] Executing command 0: docker run -t --name taskcontainer_N15o1MJ1QkupIY6odWa-nA --memory-swap -1 --pids-limit -1 --pull=never --log-driver=none '--add-host=localhost.localdomain:127.0.0.1' -v '/home/task_178352185217939/cache0:/builds/worker/.task-cache/uv' -v /home/task_178352185217939/cache1:/builds/worker/checkouts --add-host=taskcluster:host-gateway --env-file 'env.list' 15d7bd40465c19fe468da5d336cbe144d821994af3546bd61a443a07a0bc8c9a /usr/local/bin/run-task --scriptworker-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- sh -lxce 'uv run tox -e py312-cot'
[setup 2026-07-08T14:44:23.462+00:00] run-task started in /
[setup 2026-07-08T14:44:23.462+00:00] Invoked by command: --scriptworker-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- sh -lxce uv run tox -e py312-cot
[setup 2026-07-08T14:44:23.463+00:00] Python version: 3.12.12
[setup 2026-07-08T14:44:23.463+00:00] Subprocess python version: 
cpython-3.12.12-linux-x86_64-gnu    /usr/local/bin/python3.12
cpython-3.12.12-linux-x86_64-gnu    /usr/local/bin/python3 -> python3.12
cpython-3.12.12-linux-x86_64-gnu    /usr/local/bin/python -> python3
[cache 2026-07-08T14:44:23.639+00:00] cache /builds/worker/.task-cache/uv is empty; writing requirements: gid=1000 uid=1000 version=1
[cache 2026-07-08T14:44:23.640+00:00] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2026-07-08T14:44:23.640+00:00] volume /builds/worker/.task-cache/uv is a cache
[volume 2026-07-08T14:44:23.640+00:00] volume /builds/worker/checkouts is a cache
[setup 2026-07-08T14:44:23.640+00:00] running as worker:worker
[vcs 2026-07-08T14:44:23.640+00:00] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2026-07-08T14:44:23.643+00:00] executing ['git', 'clone', 'https://github.com/mozilla-releng/scriptworker', '/builds/worker/checkouts/vcs']
[vcs 2026-07-08T14:44:23.644+00:00] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2026-07-08T14:44:24.513+00:00] executing ['git', 'fetch', 'https://github.com/jcristau/scriptworker', 'cot-product-optional']
[vcs 2026-07-08T14:44:24.920+00:00] From https://github.com/jcristau/scriptworker
[vcs 2026-07-08T14:44:24.920+00:00]  * branch            cot-product-optional -> FETCH_HEAD
[vcs 2026-07-08T14:44:24.922+00:00] executing ['git', 'checkout', '-f', '-B', 'cot-product-optional', '3125e1b28f6114be009990fe171490e7a5ae5c77']
[vcs 2026-07-08T14:44:24.996+00:00] Switched to a new branch 'cot-product-optional'
[vcs 2026-07-08T14:44:24.997+00:00] cleaning git checkout...
[vcs 2026-07-08T14:44:24.997+00:00] executing ['git', 'clean', '-nxdff']
[vcs 2026-07-08T14:44:24.999+00:00] removing []
[vcs 2026-07-08T14:44:24.999+00:00] successfully cleaned git checkout!
[vcs 2026-07-08T14:44:25.001+00:00] TinderboxPrint:<a href='https://github.com/jcristau/scriptworker/commit/3125e1b28f6114be009990fe171490e7a5ae5c77' title='Built from scriptworker commit 3125e1b28f6114be009990fe171490e7a5ae5c77'>3125e1b28f6114be009990fe171490e7a5ae5c77</a>
[setup 2026-07-08T14:44:25.001+00:00] UV_CACHE_DIR is /builds/worker/.task-cache/uv
[task 2026-07-08T14:44:25.001+00:00] executing ['sh', '-lxce', 'uv run tox -e py312-cot']
[task 2026-07-08T14:44:25.002+00:00] + id -u
[task 2026-07-08T14:44:25.003+00:00] + [ 1000 -eq 0 ]
[task 2026-07-08T14:44:25.003+00:00] + PATH=/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
[task 2026-07-08T14:44:25.003+00:00] + export PATH
[task 2026-07-08T14:44:25.003+00:00] + [ $  ]
[task 2026-07-08T14:44:25.003+00:00] + [  ]
[task 2026-07-08T14:44:25.003+00:00] + id -u
[task 2026-07-08T14:44:25.004+00:00] + [ 1000 -eq 0 ]
[task 2026-07-08T14:44:25.004+00:00] + PS1=$ 
[task 2026-07-08T14:44:25.004+00:00] + [ -d /etc/profile.d ]
[task 2026-07-08T14:44:25.004+00:00] + [ -r /etc/profile.d/*.sh ]
[task 2026-07-08T14:44:25.004+00:00] + unset i
[task 2026-07-08T14:44:25.004+00:00] + uv run tox -e py312-cot
[task 2026-07-08T14:44:25.086+00:00] Using CPython 3.12.12 interpreter at: /usr/local/bin/python3
[task 2026-07-08T14:44:25.086+00:00] Creating virtual environment at: .venv
[task 2026-07-08T14:44:25.707+00:00]    Building scriptworker @ file:///builds/worker/checkouts/vcs
[task 2026-07-08T14:44:25.743+00:00] Downloading pygments (1.2MiB)
[task 2026-07-08T14:44:25.754+00:00] Downloading aiohttp (1.7MiB)
[task 2026-07-08T14:44:25.756+00:00] Downloading mypy (14.5MiB)
[task 2026-07-08T14:44:25.757+00:00] Downloading ast-serialize (1.2MiB)
[task 2026-07-08T14:44:25.758+00:00] Downloading cryptography (4.5MiB)
[task 2026-07-08T14:44:25.759+00:00] Downloading virtualenv (5.3MiB)
[task 2026-07-08T14:44:25.760+00:00] Downloading ruff (11.0MiB)
[task 2026-07-08T14:44:25.761+00:00] Downloading uv (25.9MiB)
[task 2026-07-08T14:44:26.247+00:00]  Downloaded ast-serialize
[task 2026-07-08T14:44:26.649+00:00]  Downloaded virtualenv
[task 2026-07-08T14:44:26.734+00:00]  Downloaded ruff
[task 2026-07-08T14:44:26.807+00:00]  Downloaded aiohttp
[task 2026-07-08T14:44:26.927+00:00]       Built scriptworker @ file:///builds/worker/checkouts/vcs
[task 2026-07-08T14:44:26.937+00:00]  Downloaded uv
[task 2026-07-08T14:44:26.952+00:00]  Downloaded cryptography
[task 2026-07-08T14:44:26.992+00:00]  Downloaded pygments
[task 2026-07-08T14:44:27.178+00:00]  Downloaded mypy
[task 2026-07-08T14:44:27.179+00:00] warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
[task 2026-07-08T14:44:27.179+00:00]          If the cache and target directories are on different filesystems, hardlinking may not be supported.
[task 2026-07-08T14:44:27.179+00:00]          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
[task 2026-07-08T14:44:27.343+00:00] Installed 100 packages in 164ms
[task 2026-07-08T14:44:28.025+00:00] py312-cot: venv> .venv/bin/uv venv -p cpython3.12 --allow-existing '--prompt=vcs[py312-cot]' --python-preference system /builds/worker/checkouts/vcs/.tox/py312-cot
[task 2026-07-08T14:44:28.244+00:00] .pkg: venv> .venv/bin/uv venv -p /builds/worker/checkouts/vcs/.venv/bin/python --allow-existing '--prompt=vcs[.pkg]' --python-preference system /builds/worker/checkouts/vcs/.tox/.pkg
[task 2026-07-08T14:44:28.261+00:00] .pkg: install_requires> .venv/bin/uv pip install hatchling
[task 2026-07-08T14:44:28.514+00:00] .pkg: _optional_hooks> python /builds/worker/checkouts/vcs/.venv/lib/python3.12/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-07-08T14:44:28.557+00:00] .pkg: get_requires_for_build_editable> python /builds/worker/checkouts/vcs/.venv/lib/python3.12/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-07-08T14:44:28.672+00:00] .pkg: install_requires_for_build_editable> .venv/bin/uv pip install 'editables~=0.3'
[task 2026-07-08T14:44:28.805+00:00] .pkg: build_editable> python /builds/worker/checkouts/vcs/.venv/lib/python3.12/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-07-08T14:44:28.915+00:00] py312-cot: install_package_deps> .venv/bin/uv pip install PyYAML 'aiohttp>=3' 'arrow>=1.0' 'cryptography>=2.6.1' dictdiffer github3.py 'immutabledict>=1.3.0' 'json-e>=2.5.0' 'jsonschema[format-nongpl]' taskcluster-taskgraph 'taskcluster>=40'
[task 2026-07-08T14:44:29.954+00:00] py312-cot: install_package> .venv/bin/uv pip install --reinstall --no-deps scriptworker@/builds/worker/checkouts/vcs/.tox/.tmp/package/1/scriptworker-63.2.0-py3-none-any.whl
[task 2026-07-08T14:44:30.031+00:00] py312-cot: commands[0]> py.test -k test_verify_production_cot --random-order-bucket=none
[task 2026-07-08T14:44:33.589+00:00] ============================= test session starts ==============================
[task 2026-07-08T14:44:33.589+00:00] platform linux -- Python 3.12.12, pytest-9.1.1, pluggy-1.6.0
[task 2026-07-08T14:44:33.589+00:00] cachedir: .tox/py312-cot/.pytest_cache
[task 2026-07-08T14:44:33.589+00:00] Using --random-order-bucket=none
[task 2026-07-08T14:44:33.589+00:00] Using --random-order-seed=131622
[task 2026-07-08T14:44:33.589+00:00] 
[task 2026-07-08T14:44:33.589+00:00] rootdir: /builds/worker/checkouts/vcs
[task 2026-07-08T14:44:33.589+00:00] configfile: pyproject.toml (WARNING: ignoring pytest config in tox.ini!)
[task 2026-07-08T14:44:33.589+00:00] plugins: asyncio-1.4.0, mock-3.15.1, random-order-1.2.0
[task 2026-07-08T14:44:33.589+00:00] asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
[task 2026-07-08T14:44:33.590+00:00] collected 706 items / 695 deselected / 11 selected
[task 2026-07-08T14:44:33.590+00:00] 
[task 2026-07-08T14:47:04.554+00:00] tests/test_production.py ...........                                     [100%]
[task 2026-07-08T14:47:04.554+00:00] 
[task 2026-07-08T14:47:04.554+00:00] ================ 11 passed, 695 deselected in 153.01s (0:02:33) ================
[task 2026-07-08T14:47:04.979+00:00] .pkg: _exit> python /builds/worker/checkouts/vcs/.venv/lib/python3.12/site-packages/pyproject_api/_backend.py True hatchling.build
[task 2026-07-08T14:47:05.016+00:00]   py312-cot: OK (156.99=setup[2.05]+cmd[154.95] seconds)
[task 2026-07-08T14:47:05.016+00:00]   congratulations :) (157.07 seconds)
[taskcluster 2026-07-08T14:47:05.201Z]                        Exit Code: 0
[taskcluster 2026-07-08T14:47:05.201Z]                        User Time: 15.657ms
[taskcluster 2026-07-08T14:47:05.201Z]                      Kernel Time: 16.701ms
[taskcluster 2026-07-08T14:47:05.201Z]                        Wall Time: 2m43.755479845s
[taskcluster 2026-07-08T14:47:05.201Z]  Average Available System Memory: 14.51 GiB
[taskcluster 2026-07-08T14:47:05.201Z]       Average System Memory Used: 1.10 GiB
[taskcluster 2026-07-08T14:47:05.201Z]          Peak System Memory Used: 1.51 GiB
[taskcluster 2026-07-08T14:47:05.201Z]              Total System Memory: 15.61 GiB
[taskcluster 2026-07-08T14:47:05.201Z]                           Result: SUCCEEDED
[taskcluster 2026-07-08T14:47:05.202Z] === Task Finished ===
[taskcluster 2026-07-08T14:47:05.202Z] Task Duration: 2m43.756435424s
[taskcluster 2026-07-08T14:47:05.225Z] [mounts] Preserving cache: Moving "/home/task_178352185217939/cache0" to "/home/generic-worker/caches/dwb2DLRiTPmibX55ql4aQA"
[taskcluster 2026-07-08T14:47:05.225Z] [mounts] Preserving cache: Moving "/home/task_178352185217939/cache1" to "/home/generic-worker/caches/EUKocFCkQ-muw7rbE0j4-w"