Skip to content

[ci] Update exist-xqts-runner to 2.0.0-RC4 - #6651

Merged
duncdrum merged 1 commit into
eXist-db:developfrom
line-o:deps/xqts-runner-rc4
Aug 19, 2026
Merged

[ci] Update exist-xqts-runner to 2.0.0-RC4#6651
duncdrum merged 1 commit into
eXist-db:developfrom
line-o:deps/xqts-runner-rc4

Conversation

@line-o

@line-o line-o commented Aug 19, 2026

Copy link
Copy Markdown
Member

Description:

Bumps the exist-xqts-runner_2.13 dependency in exist-xqts/pom.xml from 2.0.0-RC3 to 2.0.0-RC4.

RC4 includes the fix for the runner's nondeterministic JUnit output: RC3 could serialize a test set's result file while cases were still pending and rewrite it repeatedly mid-run, so each run recorded a slightly different subset of test cases (~40 tests of variance between runs of the same commit). That variance showed up as noise in the XQTS comparison step and triggered its recording-drift warning. With RC4, each test set is serialized exactly once after all of its cases complete — two full local runs against the same commit produced identical recorded test sets (0 presence diffs across 31,752 cases).

RC4 is published to the eXist-db GitHub Packages Maven repository, which CI already resolves via the maven-github-settings action and the github-xqts-runner repository declared in exist-parent.

Reference:

Type of tests:

No code changes — dependency version bump only. Verified locally that 2.0.0-RC4 resolves from GitHub Packages; the XQTS CI workflow on this PR exercises the new runner end-to-end.

🤖 Generated with Claude Code

https://claude.ai/code/session_01XqsCRdPehXB5zK1xcNFKEo

RC4 includes the fix for eXist-db/exist-xqts-runner#74: the runner now
serializes each test set's JUnit output exactly once, after all of its
test cases have completed. RC3 could rewrite result files mid-run and
record a nondeterministic subset of test cases (~40 tests of variance
between identical runs), which showed up as noise in the XQTS
comparison and triggered its recording-drift warning.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XqsCRdPehXB5zK1xcNFKEo
@line-o
line-o requested a review from a team as a code owner August 19, 2026 11:36
@github-actions

Copy link
Copy Markdown
Contributor

📊 XQTS result comparison

Comparison of this run against develop.

Warning

Runner JAR build SHA or sha256 differs between the previous and current XQTS runs. Test deltas may include runner-side effects unrelated to this PR. See #6326.

Warning

519 test cases were recorded in only one of the two runs (0 only in the previous run, 519 only in the current run). The runner's JUnit output is not fully deterministic (see eXist-db/exist-xqts-runner#74), so totals and per-category deltas include recording noise; the newly passing/failing lists count only tests recorded in both runs.

Metric develop this run Change
🟢 Passed 28,715 (91.75%) 28,845 (90.66%) +130 (-1.09 pp)
🔴 Failures 1,560 1,569 +9
🔴 Errors 133 134 +1
🔴 Skipped 888 1,267 +379
🧪 Total tests 31,296 31,815 +519

Relative to develop: 0 newly passing, 1 newly failing, 0 new errors, 0 newly skipped — counting only tests recorded in both runs whose outcome changed.

🔴 Newly failing tests (1)
  • Constr-inscope-2 (was passing)
⚪ Recorded only in this run (519)
  • xs-dateTimeStamp-4 (skipped)
  • xs-dateTimeStamp-5 (skipped)
  • xs-dateTimeStamp-2 (skipped)
  • xs-dateTimeStamp-6 (skipped)
  • xs-dateTimeStamp-3 (skipped)
  • fn-load-xquery-module-910 (skipped)
  • fn-load-xquery-module-915 (skipped)
  • fn-load-xquery-module-912 (skipped)
  • fn-load-xquery-module-909 (skipped)
  • fn-load-xquery-module-911 (skipped)
  • fn-load-xquery-module-914 (skipped)
  • fn-load-xquery-module-913 (skipped)
  • xs-double-005 (skipped)
  • xs-double-002 (skipped)
  • xs-double-003 (skipped)
  • xs-double-004 (skipped)
  • cbcl-schema-element-5 (skipped)
  • schema-import-4 (skipped)
  • modules-schema-context (skipped)
  • schema-import-30 (skipped)
  • qischema072-04 (skipped)
  • cbcl-validated-schema-element-4 (skipped)
  • qischema008 (skipped)
  • schema-import-18 (skipped)
  • schema-import-29 (skipped)
  • substitution-001 (skipped)
  • qischema265 (skipped)
  • qischema063q02-err (skipped)
  • qischema90612-err (skipped)
  • substitution-030 (skipped)
  • schema-import-3 (skipped)
  • qischema004 (skipped)
  • substitution-020 (skipped)
  • schema-import-6 (skipped)
  • cbcl-validated-schema-element-1 (skipped)
  • qischema041 (skipped)
  • qischema90061-err (skipped)
  • qischema90008 (skipped)
  • schema-import-19 (skipped)
  • qischema030 (skipped)
  • substitution-023 (skipped)
  • substitution-005 (skipped)
  • qischema062 (skipped)
  • schema-import-12 (skipped)
  • schema-import-23 (skipped)
  • qischema90172-err (skipped)
  • schema-import-20 (skipped)
  • substitution-021 (skipped)
  • qischema90051-err (skipped)
  • qischema072-05 (skipped)
  • … and 469 more

Runtime: 329.2s (-99.27s vs develop).

@duncdrum
duncdrum merged commit 851cfd2 into eXist-db:develop Aug 19, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants