Skip to content

Exclude iOS Simulator (Metal) failing validation tests#1773

Draft
CedricGuillemet wants to merge 1 commit into
BabylonJS:masterfrom
CedricGuillemet:ios-simulator-test-exclusions
Draft

Exclude iOS Simulator (Metal) failing validation tests#1773
CedricGuillemet wants to merge 1 commit into
BabylonJS:masterfrom
CedricGuillemet:ios-simulator-test-exclusions

Conversation

@CedricGuillemet

Copy link
Copy Markdown
Collaborator

Excludes 22 Playground validation test entries from automatic testing on the Metal backend so the iOS Simulator visualization suite runs to completion:

  • 'NPE - Angle align': crashes with an MTLVertexDescriptor assertion (attribute references a buffer with no stride) in the particle/instance rendering path, same class as the already-excluded 'Attractors' and 'Particles'.
  • 21 pixel-comparison failures observed on the iOS Simulator's Metal backend (mostly skinning/animation and shadow paths), each tagged with a reason for follow-up investigation.

Excludes 22 Playground validation test entries from automatic testing on
the Metal backend so the iOS Simulator visualization suite runs to
completion:

- 'NPE - Angle align': crashes with an MTLVertexDescriptor assertion
  (attribute references a buffer with no stride) in the particle/instance
  rendering path, same class as the already-excluded 'Attractors' and
  'Particles'.
- 21 pixel-comparison failures observed on the iOS Simulator's Metal
  backend (mostly skinning/animation and shadow paths), each tagged with a
  reason for follow-up investigation.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings July 8, 2026 09:59

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the Playground validation test configuration to allow the iOS Simulator Metal visualization suite to run to completion by skipping known-crashing and known pixel-diff tests on the Metal backend.

Changes:

  • Adds excludedGraphicsApis: ["Metal"] to 22 affected validation entries.
  • Annotates each newly excluded entry with a reason string describing the observed failure mode for follow-up investigation.

Comment on lines 17 to 21
"title": "Native Canvas",
"excludedGraphicsApis": ["Metal"],
"reason": "iOS Simulator (Metal): NativeCanvas 2D output differs from reference; needs investigation.",
"playgroundId": "#TKVFSA#8",
"referenceImage": "native-canvas.png"
@CedricGuillemet CedricGuillemet marked this pull request as draft July 8, 2026 11:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants