Skip to content

JSON Schema Draft 2020-12 Test Suite - Known Failing Tests #62

Description

@simbo1905

This issue tracks the known failing tests in the JSON Schema Draft 2020-12 Test Suite that are currently being skipped.

Test Results

  • Total Tests: 3472
  • Passed: 2048
  • Failed: 0 (after skipping)
  • Skipped: 1424

Known Failing Tests

The following tests are skipped due to known implementation issues:

Reference Resolution Issues (6 tests)

  • ref.json#relative pointer ref to array#match array
  • ref.json#relative pointer ref to array#mismatch array
  • refOfUnknownKeyword.json#reference of a root arbitrary keyword #match
  • refOfUnknownKeyword.json#reference of a root arbitrary keyword #mismatch
  • refOfUnknownKeyword.json#reference of an arbitrary keyword of a sub-schema#match
  • refOfUnknownKeyword.json#reference of an arbitrary keyword of a sub-schema#mismatch

JSON Parsing Issues (2 tests)

  • required.json#required with escaped characters#object with all properties present is valid
  • required.json#required with escaped characters#object with some properties missing is invalid

Additional Context

The 2020-12 test suite has many more tests that show as "Mismatch (ignored)" in lenient mode, but these are the only tests that actually throw exceptions and would cause build failures if not skipped.

Root Causes

  1. **Unresolved **: Reference resolution issues with prefixItems and unknown keywords
  2. Duplicate member names: JSON parser limitations with escaped characters in object keys

Implementation Status

These tests are currently skipped using Assumptions.assumeTrue(false, ...) to prevent build failures while maintaining test coverage for passing tests.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions