Skip to content

New fft tests are failing in CI #67

Description

@rgommers

For both NumPy and PyTorch, see for example gh-66. From one CI log:

FAILED array_api_tests/test_fft.py::test_fft - AssertionError: out.dtype=complex128, but should be complex64 [fft(float32)]
Falsifying example: test_fft(
    x=array([0., 0.], dtype=float32),
    data=data(...),
)
Draw 1 (n): None
Draw 2 (axis): 0
Draw 3 (norm): 'ortho'
Draw 4 (kwargs): {'axis': 0, 'norm': 'ortho'}

You can reproduce this example by temporarily adding @reproduce_failure('6.88.4', b'AXicY2BgZGJABYwMAABOAAU=') as a decorator on your test case
FAILED array_api_tests/test_fft.py::test_ifft - AssertionError: out.dtype=complex128, but should be complex64 [ifft(float32)]
Falsifying example: test_ifft(
    x=array([0., 0.], dtype=float32),
    data=data(...),
)
Draw 1 (n): None
Draw 2 (axis): 0
Draw 3 (norm): 'ortho'
Draw 4 (kwargs): {'axis': 0, 'norm': 'ortho'}
Explanation:
    These lines were always and only run by failing examples:
        /home/runner/work/array-api-compat/array-api-compat/array-api-tests/array_api_tests/test_fft.py:91

You can reproduce this example by temporarily adding @reproduce_failure('6.88.4', b'AXicY2BgZGJABYwMAABOAAU=') as a decorator on your test case
FAILED array_api_tests/test_fft.py::test_fftn - AssertionError: out.dtype=complex128, but should be complex64 [fftn(float32)]
Falsifying example: test_fftn(
    x=array([0., 0.], dtype=float32),
    data=data(...),
)
Draw 1 (axes): None
Draw 2 (s): None
Draw 3 (norm): 'ortho'
Draw 4 (kwargs): {'norm': 'ortho'}

You can reproduce this example by temporarily adding @reproduce_failure('6.88.4', b'AXicY2BgZGJABYwMDAAAUwAF') as a decorator on your test case
FAILED array_api_tests/test_fft.py::test_ifftn - AssertionError: out.dtype=complex128, but should be complex64 [ifftn(float32)]
Falsifying example: test_ifftn(
    x=array([0., 0.], dtype=float32),
    data=data(...),
)
Draw 1 (axes): [0]
Draw 2 (s): (1,)
Draw 3 (norm): 'ortho'
Draw 4 (kwargs): {'s': (1,), 'axes': [0], 'norm': 'ortho'}

You can reproduce this example by temporarily adding @reproduce_failure('6.88.4', b'AXicY2BgZGJABoxABAAAUQAG') as a decorator on your test case
FAILED array_api_tests/test_fft.py::test_rfft - ExceptionGroup: Hypothesis found 2 distinct failures. (2 sub-exceptions)
FAILED array_api_tests/test_fft.py::test_irfft - AssertionError: out.dtype=float64, but should be complex64 [irfft(complex64)]
Falsifying example: test_irfft(
    x=array([0.+0.j, 0.+0.j], dtype=complex64),  # or any other generated value
    data=data(...),
)
Draw 1 (n): None
Draw 2 (axis): 0
Draw 3 (norm): 'ortho'
Draw 4 (kwargs): {'axis': 0, 'norm': 'ortho'}

You can reproduce this example by temporarily adding @reproduce_failure('6.88.4', b'AXicY2BkYsAJGBkAAHkABQ==') as a decorator on your test case
FAILED array_api_tests/test_fft.py::test_rfftn - ExceptionGroup: Hypothesis found 2 distinct failures. (2 sub-exceptions)
FAILED array_api_tests/test_fft.py::test_irfftn - AssertionError: out.dtype=float64, but should be complex64 [irfftn(complex64)]
Falsifying example: test_irfftn(
    x=array([0.+0.j, 0.+0.j], dtype=complex64),  # or any other generated value
    data=data(...),
)
Draw 1 (axes): None
Draw 2 (s): None
Draw 3 (norm): 'ortho'
Draw 4 (kwargs): {'norm': 'ortho'}

You can reproduce this example by temporarily adding @reproduce_failure('6.88.4', b'AXicY2BkYsAJGBkYAAB+AAU=') as a decorator on your test case
FAILED array_api_tests/test_fft.py::test_hfft - AssertionError: out.dtype=float64, but should be complex64 [hfft(float32)]
Falsifying example: test_hfft(
    x=array([0., 0.], dtype=float32),  # or any other generated value
    data=data(...),
)
Draw 1 (n): None
Draw 2 (axis): 0
Draw 3 (norm): 'ortho'
Draw 4 (kwargs): {'axis': 0, 'norm': 'ortho'}

You can reproduce this example by temporarily adding @reproduce_failure('6.88.4', b'AXicY2BgZGJABYwMAABOAAU=') as a decorator on your test case
FAILED array_api_tests/test_fft.py::test_ihfft - ExceptionGroup: Hypothesis found 2 distinct failures. (2 sub-exceptions)
= 10 failed, 1003 passed, 85 skipped, 33 xfailed, 2 xpassed, 41102 warnings in 1724.22s (0:28:44) =

That's because data-apis/array-api-tests#196 got merged 4 days ago. @honno could you have a look? If it's not easy to fix, maybe just add a skip for now?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions