Incorrect parameterized tests are generated for `Sort.partition`

[alisevych]

Description

Incorrect parameterized tests are generated for Sort.partition
There are test executions that fail with unexpected NPE and ones that are expecting ArrayIndexOutOfBoundsException but failed to get it.

To Reproduce

1. Install one of the latest plugin builds from main in IDEA
2. Run the 'UTBotJava' project in IntelliJ Idea
3. Set defaults in Settings->Tools->UnitTestBot
4. Use plugin to generate Parameterized tests, No mocks for sample: org.utbot.examples.algorithms.Sort.partition()
5. Run the generated parameterized tests

Expected behavior

Tests are supposed to pass.
Expected result and actual should match.
AssertionErrors should be thrown upwards without changes.

Actual behavior

There are NPE from assertion.
There is expected result 0, while actual is -1 . Assert failed and AssertionError is also caught outside and misunderstood.

Case#	array	begin	end	expected result	actual result	expected error	actual error
1	{-255L, -255L}	1	0	(!) 0	null	(!) null	IllegalArgument: bound must be positive
3	{2, -192, -255, -255, -255, -255, -255, -255, 1, -255, -255, -255}	0	0	(!) 0	-1	null	(!) AssertionFailedError: expected: <0> but was: <-1>
5	{-255}	-192	-255	null	null	(!) ArrayIndexOutOfBounds	IllegalArgumentException: bound must be positive
7	{1, 0}	0	0	(!) null	-1	(!) ArrayIndexOutOfBounds	(!) AssertionFailedError: expected: but was: <-1>
8	{-254, -255}	1	1	(!) null	0	(!) ArrayIndexOutOfBounds	(!) AssertionFailedError: expected: but was: <0>

Visual proofs (screenshots, logs, images)

public final class SortTest {
 ///region Test suites for executable org.utbot.examples.algorithms.Sort.partition

 ///region Parameterized test for method partition(long[], int, int)

 @ParameterizedTest
 @MethodSource("org.utbot.examples.algorithms.SortTest#provideDataForPartition")
 public void parameterizedTestsForPartition(Sort sort,
 long[] array,
 int begin,
 int end,
 Integer expectedResult,
 Class expectedError
 ) {
 try {
 int actual = sort.partition(array, begin, end);

 assertEquals(expectedResult, actual);
 } catch (Throwable throwable) {
 assertTrue(expectedError.isInstance(throwable));
 }
 }
 ///endregion

 ///endregion

 ///region Data provider methods for parametrized tests

 public static ArrayList provideDataForPartition() {
 ArrayList argList = new ArrayList();

 {
 Sort sort = new Sort();
 long[] array = {-255L, -255L};

 Object[] testCaseObjects = new Object[6];
 testCaseObjects[0] = sort;
 testCaseObjects[1] = array;
 testCaseObjects[2] = 1;
 testCaseObjects[3] = 0;
 testCaseObjects[4] = 0;
 testCaseObjects[5] = null;
 argList.add(arguments(testCaseObjects));
 }
 {
 Sort sort = new Sort();
 long[] array = {12L};

 Object[] testCaseObjects = new Object[6];
 testCaseObjects[0] = sort;
 testCaseObjects[1] = array;
 testCaseObjects[2] = 0;
 testCaseObjects[3] = 0;
 testCaseObjects[4] = -1;
 testCaseObjects[5] = null;
 argList.add(arguments(testCaseObjects));
 }
 {
 Sort sort = new Sort();
 long[] array = new long[13];
 array[1] = 2L;
 array[2] = -192L;
 array[3] = -255L;
 array[4] = -255L;
 array[5] = -255L;
 array[6] = -255L;
 array[7] = -255L;
 array[8] = -255L;
 array[9] = 1L;
 array[10] = -255L;
 array[11] = -255L;
 array[12] = -255L;

 Object[] testCaseObjects = new Object[6];
 testCaseObjects[0] = sort;
 testCaseObjects[1] = array;
 testCaseObjects[2] = 0;
 testCaseObjects[3] = 0;
 testCaseObjects[4] = 0;
 testCaseObjects[5] = null;
 argList.add(arguments(testCaseObjects));
 }
 {
 Sort sort = new Sort();

 Object[] testCaseObjects = new Object[6];
 testCaseObjects[0] = sort;
 testCaseObjects[1] = null;
 testCaseObjects[2] = -255;
 testCaseObjects[3] = -255;
 testCaseObjects[4] = null;
 testCaseObjects[5] = NullPointerException.class;
 argList.add(arguments(testCaseObjects));
 }
 {
 Sort sort = new Sort();
 long[] array = {-255L};

 Object[] testCaseObjects = new Object[6];
 testCaseObjects[0] = sort;
 testCaseObjects[1] = array;
 testCaseObjects[2] = -192;
 testCaseObjects[3] = -255;
 testCaseObjects[4] = null;
 testCaseObjects[5] = ArrayIndexOutOfBoundsException.class;
 argList.add(arguments(testCaseObjects));
 }
 {
 Sort sort = new Sort();
 long[] array = {-255L};

 Object[] testCaseObjects = new Object[6];
 testCaseObjects[0] = sort;
 testCaseObjects[1] = array;
 testCaseObjects[2] = -254;
 testCaseObjects[3] = -254;
 testCaseObjects[4] = null;
 testCaseObjects[5] = ArrayIndexOutOfBoundsException.class;
 argList.add(arguments(testCaseObjects));
 }
 {
 Sort sort = new Sort();
 long[] array = {1L, 0L};

 Object[] testCaseObjects = new Object[6];
 testCaseObjects[0] = sort;
 testCaseObjects[1] = array;
 testCaseObjects[2] = 0;
 testCaseObjects[3] = 0;
 testCaseObjects[4] = null;
 testCaseObjects[5] = ArrayIndexOutOfBoundsException.class;
 argList.add(arguments(testCaseObjects));
 }
 {
 Sort sort = new Sort();
 long[] array = {-254L, -255L};

 Object[] testCaseObjects = new Object[6];
 testCaseObjects[0] = sort;
 testCaseObjects[1] = array;
 testCaseObjects[2] = 1;
 testCaseObjects[3] = 1;
 testCaseObjects[4] = null;
 testCaseObjects[5] = ArrayIndexOutOfBoundsException.class;
 argList.add(arguments(testCaseObjects));
 }

 return argList;
 }
 ///endregion
}

Environment

IntelliJ IDEA 2022.2.3
Gradle
JDK 11
JUnit 5 + parameterized

Additional context

Tests generated by Fuzzing are correct.

[EgorkaKulikov]

It seems to be a problem with triggers on force mocking and force static mocking when we generate parameterized tests from plugin, not from tests (it means from TestCaseGenerator, not TestSpecificTestCaseGenerator).

If we generate standard tests, all of them contains force mocking. It means that no parameterized tests can be generated at all.

This behavior can be reproduced on a very primitive example:

public int findLength(int length) {
 return new Random().nextInt(length);
}

[EgorkaKulikov]

Fixed with #1604