Test report: usability

[nikitavlaev]

Currently, test reports looks like this:

expanded view of the same:

Event log:

If there were no test generated, plugin shows this error message:

There are several problems with that:

1. 2 bubbles -- no good.
2. Bubble with test report is too small -- no warnings can be seen, even expanded balloon requires scroll a lot.
3. SARIF report takes too much place and is of questionable use currently.

The proposed solution is:

1. Show full info only in event log, SARIF appears only there
2. No warnings -- show notification bubble with short report like:

Report of the unit tests generation via UtBot
Unit tests for class MyClass were generated successfully.
Overall test methods: 11
See details in event log

3. There are warnings -- show warning(!) bubble with short report like:

Report of the unit tests generation via UtBot
Unit tests for class MyClass were generated with warnings.
Warning: Some test cases were ignored, because no mocking framework is installed in the project.
Better results could be achieved by installing mocking framework.
Overall test methods: 11
See details in event log

[korifey]

Text about VSCode extension in IntellijIDEA doesn't seems right to me. Maybe temporary we can give link to Intellij SARIF plugin.

[mmvpm]

Is it necessary to display this amount of information?

I mean, is the information about "how much tests are: successful / failing because of (some reason) / anything else" relevant to the user?

[Vassiliy-Kudryashov]

@nikitavlaev suggested "Overall test methods: 11" and it looks like the best summary message for me.

[amandelpie]

Looks like this is a useful information for UTBot developer in debug mode

[nikitavlaev]

Also, tsv is not required as far as I can see.