[SPARK-32524][SQL][TESTS] CachedBatchSerializerSuite should clean up InMemoryRelation.ser

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to clean up InMemoryRelation.ser in CachedBatchSerializerSuite.

Why are the changes needed?

SPARK-32274 makes SQL cache serialization pluggable.

[SPARK-32274][SQL] Make SQL cache serialization pluggable

This causes UT failures.

$ build/sbt "sql/testOnly *.CachedBatchSerializerSuite *.CachedTableSuite"
...
[info] Cause: java.lang.IllegalStateException: This does not work. This is only for testing
[info] at org.apache.spark.sql.execution.columnar.TestSingleIntColumnarCachedBatchSerializer.convertInternalRowToCachedBatch(CachedBatchSerializerSuite.scala:49)
...
[info] *** 30 TESTS FAILED ***
[error] Failed: Total 51, Failed 30, Errors 0, Passed 21
[error] Failed tests:
[error] org.apache.spark.sql.CachedTableSuite
[error] (sql/test:testOnly) sbt.TestsFailedException: Tests unsuccessful

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manually.

$ build/sbt "sql/testOnly *.CachedBatchSerializerSuite *.CachedTableSuite"
[info] Tests: succeeded 51, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[info] Passed: Total 51, Failed 0, Errors 0, Passed 51

[dongjoon-hyun]

cc @cloud-fan, @HyukjinKwon , @revans2 , @tgravescs
This is the second approach according to the review comments.

[HyukjinKwon]

LGTM. I prefer this way but don't feel strongly if other people prefer the other way.

[dongjoon-hyun]

Thank you for reiview and approval, @HyukjinKwon .

[dongjoon-hyun]

Thanks, @cloud-fan . beforeAll is also added.

[SparkQA]

Test build #127030 has finished for PR 29346 at commit a552287.

• This patch fails due to an unknown error code, -9.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #127033 has finished for PR 29346 at commit 71a75a0.

• This patch fails due to an unknown error code, -9.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #127032 has finished for PR 29346 at commit 57c0797.

• This patch fails due to an unknown error code, -9.
• This patch merges cleanly.
• This patch adds no public classes.

[cloud-fan]

retest this please

[HyukjinKwon]

I am going to merge this since GitHub Actions builds passed.

[SparkQA]

Test build #127044 has finished for PR 29346 at commit 71a75a0.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[dongjoon-hyun]

Thank you, @cloud-fan and @HyukjinKwon .

[revans2]

Thanks for finding and fixing this for me.

[dongjoon-hyun]

Thanks, @revans2 ! :)