Load: Support Active Load TSFile

[luoluoyuyu]

Description

As the title said

---

This PR has:

• been self-reviewed.
  • concurrent read
  • concurrent write
  • concurrent read and write
• added documentation for new or modified features or behaviors.
• added Javadocs for most classes and all non-trivial methods.
• added or updated version, license, or notice information
• added comments explaining the "why" and the intent of the code wherever would not be obvious
  for an unfamiliar reader.
• added unit tests or modified existing tests to cover new code paths, ensuring the threshold
  for code coverage.
• added integration tests.
• been tested in a test IoTDB cluster.

---

Key changed/added classes (or packages if there are too many classes) in this PR

[Copilot]

Pull Request Overview

This PR introduces support for asynchronous loading of TSFiles into the IoTDB system (“Active Load TSFile”) by adding new asynchronous loading logic and configuration parameters.

• Added async load logic and related methods in LoadTsFileAnalyzer.
• Introduced new async load configuration and validation in LoadTsFileConfigurator.
• Updated receiver and statement classes to propagate and utilize the async load flag.

Reviewed Changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated no comments.

File	Description
LoadTsFileAnalyzer.java	Added isAsyncLoad flag and async load methods to route file loading asynchronously.
LoadTsFileConfigurator.java	Updated parameter validation and default parsing for async load, replacing the previous VERIFY_KEY usage.
ActiveLoadTsFileLoader.java & IoTDBDataNodeReceiver.java	Adjustments to support asynchronous file movement and target directory assignment.
LoadTsFile.java & LoadTsFileStatement.java	Added async load flag and corresponding getter to support the new async loading feature.

Comments suppressed due to low confidence (3)

iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/load/config/LoadTsFileConfigurator.java:53

• Using ASYNC_LOAD_KEY in the validateParameters switch may lead to confusion between the async load and verify schema configurations. If these are intended to be separate, consider using distinct keys and validation methods.

case ASYNC_LOAD_KEY:

iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/load/config/LoadTsFileConfigurator.java:155

• The error message in validateVerifyParam now references ASYNC_LOAD_KEY instead of VERIFY_KEY. Verify that this change reflects the intended behavior and does not conflate the async load and schema verification settings.

throw new SemanticException(String.format("Given %s value '%s' is not supported, please input a valid boolean value.", ASYNC_LOAD_KEY, verify));

iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/analyze/load/LoadTsFileAnalyzer.java:207

• [nitpick] The newly introduced boolean flag 'isAsyncLoad' may be confused with the previous 'verify' configuration. Consider adding clarifying comments or renaming the flag if it represents a significantly distinct behavior.

if (isAsyncLoad) {

[Copilot]

Pull Request Overview

This PR adds support for asynchronous loading of TSFiles by introducing new configuration options and related code paths. Key changes include:

• Adding the async-load parameter and its validation in LoadTsFileConfigurator.
• Modifying the ActiveLoadTsFileLoader and related components to support an asynchronous session-based TSFile loading.
• Updating LoadTsFileStatement, LoadTsFile, and LoadTsFileAnalyzer to propagate and handle the new async-load behavior.

Reviewed Changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/utils/FileUtils.java	Introduces asynchronous file copy methods with MD5 checking and renaming.
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/load/config/LoadTsFileConfigurator.java	Adds async-load parameter validation and default value parsing.
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/load/active/ActiveLoadTsFileLoader.java	Extends TSFile loading methods to accept a session for asynchronous load.
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/statement/crud/LoadTsFileStatement.java	Propagates the async-load configuration in the TSFile load statement.
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/sql/ast/LoadTsFile.java	Adds support for async-load flag in the statement representation.
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/analyze/load/LoadTsFileAnalyzer.java	Implements asynchronous TSFile load processing using the new async-load config.
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/protocol/thrift/IoTDBDataNodeReceiver.java	Adjusts file move logic to support async TSFile loading to a configurable target directory.

Comments suppressed due to low confidence (1)

iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/protocol/thrift/IoTDBDataNodeReceiver.java:590

• Comparing file paths using getAbsolutePath() may lead to mismatches if the paths have differences in representation (e.g., trailing slashes). Consider normalizing the paths before comparison to avoid unexpected behavior.

if (!Objects.equals(targetDir.getAbsolutePath(), sourceFile.getParentFile().getAbsolutePath())) {

[Copilot]

The signature change for loadTsFile now requires all call sites to pass the session argument. Please ensure that all usages are updated accordingly and that unit tests cover the new behavior.

[Copilot]

The current directory creation check may not be robust in concurrent scenarios. Consider using Files.createDirectories for an atomic and more reliable directory creation.

Suggested change

	if (!(targetDir.exists() || targetDir.mkdirs())) {
	try {
	Files.createDirectories(targetDir.toPath());
	} catch (IOExceptione) {