Skip to content

Doris imports data through stream load, resulting in connection reset or broken pipe write failed #6093

Description

@345362231

My Doris version is 0.14,The script uses JDBC to connect Doris Fe to create a table, and at the same time uses steam_ Load stores data in the table. The error is below

2021-06-24 16:42:46.876 log [pool-42-thread-2] DEBUG c.c.d.g.p.doris.DorisStorePlugin - 开始发送doris http写请求:url=http://172.22.57.8:8030/api/datalake_hosp2_mix_hosp2his_em
r_lis_736035844_ods/EMRinstance_InstanceUserTemplate/_stream_load
2021-06-24 16:42:46.879 log [Thread-2] INFO c.c.d.g.job.task.CacheTaskContainer - 任务【TRANS:CHUNK:datalake_CDSDBRMYY_HIS_hosp8his_ods_ZLHIS_zhuyuanfeiyongjilu_556937113】销>
毁完毕
2021-06-24 16:42:46.879 log [Thread-2] INFO c.c.d.g.job.task.CacheTaskContainer - 任务【TRANS:CHUNK:datalake_hosp2_mix_hosp2his_emr_lis_736035844_ods_EMRinstance_InstanceUserT
emplate】开始销毁
2021-06-24 16:42:46.879 log [Thread-2] DEBUG c.c.d.g.p.doris.DorisStorePlugin - finished plugin
2021-06-24 16:42:46.888 log [pool-42-thread-2] INFO o.a.http.impl.execchain.RetryExec - I/O exception (java.net.SocketException) caught when processing request to {}->http://1
72.22.57.8:8030: Connection reset
2021-06-24 16:42:46.888 log [pool-42-thread-2] ERROR c.c.d.g.p.doris.DorisStorePlugin - 导入数据错误
org.apache.http.client.ClientProtocolException: null
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:187)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:221)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:165)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:140)
at com.cecdsc.dep.gateway.common.WebClient.sendStream(WebClient.java:152)
at com.cecdsc.dep.gateway.plugin.doris.DorisStorePlugin.sendDataToUrl(DorisStorePlugin.java:491)
at com.cecdsc.dep.gateway.plugin.doris.DorisStorePlugin.sendData(DorisStorePlugin.java:964)
at com.cecdsc.dep.gateway.plugin.AbstractStorePlugin.lambda$createSendTask$31(AbstractStorePlugin.java:105)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:108)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)... 13 common frames omittedCaused by: java.net.SocketException: Connection resetat java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:115)at java.net.SocketOutputStream.write(SocketOutputStream.java:155)at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:124)at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:136)at org.apache.http.impl.io.SessionOutputBufferImpl.write(SessionOutputBufferImpl.java:167)at org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:122)at org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:179)at org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:134)
at org.apache.http.impl.execchain.RequestEntityProxy.writeTo(RequestEntityProxy.java:121)

Be error, The error is below:
internal error:canceled

I don't know why there is a connection reset. Who can help?
Does Doris of 0.14 add any detection methods?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions