Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

希望sinks阶段数据写入clickhouse时支持性能更高的tcp连接 #14917

Closed
hjun881 opened this issue Oct 22, 2022 · 4 comments
Closed
Labels
type: feature A value-adding code addition that introduce new functionality.

Comments

@hjun881
Copy link

hjun881 commented Oct 22, 2022

A note for the community

No response

Use Cases

clickhouse官网默认支持tcp和http连接,可vector现在只支持http连接性能低并且不支持连接复用

Attempted Solutions

No response

Proposal

clickhouse官网默认支持tcp和http连接,可vector现在只支持http连接,希望支持tcp连接并且可以设置连接复用来提高性能.

References

No response

Version

No response

@hjun881 hjun881 added the type: feature A value-adding code addition that introduce new functionality. label Oct 22, 2022
@hjun881
Copy link
Author

hjun881 commented Oct 22, 2022

并且希望可以支持随机写,目前连接ck是一个http长连接导致只能和一台clickhouse建立连接,希望可以支持多连接与后端每一个clickhouse进行连接,特别是clickhouse 分片集群下能同时写多个片显著提高性能

@lroolle
Copy link
Contributor

lroolle commented Oct 23, 2022

WIP -> #14787

@jszwedko
Copy link
Member

Duplicate of #9000

@jszwedko jszwedko marked this as a duplicate of #9000 Oct 24, 2022
@caibirdme
Copy link
Contributor

@hjun881
You'd better add a (L4)VIP proxy before your clickhouse cluster, do not do load balancing on the client side by yourself.
And, native protocol is still working in progress, due to there's no production ready clickhouse rust sdk, So I have to develop the clickhouse sdk and vector clickhouse sink at the same time

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: feature A value-adding code addition that introduce new functionality.
Projects
None yet
Development

No branches or pull requests

4 participants