Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support for clickhouse #147

Closed
cmdares opened this issue Sep 13, 2018 · 7 comments
Closed

support for clickhouse #147

cmdares opened this issue Sep 13, 2018 · 7 comments

Comments

@cmdares
Copy link

cmdares commented Sep 13, 2018

support for clickhouse input and output.
regard!
thanks!

@hiroyuki-sato
Copy link
Member

Hello, @cmdares

Have you ever tried embulk-input-jdbc with ClickHouse JDBC?

If that plugin doesn't work as expected, Someone needs to develop a plugin for ClickHouse JDBC.

@tac0x2a
Copy link

tac0x2a commented Oct 1, 2018

Hello, @cmdares and @hiroyuki-sato .

First, I tried using ClickHouse JDBC on embulk-input-jdbc, it does NOT work in current implementation.
So, I sent pull request to clickhouse-jdbc. It will work on embulk-input-jdbc for simple data types if this PR are merged.

Second, I thought ClickHouse data types need to support by embulk-input-clickhouse plugin. Then, I tried simple simple implementation and send PR .

I'm verry happy if we review this PR and improve implementation.

@hiroyuki-sato
Copy link
Member

Hello, @cmdares
JFYI, @tac0x2a has developed embulk-input-clickhouse

Thank you @tac0x2a !

@tac0x2a
Copy link

tac0x2a commented Oct 3, 2018

Hi, @cmdares
Today, I fixed plugin to use just install it.

$ embulk gem install embulk-input-clickhouse

Could you try this ?

@hiroyuki-sato san
I really appreciate your support!

@cmdares
Copy link
Author

cmdares commented Feb 1, 2019

thanks!
i found the ck jdbc client 0.1.50 release the feature:
getMetadata implementation if query was not executed yet

@sakama
Copy link
Contributor

sakama commented Feb 1, 2019

Let me close this issue.
Since embulk-input-clickhouse was released.

@sakama sakama closed this as completed Feb 1, 2019
@cmdares
Copy link
Author

cmdares commented Feb 1, 2019

Hi, @tac0x2a @frsyuki
thanks for the works! And there is another requirement.
embulk/embulk-output-jdbc#245
to support clickhouse output.
Because of there are many engines, especially the merge family, there are some considerations for writing speed.It is estimated that there will be more considerations.
So still want to give attention and support!
thanks! regard!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

4 participants