User da0aec4855
25-08-2016 15:15:38
Hello,
I tried to COPY data into a citus distributed postgres table, but got following error at the end :
======================================
ERROR: incorrect binary data format
DETAIL: (null)
======================================
Table description : jchem_mol(inchi_key text, smiles molecule('sample'), cpx real);
COPY jchem_mol FROM 'xxx.csv' (FORMAT CSV);
Confirmed that the same COPY command can success on a non-distributed table, so I guess the problem might be with citus.
Thanks,
William
ChemAxon a202a732bf
26-08-2016 08:46:20
Hi William,
In Citus version 5.1 we also experienced problems with COPY. We advice you to try the
copy_to_distributed_table
command line import tool of Citus described here.
Best regards,
Zsuzsa
User f1455aa372
23-09-2016 17:49:01
zszabo wrote: |
In Citus version 5.1 we also experienced problems with COPY. We advice you to try the
copy_to_distributed_table
|
Hey all,
I'm a developer at Citus Data and came across your post. We think the issue you're encountering is related to a COPY bug, fixed as of Citus 5.2.
Because COPY is much faster than copy_to_distributed_table, we recommend upgrading to Citus 5.2. We recently streamlined our installation process; see more here.
N.B. — Citus 5.2 drops support for PostgreSQL 9.4, so you'll need to upgrade to PostgreSQL 9.5 if you haven't already.
ChemAxon a202a732bf
26-09-2016 08:19:29
Hi Jason!
Thank you very much for the notification, it is very kind of you. We will try it.
Best regards,
Zsuzsanna
User 6baabcf48d
29-09-2016 00:28:33
jason _at_ citusdata.com wrote: |
zszabo wrote: |
In Citus version 5.1 we also experienced problems with COPY. We advice you to try the
copy_to_distributed_table
|
Hey all,
I'm a developer at Citus Data and came across your post. We think the issue you're encountering is related to a COPY bug, fixed as of Citus 5.2.
Because COPY is much faster than copy_to_distributed_table, we recommend upgrading to Citus 5.2. We recently streamlined our installation process; see more here.
N.B. — Citus 5.2 drops support for PostgreSQL 9.4, so you'll need to upgrade to PostgreSQL 9.5 if you haven't already.
|
Hello,
I did used Citus 5.2, and this issue only happens on tables which has JChem molecule type field.
My solution is create a distributed table with normal text field first, then COPY csv files, then alter the field to JChem molecule type, it can work
Regards,
William
ChemAxon abe887c64e
30-09-2016 11:45:29
Hi William,
Thank you for the information.
Best regards,
Krisztina