trouble with importing of big lists to my DB

User 247c00dc1d

15-03-2012 11:06:02


Hello, I have a trouble with importing of big lists to my DB. When a list isn't large, the procedure of importing is Ok', as example, when it contain several thousand of strings, but when I to import the list with 33 thousand of strings to base containing 7 millions of hits at first several minutes I see the "appling list to DB" , after that process stopped and show me 0 imported rows. 


 


Imported list contain my number but not autogenerated cdid.


Field that i trying to use for importing was indexed before.


 


I using the latest version of IJC 5.9.0.


 


Thanks!



ChemAxon 2bdd02d1e5

15-03-2012 11:27:29

Hi, can you please share the log file (or send it to my mail). It will help a lot to pinpoint the problem. You can get it either from the IJC or from the directory. Please refere to https://www.chemaxon.com/instantjchem/ijc_latest/docs/admin/debug_info.html#logfile for exact info.


Thanks,
Filip 







User 247c00dc1d

15-03-2012 11:46:53










fzimandl wrote:

Hi, can you please share the log file (or send it to my mail). It will help a lot to pinpoint the problem. You can get it either from the IJC or from the directory. Please refere to https://www.chemaxon.com/instantjchem/ijc_latest/docs/admin/debug_info.html#logfile for exact info.


Thanks,
Filip 









Thanks,
Igor

ChemAxon 2bdd02d1e5

15-03-2012 13:44:30

I don not see anything suspicious in the log file(should be taken after unsuccessfull proceedure took place). However any list of this size is too much regardless actuall representation. Even list of non-unique integers lasts ages(30k~10mins on 250k DB)-roughly tested on MySQL, Oracle could provide much better performance. The lists are designed to work with about 10000 items at the most.


I recommend to specify somehow the properties in the query(ie. add another category column).


Thanks for your understanding.


Filip


 













User 247c00dc1d

15-03-2012 14:40:32










fzimandl wrote:

I don not see anything suspicious in the log file(should be taken after unsuccessfull proceedure took place). However any list of this size is too much regardless actuall representation. Even list of non-unique integers lasts ages(30k~10mins on 250k DB)-roughly tested on MySQL, Oracle could provide much better performance. The lists are designed to work with about 10000 items at the most.


I recommend to specify somehow the properties in the query(ie. add another category column).


Thanks for your understanding.


Filip


 















Thanks for answer!


Igor