Re: Problems loading data into IQ
Thanks one again! Looks like this was unrelated - the IQ process had hung and no SQL was being executed :-) I tried to stop the I server, and got the following. So I had to kill the process in the end...
View ArticleRe: Problems loading data into IQ
120m records, 5.2GB per file. There's a white paper here with some suggestions. I'd better check the number of CPUs I have allocated. http://www.sybase.com/files/White_Papers/IQ-15-Loading-WP.pdf John
View ArticleRe: Problems loading data into IQ
Looks like I have plenty of CPUs but I'm running out of buffer cache pages. I didn't tune any parameters yet so that makes sense. I'm loading 62GB of flat files, so 2GB of RAM is joing to hurt sooner...
View ArticleRe: Problems loading data into IQ
That paper is really for IQ 15. Can you send your CFG file? The system has 40 cores, but IQ sees 80. That's because hyperthreading is turned on. We recommend that HT be turned off or you add this...
View ArticleRe: Problems loading data into IQ
Hi, Here's the config file. I've clearly not correctly understood IQ's configuration... because now it doesn't load at all :-) Could not execute statement. main Bufman: All buffer cache pages are in...
View ArticleRe: Problems loading data into IQ
There is a performance tuning guide here, that offers a bunch of suggestions. http://infocenter.sybase.com/help/topic/com.sybase.infocenter.dc00169.1600/doc/pdf/iqperf.pdf Based on those I changed my...
View ArticleRe: Problems loading data into IQ
OK... so IQ doesn't recognize the 128g for -iqlm, -iqmc and -iqtc, they have to be in MB. That's pretty stupid, it recognizes these for the -c option. Grr. The following works and I see it is...
View ArticleRe: Problems loading data into IQ
So 140-160 seconds isn't too bad. A bit below normal, but not bad. Our rough calculation for IQ 16 is 10-20 MB per second per core. A 40 core system should be able to process 400-800 MB per second in...
View ArticleRe: Problems loading data into IQ
I forgot to post this before I left and have been having trouble trying to post it. Looks like you already figured that piece out: Since this is IQ 16, there are some new things to consider. Check...
View Article