Quantcast
Channel: SCN: Message List - Problems loading data into IQ
Viewing all articles
Browse latest Browse all 10

Re: Problems loading data into IQ

$
0
0

Thanks one again! Looks like this was unrelated - the IQ process had hung and no SQL was being executed :-)

 

I tried to stop the I server, and got the following. So I had to kill the process in the end to get it to stop. After that, I was able to restart IQ and restart the load process.

 

One thing that I find odd though is that it's no faster - 2m30s and I only see 1200% CPU when I have 40 cores and 80 threads available.

 

Feels like I've done something that has dropped the IQ Bulk Loader out of parallel mode.

 

John

 

server:/iq/iq/IQ-16_0/demo # more loadnew.sql

set temporary option escape_character='on';

set temporary option quoted_identifier='on';

set temporary option date_format='ymd';

DROP TABLE transaction;

CREATE TABLE "TRANSACTION" (

  "CUSTOMER_ID" INTEGER,

  "MERCHANT_ID" INTEGER,

  "TXTIMESTAMP" TIMESTAMP,

  "TXAMOUNT" DECIMAL(17,2),

  "TXCURR" CHAR(3));

LOAD TABLE transaction

( customer_id, merchant_id, txtimestamp, txamount, txcurr)

FROM

'/iq/transaction_2001.csv',

'/iq/transaction_2002.csv',

'/iq/transaction_2003.csv',

'/iq/transaction_2004.csv',

'/iq/transaction_2005.csv',

'/iq/transaction_2006.csv',

'/iq/transaction_2007.csv',

'/iq/transaction_2008.csv',

'/iq/transaction_2009.csv',

'/iq/transaction_2010.csv',

'/iq/transaction_2011.csv',

'/iq/transaction_2012.csv'

FORMAT BCP

QUOTES OFF

ESCAPES OFF

DELIMITED BY ','

ROW DELIMITED BY '\x0d\x0a'

;

commit work;

 

 

server:/iq/iq/IQ-16_0/demo # stop_iq

 

Checking system ...

 

The following 1 server(s) are owned by 'root'

 

## Owner          PID   Started  CPU Time  Additional Information

-- ---------  -------  --------  --------  ------------------------------------

1: root         73757     Nov22  00:51:15  SVR:server_iqdemo DB:iqdemo PORT:2638

              /iq/iq/IQ-16_0/bin64/iqsrv16 @iqdemo.cfg iqdemo.db -ti 4400 -gn 25 -o /iq/iq/IQ-16_0/logfiles/server_iqdemo.0001.srvlog -hn 5

--

 

  Please note that 'stop_iq' will shut down a server completely

  without regard for users, connections, or load process status.

  For more control, use the 'dbstop' utility, which has options

  that control stopping servers based on active connections.

 

Do you want to stop the server displayed above <Y/N>? Y

 

Shutting down server (73757) ...

Checkpointing server (73757) .........................................................

 

Notice:    Time alotted for server shutdown has expired. The server may

    be waiting on a system or network lock or it may requires

    more time depending on memory allocation. If server does

    not respond further, a hard shutdown may be required.


Viewing all articles
Browse latest Browse all 10

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>