Skip to Main Content

Database Software

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

uploading more than 5M records per minute with SQLLDR

Ubai SalihSep 11 2019 — edited Sep 24 2019

Hi Experts,

Oracle Database 12C Enterprise Edition,

We are capturing SYSLOG with an average 5M records each Minute, and we were trying to upload these flat files by using SQLLDR to a table with Partition per hour, with no index and no sequence,

The problem now, the SQLLDR is working but not able to upload this amount of data in a timely manner, as the file generated each minute with a 5M records while the SQLLDR takes more than 2 minutes to upload one file  .

Thus any suggestion please to speed up the SQLLDR uploading ? is there any thing we can do to make this done ?

please HELP !

SQL Loader,

sqlldr $user11/$pass11@servername:port/sid control=$j.ctl      multithreading=true     skip_index_maintenance=true    parallel=TRUE    log=$basetablog$j.log   data=$tempsource$j     bad=$basetablog$j.bad

Control File ,

OPTIONS(DIRECT=TRUE,PARALLEL=TRUE,BINDSIZE=8000000,ROWS=5000)

UNRECOVERABLE

LOAD DATA

INTO TABLE SYSLOG.SYSLOG_DETAILS

APPEND

REENABLE DISABLED_CONSTRAINTS

EXCEPTIONS SYSLOG.SYSLOG_DETAILS

FIELDS TERMINATED BY ' '

TRAILING NULLCOLS

(SRCIP,

STARTDATE "to_date('19700101','yyyymmdd')+(1/24/60/60)*(:STARTDATE+10800)",

SRCPORT,

DSTIP,

DSTPORT,

SESSIONID,

ACTION,

POLICYID,

SERVICE,

DURATION,

FILENAME CONSTANT ":FILE",

SENTBYTE,

RCVDBYTE)

Comments
Post Details
Added on Sep 11 2019
4 comments
1,338 views