Database Software

Hi,

I am making tests with an application, which performs lots of SELECT queries to a data store through multiple client/server connections. At a certain moment the TimesTen server crashed.

I am running TimesTen 7.0.3.0.0 on a 32-bit linux with 4 GB RAM. Here is the DSN for the data store:
[loadtest]
Driver=/opt/TimesTen/tt70/lib/libtten.so
DataStore=/var/TimesTen/tt70/loadtest
DatabaseCharacterSet=AL32UTF8
PermSize=1792
Connections=192

And here are the kernel settings:
kernel.shmmax = 4294967295
kernel.shmall = 268435200
kernel.sem = 250 256000 32 1024


Below is an extraction from tterrors.log. What could be the reason for the crash?

19:26:40.09 Warn: : 7954: 8054 exited while connected to data store '/var/TimesTen/tt70/loadtest' shm 2097388019 count=1
19:26:39.86 Err : SRV: 8580: EventID=68| Failed to read request from client. Closing connection without reply.
19:26:42.53 Err : : 7957: TT14000: TimesTen daemon internal error: subd: Could not connect to shared segment, err 12=Cannot allocate memory
19:26:42.54 Err : : 7954: TT14000: TimesTen daemon internal error: Unparsable reply from subdaemon 43094, rc 400 (examine for 8054)
19:26:44.41 Err : SRV: 8050: EventID=68| Failed to read request from client. Closing connection without reply.
19:26:44.70 Err : SRV: 8069: EventID=68| Failed to read request from client. Closing connection without reply.
19:26:44.79 Err : SRV: 8075: EventID=68| Failed to read request from client. Closing connection without reply.
19:26:44.71 Err : SRV: 8077: EventID=68| Failed to read request from client. Closing connection without reply.
19:26:45.93 Warn: : 7954: daRecovery: examine for 8054 failed: invalidate (failcode=-1)
19:26:46.68 Warn: : 7954: Invalidating the data store (failcode -1, recovery for 8054)
19:26:47.91 Warn: : 7967: Stopping subdaemon worker for /var/TimesTen/tt70/loadtest because db is invalid.
19:26:49.73 Err : : 7967: subd: manager exiting due to invalidation
19:26:48.08 Err : SRV: 8089: EventID=68| Failed to read request from client. Closing connection without reply.
19:26:49.74 Warn: : 7954: 8050 ----------: Disconnecting from an old instance
19:27:01.30 Warn: : 7954: 7957 ------------------: subdaemon process exited
19:27:08.18 Warn: : 7954: 8056 exited while connected to data store '/var/TimesTen/tt70/loadtest' shm 2097388019 count=1
19:27:12.84 Err : : 7954: TT14000: TimesTen daemon internal error: Could not connect to subdaemon port 34820
19:27:13.54 Err : : 7954: TT14012: TimesTen daemon subdaemon failed: Error 791 unmanaging, invalidating
19:27:13.74 Warn: : 7954: 8107/0x809b670: Forced Disconnect /var/TimesTen/tt70/loadtest
19:27:13.74 Warn: : 7954: 8107 ----------: Disconnecting from an old instance
19:27:13.74 Warn: : 7954: 8323/0x809b670: Forced Disconnect /var/TimesTen/tt70/loadtest
19:27:13.74 Warn: : 7954: 8323 ----------: Disconnecting from an old instance
19:27:13.76 Warn: : 7954: 8379/0x809b670: Forced Disconnect /var/TimesTen/tt70/loadtest
19:27:13.76 Warn: : 7954: 8379 ----------: Disconnecting from an old instance
19:27:13.76 Warn: : 7954: 8342/0x809b670: Forced Disconnect /var/TimesTen/tt70/loadtest
19:27:13.76 Warn: : 7954: 8342 ----------: Disconnecting from an old instance
19:27:13.76 Warn: : 7954: 8471/0x809b670: Forced Disconnect /var/TimesTen/tt70/loadtest
19:27:13.76 Warn: : 7954: 8471 ----------: Disconnecting from an old instance
19:27:13.77 Warn: : 7954: 8313/0x809b670: Forced Disconnect /var/TimesTen/tt70/loadtest
19:27:13.77 Warn: : 7954: 8313 ----------: Disconnecting from an old instance
19:27:13.78 Warn: : 7954: 8062 exited while connected to data store '/var/TimesTen/tt70/loadtest' shm 2097388019 count=1
19:27:13.78 Err : : 7954: TT14000: TimesTen daemon internal error: Could not connect to subdaemon port 34820
19:27:13.78 Err : : 7954: TT14012: TimesTen daemon subdaemon failed: Error 791 unmanaging, invalidating
19:27:13.78 Warn: : 7954: 8398/0x809b670: Forced Disconnect /var/TimesTen/tt70/loadtest
19:27:13.78 Warn: : 7954: 8398 ----------: Disconnecting from an old instance
19:27:14.11 Warn: : 7954: 8270/0x809b670: Forced Disconnect /var/TimesTen/tt70/loadtest
19:27:14.11 Warn: : 7954: 8270 ----------: Disconnecting from an old instance
19:27:14.11 Warn: : 7954: 8222/0x809b670: Forced Disconnect /var/TimesTen/tt70/loadtest
19:27:14.11 Warn: : 7954: 8222 ----------: Disconnecting from an old instance
19:27:14.11 Warn: : 7954: 8069 ----------: Disconnecting from an old instance
19:27:14.12 Warn: : 7954: 8580 ----------: Disconnecting from an old instance