Hi ,
Not sure i understand the reason for this error , it all fell apart in the format area what was he trying to write? Hope you can help
This is the param file :
---------------------------------------------------------------------------------------
debug=25
fsd=fsd1,anchor=/mnt/ibox505/node-2/fs14097516111,depth=10,width=2,files=10,size=1M,distribution=all
fsd=fsd2,anchor=/mnt/ibox505/node-2/fs14097516112,depth=10,width=2,files=10,size=1M,distribution=all
fsd=fsd3,anchor=/mnt/ibox505/node-2/fs14097516113,depth=10,width=2,files=10,size=1M,distribution=all
fsd=fsd4,anchor=/mnt/ibox505/node-2/fs14097516114,depth=10,width=2,files=10,size=1M,distribution=all
fsd=fsd5,anchor=/mnt/ibox505/node-2/fs14097516115,depth=10,width=2,files=10,size=1M,distribution=all
fwd=default,xfersize=4k,fileio=sequential,fileselect=random,threads=100
fwd=fwd1,fsd=fsd1,operation=read
rd=rd1,fwd=fwd*,fwdrate=max,format=yes,elapsed=30,interval=1
---------------------------------------------------------------------------------------
This is the stdout file :
---------------------------------------------------------------------------------------
16:40:25.206 16:40:25.206 Beginning of run setup
16:40:25.206 16:40:25.206 **********************
16:40:25.206
16:40:25.206
16:40:25.263 16:40:25.263 File '/var/log/messages.1' does not exist. Monitoring bypassed
16:40:25.272 16:40:25.271 Deleting old file structure.
16:40:25.630 16:40:25.629 Completed the creation of the directory list for /mnt/ibox505/node-2/fs14097516111: 2046 directories.
16:40:25.635 16:40:25.635 Memory total Java heap: 123.500 MB; Free: 79.285 MB; Used: 44.215 MB;
16:40:25.690 16:40:25.690 checkMemory()
16:40:25.691 16:40:25.691 Memory total Java heap: 123.500 MB; Free: 107.514 MB; Used: 15.986 MB;
16:40:25.728 16:40:25.728 Generated 20460 file names; total anchor size: 19.980g
16:40:25.728 16:40:25.728 Writing control file for anchor=/mnt/ibox505/node-2/fs14097516111 at start of run.
16:40:25.775 16:40:25.775 Completed control file for anchor=/mnt/ibox505/node-2/fs14097516111 at start of run. dirs: 2046/0 files: 20460/0 sizes: 19.980g/0.0/0/0.0
16:40:25.781 16:40:25.781 Skew for fwd=format,fsd=fsd1,operation=read: 100.0
16:40:25.803 16:40:25.803 Started 8 threads for fwd=format,fsd=fsd1
16:40:25.803 16:40:25.803 Started 8 FwgThreads
16:40:25.803 16:40:25.803 Waiting for task synchronization
16:40:25.803 16:40:25.803 task_wait_start_complete() end
16:40:26.001 Starting RD=format_for_rd1
16:40:26.003 16:40:26.003 task_run_all(): 9 tasks
16:40:26.341 16:40:26.341 Message to master: anchor=/mnt/ibox505/node-2/fs14097516111 mkdir complete.
16:40:26.352 16:40:26.351 Invalid byte count. Expecting 131072
16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072
16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072
16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072
16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072
16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072
16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072
16:40:26.352 16:40:26.352 but wrote only 20480 bytes.
16:40:26.352 16:40:26.352 but wrote only 12288 bytes.
16:40:26.352 16:40:26.352 but wrote only 4096 bytes.
16:40:26.352 16:40:26.352 but wrote only 49152 bytes.
16:40:26.352 16:40:26.352 but wrote only 12288 bytes.
16:40:26.352 16:40:26.352 but wrote only 4096 bytes.
16:40:26.353 16:40:26.352 but wrote only 57344 bytes.
16:40:26.356 16:40:26.356
16:40:26.357 16:40:26.356 Error writing file /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0003.file
16:40:26.357 16:40:26.356 Error: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written
16:40:26.357 16:40:26.357 lba: 0
16:40:26.357 16:40:26.357 xfersize: 131072
16:40:26.357 16:40:26.357 blocks_done: 0
16:40:26.357 16:40:26.357 bytes_done: 0
16:40:26.357 16:40:26.357 open_for_read: false
16:40:26.357 java.lang.RuntimeException: Error writing file /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0003.file
16:40:26.357 16:40:26.357
16:40:26.357 Error: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written
16:40:26.357 lba: 0
16:40:26.357 xfersize: 131072
16:40:26.358 blocks_done: 0
16:40:26.358 bytes_done: 0
16:40:26.358 open_for_read: false
16:40:26.358 at Vdb.common.failure(common.java:308)
16:40:26.358 at Vdb.ActiveFile.writeError(ActiveFile.java:611)
16:40:26.358 at Vdb.ActiveFile.writeBlock(ActiveFile.java:458)
16:40:26.358 at Vdb.FwgThread.doSequentialWrite(FwgThread.java:327)
16:40:26.358 at Vdb.OpCreate.doOperation(OpCreate.java:51)
16:40:26.358 at Vdb.OpFormat.doOperation(OpFormat.java:91)
16:40:26.358 at Vdb.FwgThread.run(FwgThread.java:157)
---------------------------------------------------------------------------------------
And this is the Logfile:
---------------------------------------------------------------------------------------
16:40:26.002 Starting RD=format_for_rd1
16:40:26.341 localhost-0: anchor=/mnt/ibox505/node-2/fs14097516111 mkdir complete.
16:40:26.356 localhost-0: 16:40:26.353 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0003.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written
16:40:26.357 localhost-0: 16:40:26.356 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0001.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written
16:40:26.358 localhost-0: 16:40:26.357 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0006.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written
16:40:26.359 localhost-0: 16:40:26.358 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0004.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written
16:40:26.361 localhost-0: 16:40:26.359 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0008.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written
16:40:26.362 localhost-0: 16:40:26.361 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0007.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written
16:40:26.363 localhost-0: 16:40:26.362 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0005.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written
16:40:26.533
16:40:26.534 **********************************************************
16:40:26.534 Slave localhost-0 aborting: Error writing file /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0003.file
Error: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written
lba: 0
xfersize: 131072
blocks_done: 0
bytes_done: 0
open_for_read: false
16:40:26.534 **********************************************************
16:40:26.534
16:40:28.003 Exception from slave: localhost-0
16:40:28.004
16:40:28.004 common.failure():
java.net.SocketException: Broken pipe
java.net.SocketException: Broken pipe
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.net.SocketOutputStream.write(Unknown Source)
at java.io.ObjectOutputStream$BlockDataOutputStream.drain(Unknown Source)
at java.io.ObjectOutputStream$BlockDataOutputStream.setBlockDataMode(Unknown Source)
at java.io.ObjectOutputStream.writeNonProxyDesc(Unknown Source)
at java.io.ObjectOutputStream.writeClassDesc(Unknown Source)
at java.io.ObjectOutputStream.writeOrdinaryObject(Unknown Source)
at java.io.ObjectOutputStream.writeObject0(Unknown Source)
at java.io.ObjectOutputStream.writeFatalException(Unknown Source)
at java.io.ObjectOutputStream.writeObject(Unknown Source)
at Vdb.SlaveSocket.putMessage(SlaveSocket.java:278)
at Vdb.CollectSlaveStats.(CollectSlaveStats.java:121)
at Vdb.Reporter.run(Reporter.java:183)
---------------------------------------------------------------------------------------
And another connected question :
The fwd operation is READ, without any writes, so if the format would have passed successfully, what would have been the correct behaviour?
Would VDBench simply read the empty files and pass ? or would fail since they are empty?