Recently, i used vdbench tool to excute IO test on the server. I always got the following error info in localhost-0.stdout.html file:
19:48:24.273 19:48:24.273 HeartBeat.checkHeartBeat(): Master has not responded for 180 seconds.
19:48:24.273 19:48:24.273 Java Heap in MB. max: 4096.000; current: 1024.000; used: 338.873; free: 685.127
19:48:24.273 19:48:24.273
19:48:24.273 19:48:24.273 Heartbeat monitor: Master did not respond. Timeout value: 180
19:48:24.273 19:48:24.273
19:48:24.274 java.lang.RuntimeException: Heartbeat monitor: Master did not respond. Timeout value: 180
19:48:24.274 at Vdb.common.failure(common.java:350)
19:48:24.274 at Vdb.HeartBeat.run(HeartBeat.java:94)
config file info:
data_errors=1
sd=default,journal=/root/vdbench/journal,openflags=directio,threads=32
sd=sd1,lun=/dev/sdb
sd=sd2,lun=/dev/sdc
sd=sd3,lun=/dev/sdd
sd=sd4,lun=/dev/sde
sd=sd5,lun=/dev/sdf
sd=sd6,lun=/dev/sdg
wd=default,xfersize=(32k),rdpct=50,seekpct=100
wd=wd1,sd=sd1
wd=wd2,sd=sd2
wd=wd3,sd=sd3
wd=wd4,sd=sd4
wd=wd5,sd=sd5
wd=wd6,sd=sd6
rd=rd1,wd=wd*,warmup=10,elapsed=25000,interval=1,openflags=directio,iorate=max
When i was testing in long time, i got the above error and the vdbench process was terminated.
[root@localhost vdbench]# ps -ef |grep vdbench
root 358820 358811 0 04:49 pts/8 00:00:00 /bin/bash /root/vdbench/vdbench -f /root/vdbench/vd_config -jn -o /root/vdbench/output -vr
root 358842 358820 0 04:49 pts/8 00:01:01 java -Xmx4G -Xms1G -cp /root/vdbench/:/root/vdbench/classes:/root/vdbench/vdbench.jar Vdb.Vdbmain -f /root/vdbench/vd_config -jn -o /root/vdbench/output -vr
root 472431 467029 0 22:25 pts/0 00:00:00 grep --color=auto vdbench
As the above vdbench process info, the java slaves were terminated.
How to fix it?