Update#2: ρύθμιση για windows αντί για Linux στο script file iometer-file-access-server.fio
Update#1: με τις μετρήσεις του Dell E5530... τρέξ' το ξανά σε safe mode... γιατί οι μετρήσεις είναι πολύ χάλια!!!
Παρατήρησα ότι το Dell που σερνόταν (και μόνο αυτό) έχει latency περισσότερα από 2000msec στο 0.21% των iops. Για σύγκριση όλα τα άλλα PCs έχουν αντίστοιχα χάλια latency το πολύ στο 0.01% των iops.
Μικρό ποσοστό μεν το 0,21% αλλά από την άλλη είναι 21 φορές περισσότερα iops σε σχέση με το Dell που θεωρείτε ΟΚ και το PC με RAID της ΚΕΝΤΙΑ (και τα δύο με 0,01%). Μήπως το 0,21% είναι αυτές οι στιγμές που αισθανόμαστε ότι ο ΗΥ παγώνει (διότι κάνει πάνω από 2 δευτερόλεπτα να ανταποκριθεί σε εντολή εγγραφής ή ανάγνωσης)?
Από την άλλη στον "
ΟΚ Dell" το 0.69% των iops που χρειάστηκε 1 με 2 δευτερόλεπτα θα πρέπει να ήταν και αυτά αισθητά ως παγώματα. Βέβαι στο OK Dell κατα λάθος δεν τρέξαμε το fio σε safe mode και ίσως εκείνη τη στιγμή να έκανε κάποιο windows update ή κάτι άλλο.
Θα χρειαστούμε κι άλλα δείγματα από Η/Υ που είναι ΟΚ (πάντα σε safe mode) και ίσως να πρέπει να ψάξω και για άλλο testing profile. Ας το τρέξουμε πάντως και στον Η/Υ που μόλις έστησε ο Παναγιώτης (επίσης σε safe mode).
Ορίστε το προβληματικό Dell:
250=44.71%, 500=41.12%, 750 9.12%, 1000=2.63%, 2000= *1.40%*=
,>=2000=0.21%
Ορίστε το ΟΚ Dell:
250= 3.03%, 500=54.09%, 750=38.48%, 1000=3.64%, 2000=0.69%, >=2000=0.01%
ΣΥΝΟΠΤΙΚΑ
0) HDD 2TB @ Lab pc
1) HDD 2TB @ Lab pc (run from SAFEMODE)
2) Φορητός dell mazars που σερνόταν
3) Raid 0 with 2 HDDs @ KENTIA (ίσως ψιλο-προβλημματικός)
4) SSD στο ίδιο PC με την περίπτωση 3)
5) Τυπικό Dell E5530 laptop απο mazars χωρίς πρόβληματα
READ: min max avg WRITE:min max avg
0 KB/s: 207 2433 674 24 917 169
1 KB/s: 289 2202 760 34 831 190 (safemode) 2 KB/s: 57 7283 2422* 7 2395 607*<--- ratio max/min is huge!
3 KB/s: 1 2668 822 1 958 206 <--- ratio max/min is huge!
4 KB/s:14881 118487 66638 4251 29003 16714
5 7 2420 632 0 894 158
* max and average R/W speeds are too high for the dell notebook compared to other systems
lat : 10 20 50 100 250 500 750 1000
0 (msec) : 0.17% 1.18% 4.27% 22.17% 38.01% 31.32% 2.81%
1 (msec) : 0.03% 0.15% 1.10% 4.22%22.08%38.33%31.68% 2.41% (safemode)
2 (msec) : 0.66% 44.71% 41.12% 9.12% 2.63%
3 (msec) : 5.49% 6.68% 11.63% 21.39% 35.28% 7.99% 0.90% 0.18%
4 (msec) :39.79% 0.79% 0.06% 0.01%
5 (msec) : 0.03% 3.03% 54.09% 38.48% 3.64%
ΑΝΑΛΥΤΙΚΑ
HDD 2TB @ Lab pc iometer: (groupid=0, jobs=1): err= 0: pid=3532: Mon Jul 6 10:29:43 2015 Description : [Emulation of Intel IOmeter File
Server Access Pattern]
read : bw=689549B/s, iops=128, runt=4979709msec
slat (usec): min=6, max=8163, avg=15.31, stdev=20.41
clat (usec): min=85, max=5164.7K, avg=398753.04, stdev=199764.62
lat (usec): min=99, max=5164.7K, avg=398768.34, stdev=199764.61
clat percentiles (msec):
| 1.00th=[ 42], 5.00th=[ 94], 10.00th=[ 133], 20.00th=[ 200],
| 30.00th=[ 265], 40.00th=[ 330], 50.00th=[ 396], 60.00th=[ 461],
| 70.00th=[ 529], 80.00th=[ 594], 90.00th=[ 668], 95.00th=[ 717],
| 99.00th=[ 799], 99.50th=[ 824], 99.90th=[ 881], 99.95th=[ 906],
| 99.99th=[ 963]
bw (KB /s): min= 207, max= 2433, avg=673.83, stdev=276.65
write: io=841039KB, bw=172946B/s, iops=32, runt=4979709msec
slat (usec): min=8, max=6843, avg=19.82, stdev=22.83
clat (usec): min=340, max=3627.7K, avg=398210.78, stdev=198716.70
lat (usec): min=358, max=3627.8K, avg=398230.60, stdev=198716.57
clat percentiles (msec):
| 1.00th=[ 44], 5.00th=[ 95], 10.00th=[ 133], 20.00th=[ 198],
| 30.00th=[ 265], 40.00th=[ 330], 50.00th=[ 396], 60.00th=[ 461],
| 70.00th=[ 529], 80.00th=[ 594], 90.00th=[ 668], 95.00th=[ 717],
| 99.00th=[ 799], 99.50th=[ 824], 99.90th=[ 881], 99.95th=[ 906],
| 99.99th=[ 963]
bw (KB /s): min= 24, max= 917, avg=168.64, stdev=94.61
lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.03%, 20=0.17%, 50=1.18%
lat (msec) : 100=4.27%, 250=22.17%, 500=38.01%, 750=31.32%, 1000=2.81%
lat (msec) : 2000=0.01%, >=2000=0.01%
cpu : usr=0.12%, sys=0.24%, ctx=0, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.4%, >=64=99.6%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.1%, 32=0.1%, 64=0.1%, >=64=0.0%
issued : total=r=639395/w=159997/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: aggrb=673KB/s, minb=673KB/s, maxb=673KB/s, mint=4979709msec, maxt=4979709msec
WRITE: aggrb=168KB/s, minb=168KB/s, maxb=168KB/s, mint=4979709msec, maxt=4979709msec
Φορητός dell mazars που σερνόταν
iometer: (groupid=0, jobs=1): err= 0: pid=2768: Mon Jul 6 08:26:29 2015 Descrip
tion : [Emulation of Intel IOmeter File Server Access Pattern]
read : bw=831344B/s, iops=154, runt=4130367msec
slat (usec): min=4, max=12233, avg=63.39, stdev=19.97
clat (msec): min=7, max=6963, avg=365.47, stdev=236.53
lat (msec): min=7, max=6963, avg=365.53, stdev=236.53
clat percentiles (msec):
| 1.00th=[ 120], 5.00th=[ 178], 10.00th=[ 196], 20.00th=[ 221],
| 30.00th=[ 243], 40.00th=[ 269], 50.00th=[ 302], 60.00th=[ 338],
| 70.00th=[ 388], 80.00th=[ 465], 90.00th=[ 603], 95.00th=[ 766],
| 99.00th=[ 1205], 99.50th=[ 1500], 99.90th=[ 2933], 99.95th=[ 3130],
| 99.99th=[ 3556]
bw (KB /s): min= 1, max= 2668, avg=821.95, stdev=307.63
write: io=841039KB, bw=208510B/s, iops=38, runt=4130367msec
slat (usec): min=6, max=1257, avg=78.85, stdev=14.84
clat (usec): min=174, max=4164.9K, avg=191164.62, stdev=87961.34
lat (usec): min=192, max=4164.9K, avg=191243.48, stdev=87961.60
clat percentiles (msec):
| 1.00th=[ 88], 5.00th=[ 141], 10.00th=[ 153], 20.00th=[ 165],
| 30.00th=[ 174], 40.00th=[ 180], 50.00th=[ 186], 60.00th=[ 194],
| 70.00th=[ 202], 80.00th=[ 212], 90.00th=[ 229], 95.00th=[ 249],
| 99.00th=[ 310], 99.50th=[ 343], 99.90th=[ 1369], 99.95th=[ 2769],
| 99.99th=[ 2868]
bw (KB /s): min= 1, max= 958, avg= 205.79, stdev=111.22
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 10=0.01%, 20=0.01%, 50=0.12%, 100=0.66%
lat ( msec ) : 250=44.71%, 500=41.12%, 750=9.12%, 1000=2.63%, 2000=1.40%
lat (msec) : >=2000=0.21%
cpu : usr=0.58%, sys=1.26%, ctx=0, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.8%,>=64=99.2%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.1%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=639395/w=159997/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: aggrb=811KB/s, minb=811KB/s, maxb=811KB/s, mint=4130367msec, maxt=4130367msec
WRITE: aggrb=203KB/s, minb=203KB/s, maxb=203KB/s, mint=4130367msec, maxt=4130367msec
Raid 0 with 2 HDDs @ KENTIA (ίσως ψιλο-προβλημματικός) iometer: (groupid=0, jobs=1): err= 0: pid=4892: Wed Jul 1 11:57:12 2015 Descrip
tion : [Emulation of Intel IOmeter File Server Access Pattern]
read : bw=2417.7KB/s, iops=460, runt=1387022msec
slat (usec): min=5, max=411, avg=15.52, stdev= 3.88
clat (usec): min=1, max=2084.8K, avg=125578.38, stdev=119459.19
lat (usec): min=14, max=2084.8K, avg=125593.90, stdev=119459.22
clat percentiles (usec):
| 1.00th=[ 12], 5.00th=[ 4016], 10.00th=[ 9152], 20.00th=[23168],
| 30.00th=[49408], 40.00th=[79360], 50.00th=[103936], 60.00th=[128512],
| 70.00th=[158720], 80.00th=[197632], 90.00th=[261120], 95.00th=[333824],
| 99.00th=[552960], 99.50th=[667648], 99.90th=[970752], 99.95th=[1138688],
| 99.99th=[1548288]
bw (KB /s): min= 57, max= 7283, avg=2422.14, stdev=935.65
write: io=841039KB, bw=620915B/s, iops=115, runt=1387022msec
slat (usec): min=6, max=290, avg=20.46, stdev= 4.09
clat (usec): min=128, max=2061.2K, avg=52739.37, stdev=60373.68
lat (usec): min=141, max=2061.2K, avg=52759.84, stdev=60373.73
clat percentiles (usec):
| 1.00th=[ 173], 5.00th=[ 193], 10.00th=[ 215], 20.00th=[ 804],
| 30.00th=[ 1768], 40.00th=[22400], 50.00th=[49920], 60.00th=[66048],
| 70.00th=[78336], 80.00th=[92672], 90.00th=[114176], 95.00th=[138240],
| 99.00th=[195584], 99.50th=[224256], 99.90th=[692224], 99.95th=[962560],
| 99.99th=[1368064]
bw (KB /s): min= 7, max= 2395, avg=607.40, stdev=277.89
lat (usec) : 2=0.01%, 4=0.01%, 10=0.04%, 20=2.89%, 50=0.05%
lat (usec) : 100=0.01%, 250=2.86%, 500=0.78%, 750=0.39%, 1000=0.96%
lat (msec) : 2=1.31%, 4=1.10%, 10=5.49%, 20=6.68%, 50=11.63%
lat (msec) : 100=21.39%, 250=35.28%, 500=7.99%, 750=0.90%, 1000=0.18%
lat (msec) : 2000=0.08%, >=2000=0.01%
cpu : usr=0.36%, sys=0.87%, ctx=0, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=1.2%, >=64=98.8%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.1%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=639395/w=159997/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: aggrb=2417KB/s, minb=2417KB/s, maxb=2417KB/s, mint=1387022msec, maxt=1387022msec
WRITE: aggrb=606KB/s, minb=606KB/s, maxb=606KB/s, mint=1387022msec, maxt=1387022msec iometer-file-access-server.fio
# This job file tries to mimic the Intel IOMeter File Server Access Pattern
[global]
description=Emulation of Intel IOmeter File Server Access Pattern
[iometer]
bssplit=512/10:1k/5:2k/5:4k/60:8k/2:16k/4:32k/4:64k/10
rw=randrw
rwmixread=80
direct=1
size=4g
#set ioengine to libaio for linux, windows for windows
#ioengine=libaio ioengine=windowsaio
# IOMeter defines the server loads as the following:
# iodepth=1 Linear
# iodepth=4 Very Light
# iodepth=8 Light
# iodepth=64 Moderate
# iodepth=256 Heavy
iodepth=64
SSD design1 kentia iometer: (groupid=0, jobs=1): err= 0: pid=7056: Wed Jul 1 11:29:57 2015 Descrip
tion : [Emulation of Intel IOmeter File Server Access Pattern]
read : io=3274.8MB, bw=66667KB/s, iops=12711, runt= 50299msec
slat (usec): min=4, max=661, avg=11.11, stdev= 3.63
clat (usec): min=224, max=53073, avg=4032.51, stdev=1595.93
lat (usec): min=231, max=53082, avg=4043.61, stdev=1595.95
clat percentiles (usec):
| 1.00th=[ 1752], 5.00th=[ 2256], 10.00th=[ 2544], 20.00th=[ 2960],
| 30.00th=[ 3248], 40.00th=[ 3504], 50.00th=[ 3760], 60.00th=[ 4048],
| 70.00th=[ 4384], 80.00th=[ 4896], 90.00th=[ 5728], 95.00th=[ 6496],
| 99.00th=[ 9408], 99.50th=[11968], 99.90th=[17536], 99.95th=[21376],
| 99.99th=[29824]
bw (KB /s): min=14881, max=118487, per=99.96%, avg=66637.79, stdev=17768.89
write: io=841039KB, bw=16721KB/s, iops=3180, runt= 50299msec
slat (usec): min=5, max=224, avg=13.67, stdev= 3.84
clat (usec): min=57, max=47779, avg=3800.71, stdev=1654.16
lat (usec): min=67, max=47789, avg=3814.38, stdev=1654.18
clat percentiles (usec):
| 1.00th=[ 1320], 5.00th=[ 1704], 10.00th=[ 2040], 20.00th=[ 2608],
| 30.00th=[ 2992], 40.00th=[ 3312], 50.00th=[ 3600], 60.00th=[ 3888],
| 70.00th=[ 4256], 80.00th=[ 4768], 90.00th=[ 5600], 95.00th=[ 6368],
| 99.00th=[ 9152], 99.50th=[11712], 99.90th=[17280], 99.95th=[21120],
| 99.99th=[27264]
bw (KB /s): min= 4251, max=29003, per=99.96%, avg=16713.89, stdev=4664.61
lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.05%
lat (msec) : 2=3.71%, 4=55.59%, 10=39.79%, 20=0.79%, 50=0.06%
lat (msec) : 100=0.01%
cpu : usr=7.95%, sys=17.89%, ctx=0, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=2.1%, >=64=97.9%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.1%, 32=0.1%, 64=0.1%, >=64=0.0%
issued : total=r=639395/w=159997/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=
0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: io=3274.8MB, aggrb=66666KB/s, minb=66666KB/s, maxb=66666KB/s, mint=5029
9msec, maxt=50299msec
WRITE: io=841038KB, aggrb=16720KB/s, minb=16720KB/s, maxb=16720KB/s, mint=5029
9msec, maxt=50299msec
TYPICAL Dell E5530 laptop Jobs: 1 (f=1): [m(1)] [74.5% done] [509KB/171KB/0KB /s] [120/32/0 iops] [eta 22m:33s]
fio: terminating on signal 2
iometer: (groupid=0, jobs=1): err= 0: pid=6708: Wed Jul 8 14:15:32 2015 Descrip
tion : [Emulation of Intel IOmeter File Server Access Pattern]
read : io=2440.1MB, bw=646201B/s, iops=104, runt=3960818msec
slat (usec): min=5, max=1260, avg=73.36, stdev=10.12
clat (msec): min=5, max=5446, avg=506.92, stdev=151.37
lat (msec): min=5, max=5446, avg=507.00, stdev=151.37
clat percentiles (msec):
| 1.00th=[ 217], 5.00th=[ 293], 10.00th=[ 343], 20.00th=[ 396],
| 30.00th=[ 433], 40.00th=[ 465], 50.00th=[ 494], 60.00th=[ 529],
| 70.00th=[ 562], 80.00th=[ 603], 90.00th=[ 676], 95.00th=[ 758],
| 99.00th=[ 979], 99.50th=[ 1090], 99.90th=[ 1401], 99.95th=[ 1565],
| 99.99th=[ 2376]
bw (KB /s): min 7, max= 2420, per=100.00%, avg=632.13, stdev=255.48=
write: io=626996KB, bw=162098B/s, iops=26, runt=3960818msec
slat (usec): min=7, max=533, avg=89.31, stdev=11.03
clat (usec): min=182, max=5346.2K, avg=418947.74, stdev=115173.39
lat (usec): min=207, max=5346.2K, avg=419037.05, stdev=115173.22
clat percentiles (msec):
| 1.00th=[ 159], 5.00th=[ 235], 10.00th=[ 277], 20.00th=[ 330],
| 30.00th=[ 371], 40.00th=[ 400], 50.00th=[ 424], 60.00th=[ 453],
| 70.00th=[ 478], 80.00th=[ 506], 90.00th=[ 545], 95.00th=[ 570],
| 99.00th=[ 644], 99.50th=[ 685], 99.90th=[ 1057], 99.95th=[ 1287],
| 99.99th=[ 2573]
bw (KB /s): min 0, max= 894, per=100.00%, avg=158.24, stdev=90.88=
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
lat (msec) : 100=0.03%, 250=3.03%, 500=54.09%, 750=38.48%, 1000=3.64%
lat (msec) : 2000=0.69%, >=2000=0.01%
cpu : usr=0.23%, sys=1.06%, ctx=0, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=414165/w=103796/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: io=2440.1MB, aggrb=631KB/s, minb=631KB/s, maxb=631KB/s, mint=3960818msec, maxt=3960818msec
WRITE: io=626995KB, aggrb=158KB/s, minb=158KB/s, maxb=158KB/s, mint=3960818msec, maxt=3960818msec