|
s8p6-kingston-4k-sync-write-1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
fio-3.12
|
|
Starting 1 process
|
|
|
|
s8p6-kingston-4k-sync-write-1: (groupid=0, jobs=1): err= 0: pid=1467128: Sat Apr 15 13:45:50 2023
|
|
write: IOPS=3094, BW=12.1MiB/s (12.7MB/s)(727MiB/60115msec); 0 zone resets
|
|
clat (usec): min=33, max=1256.0k, avg=312.35, stdev=6195.87
|
|
lat (usec): min=34, max=1256.0k, avg=312.58, stdev=6195.87
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 38], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 39],
|
|
| 30.00th=[ 40], 40.00th=[ 40], 50.00th=[ 40], 60.00th=[ 41],
|
|
| 70.00th=[ 42], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 108],
|
|
| 99.00th=[ 297], 99.50th=[ 1532], 99.90th=[111674], 99.95th=[132645],
|
|
| 99.99th=[162530]
|
|
bw ( KiB/s): min= 184, max=74656, per=100.00%, avg=12507.03, stdev=16943.83, samples=119
|
|
iops : min= 46, max=18664, avg=3126.76, stdev=4236.02, samples=119
|
|
lat (usec) : 50=83.96%, 100=10.49%, 250=4.41%, 500=0.40%, 750=0.16%
|
|
lat (usec) : 1000=0.05%
|
|
lat (msec) : 2=0.08%, 4=0.12%, 10=0.07%, 20=0.06%, 50=0.01%
|
|
lat (msec) : 100=0.04%, 250=0.16%, 500=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=6, max=222, avg= 8.29, stdev= 3.65
|
|
sync percentiles (nsec):
|
|
| 1.00th=[ 7136], 5.00th=[ 7328], 10.00th=[ 7328], 20.00th=[ 7456],
|
|
| 30.00th=[ 7520], 40.00th=[ 7584], 50.00th=[ 7584], 60.00th=[ 7648],
|
|
| 70.00th=[ 7712], 80.00th=[ 7904], 90.00th=[ 8512], 95.00th=[10688],
|
|
| 99.00th=[26752], 99.50th=[34560], 99.90th=[50944], 99.95th=[60672],
|
|
| 99.99th=[82432]
|
|
cpu : usr=1.45%, sys=2.65%, ctx=372123, majf=0, minf=26
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,186050,0,186049 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=12.1MiB/s (12.7MB/s), 12.1MiB/s-12.1MiB/s (12.7MB/s-12.7MB/s), io=727MiB (762MB), run=60115-60115msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=19/371554, merge=0/0, ticks=5/57736, in_queue=56648, util=94.46%
|
|
s8p6-kingston-4k-sync-write-2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 2 processes
|
|
|
|
s8p6-kingston-4k-sync-write-2: (groupid=0, jobs=2): err= 0: pid=1468818: Sat Apr 15 13:46:51 2023
|
|
write: IOPS=3644, BW=14.2MiB/s (14.9MB/s)(855MiB/60044msec); 0 zone resets
|
|
clat (usec): min=39, max=1462.0k, avg=520.53, stdev=8517.66
|
|
lat (usec): min=39, max=1462.0k, avg=520.79, stdev=8517.66
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 45], 5.00th=[ 46], 10.00th=[ 47], 20.00th=[ 49],
|
|
| 30.00th=[ 50], 40.00th=[ 52], 50.00th=[ 53], 60.00th=[ 56],
|
|
| 70.00th=[ 58], 80.00th=[ 65], 90.00th=[ 102], 95.00th=[ 153],
|
|
| 99.00th=[ 652], 99.50th=[ 4948], 99.90th=[132645], 99.95th=[139461],
|
|
| 99.99th=[160433]
|
|
bw ( KiB/s): min= 16, max=43832, per=51.76%, avg=7544.26, stdev=4148.07, samples=232
|
|
iops : min= 4, max=10958, avg=1886.04, stdev=1037.02, samples=232
|
|
lat (usec) : 50=31.09%, 100=58.71%, 250=8.29%, 500=0.74%, 750=0.22%
|
|
lat (usec) : 1000=0.07%
|
|
lat (msec) : 2=0.13%, 4=0.19%, 10=0.15%, 20=0.08%, 50=0.01%
|
|
lat (msec) : 100=0.02%, 250=0.30%, 500=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=1784, avg=15.85, stdev= 7.80
|
|
sync percentiles (nsec):
|
|
| 1.00th=[ 9536], 5.00th=[10176], 10.00th=[10560], 20.00th=[11456],
|
|
| 30.00th=[12224], 40.00th=[13248], 50.00th=[14656], 60.00th=[15680],
|
|
| 70.00th=[17024], 80.00th=[18560], 90.00th=[21888], 95.00th=[25728],
|
|
| 99.00th=[41728], 99.50th=[48896], 99.90th=[65280], 99.95th=[72192],
|
|
| 99.99th=[99840]
|
|
cpu : usr=0.72%, sys=3.40%, ctx=445983, majf=0, minf=53
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,218808,0,218806 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=14.2MiB/s (14.9MB/s), 14.2MiB/s-14.2MiB/s (14.9MB/s-14.9MB/s), io=855MiB (896MB), run=60044-60044msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=54/436488, merge=0/16, ticks=12343/113031, in_queue=123396, util=97.26%
|
|
s8p6-kingston-4k-sync-write-3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 3 processes
|
|
|
|
s8p6-kingston-4k-sync-write-3: (groupid=0, jobs=3): err= 0: pid=1470151: Sat Apr 15 13:47:52 2023
|
|
write: IOPS=5309, BW=20.7MiB/s (21.7MB/s)(1245MiB/60002msec); 0 zone resets
|
|
clat (usec): min=42, max=211086, avg=534.01, stdev=7361.29
|
|
lat (usec): min=42, max=211087, avg=534.27, stdev=7361.29
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 47], 5.00th=[ 48], 10.00th=[ 50], 20.00th=[ 51],
|
|
| 30.00th=[ 53], 40.00th=[ 56], 50.00th=[ 58], 60.00th=[ 61],
|
|
| 70.00th=[ 65], 80.00th=[ 76], 90.00th=[ 122], 95.00th=[ 174],
|
|
| 99.00th=[ 963], 99.50th=[ 6587], 99.90th=[133694], 99.95th=[143655],
|
|
| 99.99th=[160433]
|
|
bw ( KiB/s): min= 2032, max=43248, per=33.61%, avg=7138.30, stdev=3586.86, samples=357
|
|
iops : min= 508, max=10812, avg=1784.52, stdev=896.72, samples=357
|
|
lat (usec) : 50=13.79%, 100=73.35%, 250=10.53%, 500=1.02%, 750=0.23%
|
|
lat (usec) : 1000=0.08%
|
|
lat (msec) : 2=0.15%, 4=0.20%, 10=0.17%, 20=0.11%, 50=0.03%
|
|
lat (msec) : 100=0.03%, 250=0.30%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=654, avg=19.12, stdev= 8.88
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 12], 20.00th=[ 13],
|
|
| 30.00th=[ 15], 40.00th=[ 16], 50.00th=[ 17], 60.00th=[ 19],
|
|
| 70.00th=[ 21], 80.00th=[ 24], 90.00th=[ 30], 95.00th=[ 36],
|
|
| 99.00th=[ 52], 99.50th=[ 60], 99.90th=[ 80], 99.95th=[ 89],
|
|
| 99.99th=[ 143]
|
|
cpu : usr=0.75%, sys=3.60%, ctx=651038, majf=0, minf=80
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,318609,0,318606 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=20.7MiB/s (21.7MB/s), 20.7MiB/s-20.7MiB/s (21.7MB/s-21.7MB/s), io=1245MiB (1305MB), run=60002-60002msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=54/637147, merge=0/44, ticks=12836/169478, in_queue=178028, util=98.88%
|
|
s8p6-kingston-4k-sync-write-4: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 4 processes
|
|
|
|
s8p6-kingston-4k-sync-write-4: (groupid=0, jobs=4): err= 0: pid=1471514: Sat Apr 15 13:48:53 2023
|
|
write: IOPS=12.7k, BW=49.8MiB/s (52.2MB/s)(2985MiB/60001msec); 0 zone resets
|
|
clat (usec): min=37, max=1389.9k, avg=284.98, stdev=5948.90
|
|
lat (usec): min=37, max=1389.9k, avg=285.22, stdev=5948.91
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 48], 5.00th=[ 49], 10.00th=[ 50], 20.00th=[ 52],
|
|
| 30.00th=[ 54], 40.00th=[ 56], 50.00th=[ 58], 60.00th=[ 61],
|
|
| 70.00th=[ 65], 80.00th=[ 72], 90.00th=[ 95], 95.00th=[ 149],
|
|
| 99.00th=[ 379], 99.50th=[ 1188], 99.90th=[117965], 99.95th=[127402],
|
|
| 99.99th=[141558]
|
|
bw ( KiB/s): min= 72, max=49536, per=24.89%, avg=12679.74, stdev=13914.88, samples=468
|
|
iops : min= 18, max=12384, avg=3169.90, stdev=3478.75, samples=468
|
|
lat (usec) : 50=9.46%, 100=81.47%, 250=7.49%, 500=0.74%, 750=0.21%
|
|
lat (usec) : 1000=0.09%
|
|
lat (msec) : 2=0.13%, 4=0.12%, 10=0.09%, 20=0.03%, 50=0.01%
|
|
lat (msec) : 100=0.02%, 250=0.14%, 750=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=917, avg=21.54, stdev= 9.75
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 12], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 16],
|
|
| 30.00th=[ 17], 40.00th=[ 18], 50.00th=[ 19], 60.00th=[ 21],
|
|
| 70.00th=[ 23], 80.00th=[ 27], 90.00th=[ 34], 95.00th=[ 40],
|
|
| 99.00th=[ 56], 99.50th=[ 64], 99.90th=[ 84], 99.95th=[ 94],
|
|
| 99.99th=[ 145]
|
|
cpu : usr=1.33%, sys=6.51%, ctx=1574673, majf=0, minf=107
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,764193,0,764189 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=49.8MiB/s (52.2MB/s), 49.8MiB/s-49.8MiB/s (52.2MB/s-52.2MB/s), io=2985MiB (3130MB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=54/1512844, merge=0/157, ticks=13458/217131, in_queue=218408, util=99.23%
|
|
s8p6-kingston-4k-sync-write-5: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 5 processes
|
|
|
|
s8p6-kingston-4k-sync-write-5: (groupid=0, jobs=5): err= 0: pid=1473170: Sat Apr 15 13:49:54 2023
|
|
write: IOPS=52.9k, BW=206MiB/s (216MB/s)(12.1GiB/60001msec); 0 zone resets
|
|
clat (usec): min=38, max=19544, avg=66.26, stdev=93.74
|
|
lat (usec): min=38, max=19544, avg=66.47, stdev=93.74
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 45], 5.00th=[ 47], 10.00th=[ 49], 20.00th=[ 52],
|
|
| 30.00th=[ 54], 40.00th=[ 56], 50.00th=[ 58], 60.00th=[ 61],
|
|
| 70.00th=[ 64], 80.00th=[ 69], 90.00th=[ 77], 95.00th=[ 95],
|
|
| 99.00th=[ 165], 99.50th=[ 277], 99.90th=[ 1123], 99.95th=[ 1582],
|
|
| 99.99th=[ 2900]
|
|
bw ( KiB/s): min=37508, max=46032, per=20.02%, avg=42316.56, stdev=1471.84, samples=595
|
|
iops : min= 9377, max=11508, avg=10579.12, stdev=367.97, samples=595
|
|
lat (usec) : 50=14.91%, 100=80.78%, 250=3.76%, 500=0.18%, 750=0.16%
|
|
lat (usec) : 1000=0.08%
|
|
lat (msec) : 2=0.09%, 4=0.03%, 10=0.01%, 20=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=6, max=3164, avg=26.07, stdev=10.91
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 18],
|
|
| 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 28],
|
|
| 70.00th=[ 31], 80.00th=[ 35], 90.00th=[ 40], 95.00th=[ 45],
|
|
| 99.00th=[ 58], 99.50th=[ 63], 99.90th=[ 81], 99.95th=[ 89],
|
|
| 99.99th=[ 131]
|
|
cpu : usr=4.01%, sys=17.77%, ctx=6536916, majf=0, minf=141
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,3171173,0,3171168 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=206MiB/s (216MB/s), 206MiB/s-206MiB/s (216MB/s-216MB/s), io=12.1GiB (12.0GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/6329791, merge=0/262, ticks=21/226077, in_queue=159308, util=99.36%
|
|
s8p6-kingston-4k-sync-write-6: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 6 processes
|
|
|
|
s8p6-kingston-4k-sync-write-6: (groupid=0, jobs=6): err= 0: pid=1474531: Sat Apr 15 13:50:55 2023
|
|
write: IOPS=56.9k, BW=222MiB/s (233MB/s)(13.0GiB/60001msec); 0 zone resets
|
|
clat (usec): min=38, max=19770, avg=70.11, stdev=97.30
|
|
lat (usec): min=39, max=19770, avg=70.33, stdev=97.31
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 46], 5.00th=[ 49], 10.00th=[ 51], 20.00th=[ 54],
|
|
| 30.00th=[ 57], 40.00th=[ 59], 50.00th=[ 62], 60.00th=[ 64],
|
|
| 70.00th=[ 68], 80.00th=[ 73], 90.00th=[ 83], 95.00th=[ 102],
|
|
| 99.00th=[ 180], 99.50th=[ 314], 99.90th=[ 1172], 99.95th=[ 1598],
|
|
| 99.99th=[ 2999]
|
|
bw ( KiB/s): min=31928, max=41776, per=16.66%, avg=37925.74, stdev=1494.07, samples=714
|
|
iops : min= 7982, max=10444, avg=9481.41, stdev=373.51, samples=714
|
|
lat (usec) : 50=8.23%, 100=86.53%, 250=4.63%, 500=0.22%, 750=0.16%
|
|
lat (usec) : 1000=0.09%
|
|
lat (msec) : 2=0.11%, 4=0.02%, 10=0.01%, 20=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=4575, avg=32.95, stdev=14.58
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21],
|
|
| 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36],
|
|
| 70.00th=[ 39], 80.00th=[ 43], 90.00th=[ 49], 95.00th=[ 55],
|
|
| 99.00th=[ 70], 99.50th=[ 77], 99.90th=[ 99], 99.95th=[ 117],
|
|
| 99.99th=[ 277]
|
|
cpu : usr=3.77%, sys=17.01%, ctx=7288114, majf=0, minf=167
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,3414681,0,3414677 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=222MiB/s (233MB/s), 222MiB/s-222MiB/s (233MB/s-233MB/s), io=13.0GiB (13.0GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=51/6814212, merge=0/837, ticks=10/272061, in_queue=181904, util=100.00%
|
|
s8p6-kingston-4k-sync-write-7: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 7 processes
|
|
|
|
s8p6-kingston-4k-sync-write-7: (groupid=0, jobs=7): err= 0: pid=1475984: Sat Apr 15 13:51:56 2023
|
|
write: IOPS=59.8k, BW=234MiB/s (245MB/s)(13.7GiB/60001msec); 0 zone resets
|
|
clat (usec): min=38, max=1232.2k, avg=76.13, stdev=1736.94
|
|
lat (usec): min=39, max=1232.2k, avg=76.37, stdev=1736.94
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 47], 5.00th=[ 50], 10.00th=[ 53], 20.00th=[ 57],
|
|
| 30.00th=[ 60], 40.00th=[ 62], 50.00th=[ 65], 60.00th=[ 69],
|
|
| 70.00th=[ 73], 80.00th=[ 78], 90.00th=[ 88], 95.00th=[ 110],
|
|
| 99.00th=[ 182], 99.50th=[ 265], 99.90th=[ 1020], 99.95th=[ 1532],
|
|
| 99.99th=[ 3032]
|
|
bw ( KiB/s): min=11368, max=37936, per=14.52%, avg=34757.56, stdev=2509.15, samples=820
|
|
iops : min= 2842, max= 9484, avg=8689.37, stdev=627.30, samples=820
|
|
lat (usec) : 50=4.91%, 100=88.95%, 250=5.61%, 500=0.20%, 750=0.15%
|
|
lat (usec) : 1000=0.07%
|
|
lat (msec) : 2=0.08%, 4=0.02%, 10=0.01%, 20=0.01%, 50=0.01%
|
|
lat (msec) : 250=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=3533, avg=38.60, stdev=16.21
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 28],
|
|
| 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 38], 60.00th=[ 41],
|
|
| 70.00th=[ 45], 80.00th=[ 49], 90.00th=[ 56], 95.00th=[ 63],
|
|
| 99.00th=[ 80], 99.50th=[ 87], 99.90th=[ 112], 99.95th=[ 133],
|
|
| 99.99th=[ 330]
|
|
cpu : usr=3.38%, sys=16.55%, ctx=7827640, majf=0, minf=212
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,3589783,0,3589778 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=234MiB/s (245MB/s), 234MiB/s-234MiB/s (245MB/s-245MB/s), io=13.7GiB (14.7GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/7163824, merge=0/669, ticks=19/322178, in_queue=211104, util=99.99%
|
|
s8p6-kingston-4k-sync-write-8: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 8 processes
|
|
|
|
s8p6-kingston-4k-sync-write-8: (groupid=0, jobs=8): err= 0: pid=1477674: Sat Apr 15 13:52:57 2023
|
|
write: IOPS=63.0k, BW=250MiB/s (262MB/s)(14.6GiB/60001msec); 0 zone resets
|
|
clat (usec): min=39, max=36981, avg=79.33, stdev=115.60
|
|
lat (usec): min=39, max=36982, avg=79.56, stdev=115.61
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 48], 5.00th=[ 52], 10.00th=[ 56], 20.00th=[ 60],
|
|
| 30.00th=[ 63], 40.00th=[ 67], 50.00th=[ 70], 60.00th=[ 74],
|
|
| 70.00th=[ 78], 80.00th=[ 85], 90.00th=[ 97], 95.00th=[ 120],
|
|
| 99.00th=[ 202], 99.50th=[ 334], 99.90th=[ 1123], 99.95th=[ 1582],
|
|
| 99.99th=[ 3326]
|
|
bw ( KiB/s): min=24455, max=34880, per=12.50%, avg=31986.29, stdev=1426.41, samples=952
|
|
iops : min= 6113, max= 8720, avg=7996.53, stdev=356.61, samples=952
|
|
lat (usec) : 50=2.85%, 100=88.38%, 250=8.10%, 500=0.29%, 750=0.15%
|
|
lat (usec) : 1000=0.11%
|
|
lat (msec) : 2=0.10%, 4=0.02%, 10=0.01%, 20=0.01%, 50=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=5285, avg=43.41, stdev=18.35
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 26], 20.00th=[ 32],
|
|
| 30.00th=[ 36], 40.00th=[ 39], 50.00th=[ 42], 60.00th=[ 45],
|
|
| 70.00th=[ 49], 80.00th=[ 55], 90.00th=[ 63], 95.00th=[ 72],
|
|
| 99.00th=[ 92], 99.50th=[ 101], 99.90th=[ 130], 99.95th=[ 161],
|
|
| 99.99th=[ 383]
|
|
cpu : usr=3.07%, sys=16.91%, ctx=8494279, majf=0, minf=259
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,3839838,0,3839834 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=250MiB/s (262MB/s), 250MiB/s-250MiB/s (262MB/s-262MB/s), io=14.6GiB (15.7GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=51/7663344, merge=0/620, ticks=10/371247, in_queue=234736, util=100.00%
|
|
s8p6-kingston-4k-sync-write-9: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 9 processes
|
|
|
|
s8p6-kingston-4k-sync-write-9: (groupid=0, jobs=9): err= 0: pid=1478990: Sat Apr 15 13:53:57 2023
|
|
write: IOPS=67.5k, BW=264MiB/s (276MB/s)(15.4GiB/60001msec); 0 zone resets
|
|
clat (usec): min=39, max=20346, avg=83.79, stdev=107.42
|
|
lat (usec): min=40, max=20346, avg=84.03, stdev=107.43
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 50], 5.00th=[ 56], 10.00th=[ 59], 20.00th=[ 64],
|
|
| 30.00th=[ 68], 40.00th=[ 71], 50.00th=[ 75], 60.00th=[ 78],
|
|
| 70.00th=[ 83], 80.00th=[ 90], 90.00th=[ 104], 95.00th=[ 127],
|
|
| 99.00th=[ 208], 99.50th=[ 306], 99.90th=[ 1139], 99.95th=[ 1549],
|
|
| 99.99th=[ 2999]
|
|
bw ( KiB/s): min=26024, max=33328, per=11.11%, avg=29994.46, stdev=1003.80, samples=1071
|
|
iops : min= 6506, max= 8334, avg=7498.59, stdev=250.95, samples=1071
|
|
lat (usec) : 50=1.34%, 100=86.90%, 250=11.10%, 500=0.28%, 750=0.13%
|
|
lat (usec) : 1000=0.10%
|
|
lat (msec) : 2=0.10%, 4=0.02%, 10=0.01%, 20=0.01%, 50=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=7255, avg=47.27, stdev=19.70
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 30], 20.00th=[ 35],
|
|
| 30.00th=[ 39], 40.00th=[ 42], 50.00th=[ 45], 60.00th=[ 48],
|
|
| 70.00th=[ 53], 80.00th=[ 59], 90.00th=[ 69], 95.00th=[ 80],
|
|
| 99.00th=[ 103], 99.50th=[ 115], 99.90th=[ 151], 99.95th=[ 182],
|
|
| 99.99th=[ 437]
|
|
cpu : usr=2.95%, sys=16.90%, ctx=9012991, majf=0, minf=291
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,4048618,0,4048611 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=264MiB/s (276MB/s), 264MiB/s-264MiB/s (276MB/s-276MB/s), io=15.4GiB (16.6GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/8078696, merge=0/1713, ticks=21/420687, in_queue=261196, util=100.00%
|
|
s8p6-kingston-4k-sync-write-10: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 10 processes
|
|
|
|
s8p6-kingston-4k-sync-write-10: (groupid=0, jobs=10): err= 0: pid=1480386: Sat Apr 15 13:54:59 2023
|
|
write: IOPS=51.6k, BW=202MiB/s (211MB/s)(11.8GiB/60078msec); 0 zone resets
|
|
clat (usec): min=41, max=263703, avg=142.26, stdev=2178.65
|
|
lat (usec): min=41, max=263703, avg=142.49, stdev=2178.65
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 53], 5.00th=[ 61], 10.00th=[ 65], 20.00th=[ 71],
|
|
| 30.00th=[ 75], 40.00th=[ 79], 50.00th=[ 83], 60.00th=[ 87],
|
|
| 70.00th=[ 93], 80.00th=[ 100], 90.00th=[ 118], 95.00th=[ 157],
|
|
| 99.00th=[ 322], 99.50th=[ 725], 99.90th=[ 3949], 99.95th=[ 17171],
|
|
| 99.99th=[123208]
|
|
bw ( KiB/s): min= 1888, max=30760, per=10.01%, avg=20662.46, stdev=10034.61, samples=1200
|
|
iops : min= 472, max= 7690, avg=5165.59, stdev=2508.66, samples=1200
|
|
lat (usec) : 50=0.35%, 100=79.36%, 250=18.65%, 500=0.98%, 750=0.19%
|
|
lat (usec) : 1000=0.14%
|
|
lat (msec) : 2=0.16%, 4=0.07%, 10=0.03%, 20=0.02%, 50=0.01%
|
|
lat (msec) : 100=0.01%, 250=0.02%, 500=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=2998, avg=49.03, stdev=22.68
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 35],
|
|
| 30.00th=[ 39], 40.00th=[ 42], 50.00th=[ 45], 60.00th=[ 49],
|
|
| 70.00th=[ 54], 80.00th=[ 61], 90.00th=[ 74], 95.00th=[ 87],
|
|
| 99.00th=[ 118], 99.50th=[ 133], 99.90th=[ 182], 99.95th=[ 233],
|
|
| 99.99th=[ 611]
|
|
cpu : usr=2.25%, sys=12.07%, ctx=6893800, majf=0, minf=321
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,3099720,0,3099710 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=202MiB/s (211MB/s), 202MiB/s-202MiB/s (211MB/s-211MB/s), io=11.8GiB (12.7GB), run=60078-60078msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/6192205, merge=0/1935, ticks=19/500453, in_queue=372768, util=99.52%
|
|
s8p6-kingston-4k-sync-write-11: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 11 processes
|
|
|
|
s8p6-kingston-4k-sync-write-11: (groupid=0, jobs=11): err= 0: pid=1481881: Sat Apr 15 13:56:02 2023
|
|
write: IOPS=24.0k, BW=93.8MiB/s (98.3MB/s)(5626MiB/60011msec); 0 zone resets
|
|
clat (usec): min=43, max=1151.4k, avg=392.55, stdev=5377.74
|
|
lat (usec): min=44, max=1151.4k, avg=392.82, stdev=5377.75
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 52], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 80],
|
|
| 30.00th=[ 88], 40.00th=[ 93], 50.00th=[ 99], 60.00th=[ 105],
|
|
| 70.00th=[ 114], 80.00th=[ 128], 90.00th=[ 204], 95.00th=[ 265],
|
|
| 99.00th=[ 1156], 99.50th=[ 4883], 99.90th=[ 81265], 99.95th=[ 95945],
|
|
| 99.99th=[116917]
|
|
bw ( KiB/s): min= 175, max=23744, per=9.17%, avg=8801.24, stdev=2732.29, samples=1309
|
|
iops : min= 43, max= 5936, avg=2200.27, stdev=683.08, samples=1309
|
|
lat (usec) : 50=0.15%, 100=52.16%, 250=41.67%, 500=4.28%, 750=0.49%
|
|
lat (usec) : 1000=0.18%
|
|
lat (msec) : 2=0.23%, 4=0.22%, 10=0.22%, 20=0.06%, 50=0.05%
|
|
lat (msec) : 100=0.25%, 250=0.04%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=2802, avg=63.13, stdev=39.02
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 32], 20.00th=[ 38],
|
|
| 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 51], 60.00th=[ 58],
|
|
| 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 126], 95.00th=[ 141],
|
|
| 99.00th=[ 172], 99.50th=[ 188], 99.90th=[ 269], 99.95th=[ 351],
|
|
| 99.99th=[ 758]
|
|
cpu : usr=0.94%, sys=6.34%, ctx=3372053, majf=0, minf=319
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,1440322,0,1440311 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=93.8MiB/s (98.3MB/s), 93.8MiB/s-93.8MiB/s (98.3MB/s-98.3MB/s), io=5626MiB (5900MB), run=60011-60011msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=51/2873219, merge=0/1662, ticks=8674/584844, in_queue=539088, util=99.98%
|
|
s8p6-kingston-4k-sync-write-12: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 12 processes
|
|
|
|
s8p6-kingston-4k-sync-write-12: (groupid=0, jobs=12): err= 0: pid=1483477: Sat Apr 15 13:57:04 2023
|
|
write: IOPS=22.1k, BW=86.3MiB/s (90.5MB/s)(5180MiB/60002msec); 0 zone resets
|
|
clat (usec): min=43, max=1800.9k, avg=468.92, stdev=7617.73
|
|
lat (usec): min=43, max=1800.9k, avg=469.20, stdev=7617.73
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 52], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 81],
|
|
| 30.00th=[ 92], 40.00th=[ 99], 50.00th=[ 106], 60.00th=[ 114],
|
|
| 70.00th=[ 123], 80.00th=[ 139], 90.00th=[ 227], 95.00th=[ 281],
|
|
| 99.00th=[ 1418], 99.50th=[ 5014], 99.90th=[103285], 99.95th=[110625],
|
|
| 99.99th=[128451]
|
|
bw ( KiB/s): min= 4472, max=22976, per=8.56%, avg=7567.40, stdev=2803.35, samples=1394
|
|
iops : min= 1118, max= 5744, avg=1891.81, stdev=700.85, samples=1394
|
|
lat (usec) : 50=0.14%, 100=41.01%, 250=51.28%, 500=5.69%, 750=0.58%
|
|
lat (usec) : 1000=0.17%
|
|
lat (msec) : 2=0.25%, 4=0.25%, 10=0.26%, 20=0.05%, 50=0.02%
|
|
lat (msec) : 100=0.20%, 250=0.11%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=8, max=4741, avg=71.19, stdev=45.40
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 18], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 40],
|
|
| 30.00th=[ 45], 40.00th=[ 50], 50.00th=[ 56], 60.00th=[ 63],
|
|
| 70.00th=[ 76], 80.00th=[ 102], 90.00th=[ 145], 95.00th=[ 157],
|
|
| 99.00th=[ 186], 99.50th=[ 202], 99.90th=[ 273], 99.95th=[ 375],
|
|
| 99.99th=[ 922]
|
|
cpu : usr=0.81%, sys=5.62%, ctx=3153512, majf=0, minf=371
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,1326114,0,1326109 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=86.3MiB/s (90.5MB/s), 86.3MiB/s-86.3MiB/s (90.5MB/s-90.5MB/s), io=5180MiB (5432MB), run=60002-60002msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=51/2643716, merge=0/1663, ticks=10756/641921, in_queue=600976, util=100.00%
|
|
s8p6-kingston-4k-sync-write-13: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 13 processes
|
|
|
|
s8p6-kingston-4k-sync-write-13: (groupid=0, jobs=13): err= 0: pid=1484905: Sat Apr 15 13:58:05 2023
|
|
write: IOPS=47.3k, BW=185MiB/s (194MB/s)(10.8GiB/60001msec); 0 zone resets
|
|
clat (usec): min=44, max=709512, avg=202.91, stdev=3378.14
|
|
lat (usec): min=44, max=709512, avg=203.15, stdev=3378.15
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 53], 5.00th=[ 62], 10.00th=[ 73], 20.00th=[ 85],
|
|
| 30.00th=[ 92], 40.00th=[ 98], 50.00th=[ 103], 60.00th=[ 110],
|
|
| 70.00th=[ 118], 80.00th=[ 129], 90.00th=[ 159], 95.00th=[ 217],
|
|
| 99.00th=[ 490], 99.50th=[ 922], 99.90th=[ 8455], 99.95th=[ 85459],
|
|
| 99.99th=[110625]
|
|
bw ( KiB/s): min= 728, max=24864, per=7.65%, avg=14469.80, stdev=7519.22, samples=1547
|
|
iops : min= 182, max= 6216, avg=3617.42, stdev=1879.81, samples=1547
|
|
lat (usec) : 50=0.09%, 100=44.75%, 250=51.76%, 500=2.42%, 750=0.28%
|
|
lat (usec) : 1000=0.24%
|
|
lat (msec) : 2=0.20%, 4=0.10%, 10=0.06%, 20=0.02%, 50=0.01%
|
|
lat (msec) : 100=0.05%, 250=0.02%, 750=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=2982, avg=69.55, stdev=41.59
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 20], 5.00th=[ 33], 10.00th=[ 37], 20.00th=[ 43],
|
|
| 30.00th=[ 47], 40.00th=[ 51], 50.00th=[ 57], 60.00th=[ 63],
|
|
| 70.00th=[ 73], 80.00th=[ 89], 90.00th=[ 130], 95.00th=[ 165],
|
|
| 99.00th=[ 194], 99.50th=[ 208], 99.90th=[ 265], 99.95th=[ 314],
|
|
| 99.99th=[ 791]
|
|
cpu : usr=1.51%, sys=12.19%, ctx=6632216, majf=0, minf=401
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,2835837,0,2835829 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=185MiB/s (194MB/s), 185MiB/s-185MiB/s (194MB/s-194MB/s), io=10.8GiB (11.6GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=51/5665641, merge=0/3960, ticks=11258/639718, in_queue=510988, util=100.00%
|
|
s8p6-kingston-4k-sync-write-14: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 14 processes
|
|
|
|
s8p6-kingston-4k-sync-write-14: (groupid=0, jobs=14): err= 0: pid=1486299: Sat Apr 15 13:59:06 2023
|
|
write: IOPS=73.4k, BW=287MiB/s (301MB/s)(16.8GiB/60001msec); 0 zone resets
|
|
clat (usec): min=38, max=7145, avg=122.71, stdev=79.89
|
|
lat (usec): min=38, max=7145, avg=122.93, stdev=79.90
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 64], 5.00th=[ 77], 10.00th=[ 85], 20.00th=[ 93],
|
|
| 30.00th=[ 100], 40.00th=[ 105], 50.00th=[ 112], 60.00th=[ 117],
|
|
| 70.00th=[ 125], 80.00th=[ 135], 90.00th=[ 159], 95.00th=[ 192],
|
|
| 99.00th=[ 330], 99.50th=[ 594], 99.90th=[ 1205], 99.95th=[ 1418],
|
|
| 99.99th=[ 1926]
|
|
bw ( KiB/s): min=18176, max=23352, per=7.14%, avg=20978.32, stdev=761.82, samples=1667
|
|
iops : min= 4544, max= 5838, avg=5244.56, stdev=190.47, samples=1667
|
|
lat (usec) : 50=0.07%, 100=31.00%, 250=66.91%, 500=1.46%, 750=0.15%
|
|
lat (usec) : 1000=0.26%
|
|
lat (msec) : 2=0.16%, 4=0.01%, 10=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=6, max=2711, avg=65.49, stdev=33.71
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 21], 5.00th=[ 33], 10.00th=[ 38], 20.00th=[ 43],
|
|
| 30.00th=[ 47], 40.00th=[ 52], 50.00th=[ 57], 60.00th=[ 64],
|
|
| 70.00th=[ 73], 80.00th=[ 85], 90.00th=[ 108], 95.00th=[ 128],
|
|
| 99.00th=[ 174], 99.50th=[ 194], 99.90th=[ 249], 99.95th=[ 302],
|
|
| 99.99th=[ 701]
|
|
cpu : usr=2.12%, sys=17.90%, ctx=10223642, majf=0, minf=417
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,4405859,0,4405847 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=287MiB/s (301MB/s), 287MiB/s-287MiB/s (301MB/s-301MB/s), io=16.8GiB (18.0GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=51/8790249, merge=0/2813, ticks=10/680268, in_queue=417100, util=98.72%
|
|
s8p6-kingston-4k-sync-write-15: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 15 processes
|
|
|
|
s8p6-kingston-4k-sync-write-15: (groupid=0, jobs=15): err= 0: pid=1487948: Sat Apr 15 14:00:07 2023
|
|
write: IOPS=69.7k, BW=272MiB/s (285MB/s)(15.9GiB/60001msec); 0 zone resets
|
|
clat (usec): min=40, max=17553, avg=138.57, stdev=111.02
|
|
lat (usec): min=40, max=17553, avg=138.81, stdev=111.03
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 67], 5.00th=[ 81], 10.00th=[ 90], 20.00th=[ 100],
|
|
| 30.00th=[ 108], 40.00th=[ 115], 50.00th=[ 122], 60.00th=[ 129],
|
|
| 70.00th=[ 139], 80.00th=[ 155], 90.00th=[ 188], 95.00th=[ 229],
|
|
| 99.00th=[ 441], 99.50th=[ 832], 99.90th=[ 1450], 99.95th=[ 1762],
|
|
| 99.99th=[ 2999]
|
|
bw ( KiB/s): min=13736, max=22264, per=6.67%, avg=18587.64, stdev=1182.21, samples=1788
|
|
iops : min= 3434, max= 5566, avg=4646.88, stdev=295.55, samples=1788
|
|
lat (usec) : 50=0.07%, 100=20.23%, 250=76.10%, 500=2.71%, 750=0.25%
|
|
lat (usec) : 1000=0.35%
|
|
lat (msec) : 2=0.25%, 4=0.03%, 10=0.01%, 20=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=4674, avg=74.41, stdev=41.19
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 21], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 46],
|
|
| 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 63], 60.00th=[ 73],
|
|
| 70.00th=[ 84], 80.00th=[ 100], 90.00th=[ 127], 95.00th=[ 151],
|
|
| 99.00th=[ 206], 99.50th=[ 229], 99.90th=[ 285], 99.95th=[ 326],
|
|
| 99.99th=[ 963]
|
|
cpu : usr=1.76%, sys=18.82%, ctx=9821389, majf=0, minf=459
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,4179439,0,4179429 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=272MiB/s (285MB/s), 272MiB/s-272MiB/s (285MB/s-285MB/s), io=15.9GiB (17.1GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/8341482, merge=0/2638, ticks=19/733146, in_queue=440784, util=97.61%
|
|
s8p6-kingston-4k-sync-write-16: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 16 processes
|
|
|
|
s8p6-kingston-4k-sync-write-16: (groupid=0, jobs=16): err= 0: pid=1489331: Sat Apr 15 14:01:08 2023
|
|
write: IOPS=65.9k, BW=257MiB/s (270MB/s)(15.1GiB/60001msec); 0 zone resets
|
|
clat (usec): min=37, max=15446, avg=159.49, stdev=144.99
|
|
lat (usec): min=38, max=15446, avg=159.74, stdev=145.00
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 68], 5.00th=[ 85], 10.00th=[ 95], 20.00th=[ 108],
|
|
| 30.00th=[ 117], 40.00th=[ 124], 50.00th=[ 133], 60.00th=[ 143],
|
|
| 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 221], 95.00th=[ 281],
|
|
| 99.00th=[ 832], 99.50th=[ 1045], 99.90th=[ 1795], 99.95th=[ 2212],
|
|
| 99.99th=[ 3621]
|
|
bw ( KiB/s): min=12888, max=20136, per=6.25%, avg=16463.73, stdev=1146.39, samples=1906
|
|
iops : min= 3222, max= 5034, avg=4115.92, stdev=286.60, samples=1906
|
|
lat (usec) : 50=0.06%, 100=13.95%, 250=78.96%, 500=5.22%, 750=0.54%
|
|
lat (usec) : 1000=0.71%
|
|
lat (msec) : 2=0.49%, 4=0.06%, 10=0.01%, 20=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=5151, avg=80.88, stdev=47.81
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 21], 5.00th=[ 35], 10.00th=[ 40], 20.00th=[ 47],
|
|
| 30.00th=[ 53], 40.00th=[ 60], 50.00th=[ 69], 60.00th=[ 79],
|
|
| 70.00th=[ 92], 80.00th=[ 112], 90.00th=[ 141], 95.00th=[ 169],
|
|
| 99.00th=[ 229], 99.50th=[ 253], 99.90th=[ 322], 99.95th=[ 383],
|
|
| 99.99th=[ 979]
|
|
cpu : usr=1.60%, sys=18.66%, ctx=9378803, majf=0, minf=486
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,3953383,0,3953370 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=257MiB/s (270MB/s), 257MiB/s-257MiB/s (270MB/s-270MB/s), io=15.1GiB (16.2GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/7884730, merge=0/3908, ticks=20/790666, in_queue=483440, util=96.93%
|