|
s8p6-kingston-2-4k-sync-write-1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
fio-3.12
|
|
Starting 1 process
|
|
|
|
s8p6-kingston-2-4k-sync-write-1: (groupid=0, jobs=1): err= 0: pid=1545533: Sat Apr 15 14:41:27 2023
|
|
write: IOPS=18.1k, BW=70.9MiB/s (74.3MB/s)(4253MiB/60001msec); 0 zone resets
|
|
clat (usec): min=32, max=252247, avg=45.02, stdev=252.20
|
|
lat (usec): min=32, max=252247, avg=45.23, stdev=252.20
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 38],
|
|
| 30.00th=[ 38], 40.00th=[ 38], 50.00th=[ 39], 60.00th=[ 39],
|
|
| 70.00th=[ 40], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 64],
|
|
| 99.00th=[ 89], 99.50th=[ 206], 99.90th=[ 791], 99.95th=[ 1319],
|
|
| 99.99th=[ 2540]
|
|
bw ( KiB/s): min=55736, max=79160, per=99.95%, avg=72549.01, stdev=6329.94, samples=119
|
|
iops : min=13934, max=19790, avg=18137.24, stdev=1582.50, samples=119
|
|
lat (usec) : 50=88.35%, 100=10.87%, 250=0.35%, 500=0.15%, 750=0.18%
|
|
lat (usec) : 1000=0.04%
|
|
lat (msec) : 2=0.04%, 4=0.02%, 10=0.01%, 20=0.01%, 500=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=6, max=374, avg= 7.78, stdev= 1.76
|
|
sync percentiles (nsec):
|
|
| 1.00th=[ 7136], 5.00th=[ 7264], 10.00th=[ 7328], 20.00th=[ 7392],
|
|
| 30.00th=[ 7456], 40.00th=[ 7456], 50.00th=[ 7520], 60.00th=[ 7520],
|
|
| 70.00th=[ 7584], 80.00th=[ 7712], 90.00th=[ 7968], 95.00th=[ 8640],
|
|
| 99.00th=[12608], 99.50th=[18304], 99.90th=[32128], 99.95th=[37120],
|
|
| 99.99th=[50944]
|
|
cpu : usr=7.76%, sys=14.70%, ctx=2177694, majf=0, minf=26
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,1088834,0,1088833 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=70.9MiB/s (74.3MB/s), 70.9MiB/s-70.9MiB/s (74.3MB/s-74.3MB/s), io=4253MiB (4460MB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=51/2173248, merge=0/0, ticks=19/48955, in_queue=42560, util=70.95%
|
|
s8p6-kingston-2-4k-sync-write-2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 2 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-2: (groupid=0, jobs=2): err= 0: pid=1547195: Sat Apr 15 14:42:28 2023
|
|
write: IOPS=27.3k, BW=107MiB/s (112MB/s)(6406MiB/60001msec); 0 zone resets
|
|
clat (usec): min=33, max=22092, avg=54.91, stdev=79.16
|
|
lat (usec): min=33, max=22092, avg=55.11, stdev=79.17
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 40], 5.00th=[ 41], 10.00th=[ 42], 20.00th=[ 44],
|
|
| 30.00th=[ 46], 40.00th=[ 49], 50.00th=[ 50], 60.00th=[ 51],
|
|
| 70.00th=[ 52], 80.00th=[ 55], 90.00th=[ 63], 95.00th=[ 79],
|
|
| 99.00th=[ 112], 99.50th=[ 176], 99.90th=[ 889], 99.95th=[ 1336],
|
|
| 99.99th=[ 2737]
|
|
bw ( KiB/s): min=41728, max=60192, per=50.00%, avg=54670.04, stdev=2866.07, samples=238
|
|
iops : min=10432, max=15048, avg=13667.51, stdev=716.53, samples=238
|
|
lat (usec) : 50=49.39%, 100=48.76%, 250=1.47%, 500=0.09%, 750=0.16%
|
|
lat (usec) : 1000=0.05%
|
|
lat (msec) : 2=0.06%, 4=0.02%, 10=0.01%, 20=0.01%, 50=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=6, max=1215, avg=15.95, stdev= 5.40
|
|
sync percentiles (nsec):
|
|
| 1.00th=[ 9408], 5.00th=[ 9920], 10.00th=[10688], 20.00th=[13376],
|
|
| 30.00th=[14016], 40.00th=[14400], 50.00th=[14656], 60.00th=[14912],
|
|
| 70.00th=[15424], 80.00th=[18048], 90.00th=[24448], 95.00th=[26240],
|
|
| 99.00th=[31872], 99.50th=[36096], 99.90th=[49920], 99.95th=[56576],
|
|
| 99.99th=[74240]
|
|
cpu : usr=4.76%, sys=19.21%, ctx=3282883, majf=0, minf=73
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,1639981,0,1639979 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=107MiB/s (112MB/s), 107MiB/s-107MiB/s (112MB/s-112MB/s), io=6406MiB (6717MB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/3272969, merge=0/715, ticks=19/95089, in_queue=75204, util=80.45%
|
|
s8p6-kingston-2-4k-sync-write-3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 3 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-3: (groupid=0, jobs=3): err= 0: pid=1548504: Sat Apr 15 14:43:28 2023
|
|
write: IOPS=38.2k, BW=149MiB/s (157MB/s)(8960MiB/60001msec); 0 zone resets
|
|
clat (usec): min=33, max=1463.9k, avg=58.47, stdev=1676.26
|
|
lat (usec): min=33, max=1463.9k, avg=58.69, stdev=1676.26
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 41], 5.00th=[ 42], 10.00th=[ 43], 20.00th=[ 45],
|
|
| 30.00th=[ 46], 40.00th=[ 48], 50.00th=[ 50], 60.00th=[ 52],
|
|
| 70.00th=[ 55], 80.00th=[ 58], 90.00th=[ 67], 95.00th=[ 88],
|
|
| 99.00th=[ 121], 99.50th=[ 196], 99.90th=[ 889], 99.95th=[ 1336],
|
|
| 99.99th=[ 2606]
|
|
bw ( KiB/s): min=15080, max=55312, per=33.89%, avg=51822.08, stdev=4306.53, samples=351
|
|
iops : min= 3770, max=13828, avg=12955.52, stdev=1076.63, samples=351
|
|
lat (usec) : 50=50.06%, 100=46.86%, 250=2.67%, 500=0.11%, 750=0.16%
|
|
lat (usec) : 1000=0.06%
|
|
lat (msec) : 2=0.06%, 4=0.02%, 10=0.01%, 20=0.01%, 50=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=6, max=855, avg=17.81, stdev= 6.84
|
|
sync percentiles (nsec):
|
|
| 1.00th=[ 9664], 5.00th=[10560], 10.00th=[11584], 20.00th=[12864],
|
|
| 30.00th=[13888], 40.00th=[14784], 50.00th=[15424], 60.00th=[16512],
|
|
| 70.00th=[19072], 80.00th=[22912], 90.00th=[27776], 95.00th=[30848],
|
|
| 99.00th=[38656], 99.50th=[42752], 99.90th=[57088], 99.95th=[63744],
|
|
| 99.99th=[82432]
|
|
cpu : usr=4.44%, sys=18.52%, ctx=4617096, majf=0, minf=82
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,2293796,0,2293794 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=149MiB/s (157MB/s), 149MiB/s-149MiB/s (157MB/s-157MB/s), io=8960MiB (9395MB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/4578554, merge=0/862, ticks=24/141644, in_queue=109920, util=94.90%
|
|
s8p6-kingston-2-4k-sync-write-4: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 4 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-4: (groupid=0, jobs=4): err= 0: pid=1549844: Sat Apr 15 14:44:29 2023
|
|
write: IOPS=46.2k, BW=180MiB/s (189MB/s)(10.6GiB/60001msec); 0 zone resets
|
|
clat (usec): min=36, max=387629, avg=63.14, stdev=477.84
|
|
lat (usec): min=36, max=387629, avg=63.35, stdev=477.85
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 43], 5.00th=[ 45], 10.00th=[ 46], 20.00th=[ 48],
|
|
| 30.00th=[ 50], 40.00th=[ 52], 50.00th=[ 53], 60.00th=[ 56],
|
|
| 70.00th=[ 59], 80.00th=[ 63], 90.00th=[ 73], 95.00th=[ 97],
|
|
| 99.00th=[ 149], 99.50th=[ 255], 99.90th=[ 1450], 99.95th=[ 2114],
|
|
| 99.99th=[ 3916]
|
|
bw ( KiB/s): min=25696, max=51160, per=25.01%, avg=46215.08, stdev=3623.72, samples=476
|
|
iops : min= 6424, max=12790, avg=11553.78, stdev=905.93, samples=476
|
|
lat (usec) : 50=32.26%, 100=63.27%, 250=3.96%, 500=0.14%, 750=0.17%
|
|
lat (usec) : 1000=0.05%
|
|
lat (msec) : 2=0.09%, 4=0.04%, 10=0.01%, 20=0.01%, 50=0.01%
|
|
lat (msec) : 500=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=2420, avg=21.17, stdev= 8.83
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 12], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 15],
|
|
| 30.00th=[ 16], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 21],
|
|
| 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 33], 95.00th=[ 38],
|
|
| 99.00th=[ 48], 99.50th=[ 53], 99.90th=[ 70], 99.95th=[ 78],
|
|
| 99.99th=[ 105]
|
|
cpu : usr=4.17%, sys=18.06%, ctx=5615075, majf=0, minf=151
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,2772249,0,2772247 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=180MiB/s (189MB/s), 180MiB/s-180MiB/s (189MB/s-189MB/s), io=10.6GiB (11.4GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=51/5533591, merge=0/430, ticks=9/187041, in_queue=139992, util=98.68%
|
|
s8p6-kingston-2-4k-sync-write-5: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 5 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-5: (groupid=0, jobs=5): err= 0: pid=1551528: Sat Apr 15 14:45:30 2023
|
|
write: IOPS=48.8k, BW=191MiB/s (200MB/s)(11.2GiB/60001msec); 0 zone resets
|
|
clat (usec): min=37, max=18771, avg=73.19, stdev=119.93
|
|
lat (usec): min=38, max=18772, avg=73.42, stdev=119.93
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 45], 5.00th=[ 47], 10.00th=[ 49], 20.00th=[ 52],
|
|
| 30.00th=[ 55], 40.00th=[ 57], 50.00th=[ 60], 60.00th=[ 63],
|
|
| 70.00th=[ 67], 80.00th=[ 74], 90.00th=[ 92], 95.00th=[ 122],
|
|
| 99.00th=[ 237], 99.50th=[ 594], 99.90th=[ 1680], 99.95th=[ 2507],
|
|
| 99.99th=[ 3654]
|
|
bw ( KiB/s): min=32568, max=44782, per=19.99%, avg=39046.86, stdev=1904.45, samples=595
|
|
iops : min= 8142, max=11195, avg=9761.67, stdev=476.11, samples=595
|
|
lat (usec) : 50=14.03%, 100=77.60%, 250=7.44%, 500=0.36%, 750=0.24%
|
|
lat (usec) : 1000=0.10%
|
|
lat (msec) : 2=0.15%, 4=0.07%, 10=0.01%, 20=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=6, max=1928, avg=26.79, stdev=11.99
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 18],
|
|
| 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 28],
|
|
| 70.00th=[ 32], 80.00th=[ 36], 90.00th=[ 42], 95.00th=[ 47],
|
|
| 99.00th=[ 61], 99.50th=[ 67], 99.90th=[ 86], 99.95th=[ 96],
|
|
| 99.99th=[ 172]
|
|
cpu : usr=3.76%, sys=16.86%, ctx=6052254, majf=0, minf=165
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,2930522,0,2930520 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=191MiB/s (200MB/s), 191MiB/s-191MiB/s (200MB/s-200MB/s), io=11.2GiB (12.0GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/5847384, merge=0/1321, ticks=19/232473, in_queue=170276, util=98.94%
|
|
s8p6-kingston-2-4k-sync-write-6: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 6 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-6: (groupid=0, jobs=6): err= 0: pid=1552877: Sat Apr 15 14:46:31 2023
|
|
write: IOPS=52.7k, BW=206MiB/s (216MB/s)(12.1GiB/60001msec); 0 zone resets
|
|
clat (usec): min=38, max=19962, avg=78.26, stdev=133.31
|
|
lat (usec): min=39, max=19962, avg=78.50, stdev=133.32
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 46], 5.00th=[ 49], 10.00th=[ 52], 20.00th=[ 55],
|
|
| 30.00th=[ 58], 40.00th=[ 61], 50.00th=[ 64], 60.00th=[ 68],
|
|
| 70.00th=[ 73], 80.00th=[ 80], 90.00th=[ 103], 95.00th=[ 131],
|
|
| 99.00th=[ 245], 99.50th=[ 562], 99.90th=[ 1713], 99.95th=[ 2474],
|
|
| 99.99th=[ 3654]
|
|
bw ( KiB/s): min=29632, max=39512, per=16.66%, avg=35127.74, stdev=1686.27, samples=714
|
|
iops : min= 7408, max= 9878, avg=8781.91, stdev=421.56, samples=714
|
|
lat (usec) : 50=7.06%, 100=82.25%, 250=9.73%, 500=0.43%, 750=0.23%
|
|
lat (usec) : 1000=0.08%
|
|
lat (msec) : 2=0.15%, 4=0.07%, 10=0.01%, 20=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=6, max=5264, avg=33.23, stdev=16.12
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21],
|
|
| 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36],
|
|
| 70.00th=[ 40], 80.00th=[ 44], 90.00th=[ 50], 95.00th=[ 57],
|
|
| 99.00th=[ 73], 99.50th=[ 81], 99.90th=[ 105], 99.95th=[ 125],
|
|
| 99.99th=[ 269]
|
|
cpu : usr=3.52%, sys=16.27%, ctx=6713398, majf=0, minf=179
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,3162742,0,3162739 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=206MiB/s (216MB/s), 206MiB/s-206MiB/s (216MB/s-216MB/s), io=12.1GiB (12.0GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/6309915, merge=0/1579, ticks=19/278277, in_queue=194896, util=99.76%
|
|
s8p6-kingston-2-4k-sync-write-7: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 7 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-7: (groupid=0, jobs=7): err= 0: pid=1554333: Sat Apr 15 14:47:32 2023
|
|
write: IOPS=17.8k, BW=69.7MiB/s (73.0MB/s)(4183MiB/60054msec); 0 zone resets
|
|
clat (usec): min=44, max=368935, avg=352.55, stdev=4708.03
|
|
lat (usec): min=44, max=368935, avg=352.80, stdev=4708.03
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 53], 5.00th=[ 59], 10.00th=[ 62], 20.00th=[ 66],
|
|
| 30.00th=[ 70], 40.00th=[ 74], 50.00th=[ 79], 60.00th=[ 84],
|
|
| 70.00th=[ 92], 80.00th=[ 109], 90.00th=[ 153], 95.00th=[ 210],
|
|
| 99.00th=[ 824], 99.50th=[ 4555], 99.90th=[ 92799], 99.95th=[109577],
|
|
| 99.99th=[132645]
|
|
bw ( KiB/s): min= 510, max=32128, per=14.30%, avg=10197.50, stdev=7115.93, samples=840
|
|
iops : min= 127, max= 8032, avg=2549.34, stdev=1778.99, samples=840
|
|
lat (usec) : 50=0.10%, 100=75.96%, 250=20.74%, 500=1.85%, 750=0.30%
|
|
lat (usec) : 1000=0.11%
|
|
lat (msec) : 2=0.20%, 4=0.20%, 10=0.19%, 20=0.08%, 50=0.03%
|
|
lat (msec) : 100=0.15%, 250=0.08%, 500=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=2465, avg=37.30, stdev=19.01
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 24],
|
|
| 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 39],
|
|
| 70.00th=[ 43], 80.00th=[ 49], 90.00th=[ 58], 95.00th=[ 67],
|
|
| 99.00th=[ 89], 99.50th=[ 99], 99.90th=[ 133], 99.95th=[ 165],
|
|
| 99.99th=[ 506]
|
|
cpu : usr=1.17%, sys=6.32%, ctx=2322856, majf=0, minf=209
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,1070894,0,1070887 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=69.7MiB/s (73.0MB/s), 69.7MiB/s-69.7MiB/s (73.0MB/s-73.0MB/s), io=4183MiB (4386MB), run=60054-60054msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=64/2138913, merge=0/438, ticks=1154/381106, in_queue=352312, util=99.90%
|
|
s8p6-kingston-2-4k-sync-write-8: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 8 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-8: (groupid=0, jobs=8): err= 0: pid=1555841: Sat Apr 15 14:48:33 2023
|
|
write: IOPS=19.6k, BW=76.4MiB/s (80.1MB/s)(4587MiB/60039msec); 0 zone resets
|
|
clat (usec): min=45, max=204982, avg=355.21, stdev=4075.62
|
|
lat (usec): min=45, max=204982, avg=355.48, stdev=4075.62
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 53], 5.00th=[ 58], 10.00th=[ 62], 20.00th=[ 68],
|
|
| 30.00th=[ 73], 40.00th=[ 78], 50.00th=[ 83], 60.00th=[ 89],
|
|
| 70.00th=[ 98], 80.00th=[ 115], 90.00th=[ 163], 95.00th=[ 223],
|
|
| 99.00th=[ 1303], 99.50th=[ 8455], 99.90th=[ 72877], 99.95th=[ 91751],
|
|
| 99.99th=[125305]
|
|
bw ( KiB/s): min= 808, max=25184, per=12.61%, avg=9867.41, stdev=2907.51, samples=952
|
|
iops : min= 202, max= 6296, avg=2466.83, stdev=726.88, samples=952
|
|
lat (usec) : 50=0.08%, 100=71.84%, 250=24.41%, 500=2.16%, 750=0.31%
|
|
lat (usec) : 1000=0.13%
|
|
lat (msec) : 2=0.22%, 4=0.17%, 10=0.23%, 20=0.12%, 50=0.11%
|
|
lat (msec) : 100=0.19%, 250=0.04%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=2814, avg=45.02, stdev=25.24
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27],
|
|
| 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 41], 60.00th=[ 45],
|
|
| 70.00th=[ 52], 80.00th=[ 62], 90.00th=[ 77], 95.00th=[ 86],
|
|
| 99.00th=[ 112], 99.50th=[ 126], 99.90th=[ 182], 99.95th=[ 235],
|
|
| 99.99th=[ 619]
|
|
cpu : usr=1.10%, sys=6.33%, ctx=2676595, majf=0, minf=254
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,1174335,0,1174327 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=76.4MiB/s (80.1MB/s), 76.4MiB/s-76.4MiB/s (80.1MB/s-80.1MB/s), io=4587MiB (4810MB), run=60039-60039msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=54/2343557, merge=0/785, ticks=10656/424130, in_queue=402832, util=99.93%
|
|
s8p6-kingston-2-4k-sync-write-9: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 9 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-9: (groupid=0, jobs=9): err= 0: pid=1557384: Sat Apr 15 14:49:36 2023
|
|
write: IOPS=16.2k, BW=63.4MiB/s (66.5MB/s)(3806MiB/60004msec); 0 zone resets
|
|
clat (usec): min=45, max=200068, avg=499.18, stdev=6218.77
|
|
lat (usec): min=45, max=200068, avg=499.46, stdev=6218.77
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 53], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 72],
|
|
| 30.00th=[ 77], 40.00th=[ 82], 50.00th=[ 88], 60.00th=[ 94],
|
|
| 70.00th=[ 104], 80.00th=[ 122], 90.00th=[ 178], 95.00th=[ 235],
|
|
| 99.00th=[ 1647], 99.50th=[ 8455], 99.90th=[116917], 99.95th=[127402],
|
|
| 99.99th=[145753]
|
|
bw ( KiB/s): min= 4191, max=21908, per=11.11%, avg=7216.12, stdev=2518.01, samples=1080
|
|
iops : min= 1047, max= 5477, avg=1804.00, stdev=629.51, samples=1080
|
|
lat (usec) : 50=0.09%, 100=66.54%, 250=29.19%, 500=2.56%, 750=0.30%
|
|
lat (usec) : 1000=0.13%
|
|
lat (msec) : 2=0.25%, 4=0.22%, 10=0.26%, 20=0.11%, 50=0.02%
|
|
lat (msec) : 100=0.12%, 250=0.21%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=3203, avg=52.26, stdev=29.84
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 31],
|
|
| 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 51],
|
|
| 70.00th=[ 59], 80.00th=[ 74], 90.00th=[ 94], 95.00th=[ 104],
|
|
| 99.00th=[ 133], 99.50th=[ 147], 99.90th=[ 206], 99.95th=[ 265],
|
|
| 99.99th=[ 685]
|
|
cpu : usr=0.84%, sys=4.88%, ctx=2264486, majf=0, minf=240
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,974317,0,974308 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=63.4MiB/s (66.5MB/s), 63.4MiB/s-63.4MiB/s (66.5MB/s-66.5MB/s), io=3806MiB (3991MB), run=60004-60004msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=51/1944567, merge=0/1196, ticks=11351/493536, in_queue=476916, util=100.00%
|
|
s8p6-kingston-2-4k-sync-write-10: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 10 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-10: (groupid=0, jobs=10): err= 0: pid=1558752: Sat Apr 15 14:50:38 2023
|
|
write: IOPS=17.9k, BW=70.0MiB/s (73.4MB/s)(4201MiB/60001msec); 0 zone resets
|
|
clat (usec): min=45, max=712862, avg=487.49, stdev=6201.22
|
|
lat (usec): min=45, max=712862, avg=487.80, stdev=6201.22
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 52], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 74],
|
|
| 30.00th=[ 81], 40.00th=[ 87], 50.00th=[ 93], 60.00th=[ 101],
|
|
| 70.00th=[ 111], 80.00th=[ 129], 90.00th=[ 196], 95.00th=[ 255],
|
|
| 99.00th=[ 1745], 99.50th=[ 8455], 99.90th=[106431], 99.95th=[119014],
|
|
| 99.99th=[137364]
|
|
bw ( KiB/s): min= 5376, max=18384, per=10.18%, avg=7296.24, stdev=1923.41, samples=1172
|
|
iops : min= 1344, max= 4596, avg=1824.03, stdev=480.86, samples=1172
|
|
lat (usec) : 50=0.09%, 100=59.42%, 250=35.22%, 500=3.54%, 750=0.37%
|
|
lat (usec) : 1000=0.15%
|
|
lat (msec) : 2=0.26%, 4=0.23%, 10=0.27%, 20=0.11%, 50=0.02%
|
|
lat (msec) : 100=0.18%, 250=0.14%, 500=0.01%, 750=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=2644, avg=61.05, stdev=36.31
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 29], 20.00th=[ 36],
|
|
| 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 51], 60.00th=[ 58],
|
|
| 70.00th=[ 68], 80.00th=[ 89], 90.00th=[ 114], 95.00th=[ 124],
|
|
| 99.00th=[ 155], 99.50th=[ 174], 99.90th=[ 265], 99.95th=[ 359],
|
|
| 99.99th=[ 807]
|
|
cpu : usr=0.85%, sys=5.12%, ctx=2540310, majf=0, minf=280
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,1075493,0,1075486 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=70.0MiB/s (73.4MB/s), 70.0MiB/s-70.0MiB/s (73.4MB/s-73.4MB/s), io=4201MiB (4405MB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=54/2148503, merge=0/1481, ticks=13585/535985, in_queue=513800, util=100.00%
|
|
s8p6-kingston-2-4k-sync-write-11: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 11 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-11: (groupid=0, jobs=11): err= 0: pid=1560164: Sat Apr 15 14:51:39 2023
|
|
write: IOPS=54.6k, BW=213MiB/s (224MB/s)(12.5GiB/60001msec); 0 zone resets
|
|
clat (usec): min=44, max=531505, avg=141.96, stdev=1893.03
|
|
lat (usec): min=44, max=531506, avg=142.19, stdev=1893.03
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 54], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 76],
|
|
| 30.00th=[ 81], 40.00th=[ 85], 50.00th=[ 90], 60.00th=[ 96],
|
|
| 70.00th=[ 104], 80.00th=[ 117], 90.00th=[ 147], 95.00th=[ 198],
|
|
| 99.00th=[ 529], 99.50th=[ 898], 99.90th=[ 3425], 99.95th=[ 8586],
|
|
| 99.99th=[104334]
|
|
bw ( KiB/s): min= 7, max=28304, per=9.07%, avg=19796.42, stdev=7520.65, samples=1309
|
|
iops : min= 1, max= 7076, avg=4949.09, stdev=1880.17, samples=1309
|
|
lat (usec) : 50=0.07%, 100=65.57%, 250=31.50%, 500=1.83%, 750=0.29%
|
|
lat (usec) : 1000=0.31%
|
|
lat (msec) : 2=0.25%, 4=0.10%, 10=0.04%, 20=0.02%, 50=0.01%
|
|
lat (msec) : 100=0.01%, 250=0.01%, 750=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=7418, avg=57.01, stdev=35.05
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 32], 20.00th=[ 38],
|
|
| 30.00th=[ 42], 40.00th=[ 45], 50.00th=[ 49], 60.00th=[ 55],
|
|
| 70.00th=[ 61], 80.00th=[ 71], 90.00th=[ 93], 95.00th=[ 125],
|
|
| 99.00th=[ 155], 99.50th=[ 169], 99.90th=[ 227], 99.95th=[ 285],
|
|
| 99.99th=[ 807]
|
|
cpu : usr=2.04%, sys=14.55%, ctx=7476489, majf=0, minf=321
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,3274770,0,3274760 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=213MiB/s (224MB/s), 213MiB/s-213MiB/s (224MB/s-224MB/s), io=12.5GiB (13.4GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=51/6525581, merge=0/1655, ticks=11533/522741, in_queue=397900, util=100.00%
|
|
s8p6-kingston-2-4k-sync-write-12: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 12 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-12: (groupid=0, jobs=12): err= 0: pid=1561849: Sat Apr 15 14:52:40 2023
|
|
write: IOPS=68.0k, BW=266MiB/s (279MB/s)(15.6GiB/60001msec); 0 zone resets
|
|
clat (usec): min=40, max=6106, avg=116.91, stdev=123.69
|
|
lat (usec): min=41, max=6106, avg=117.15, stdev=123.70
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 59], 5.00th=[ 68], 10.00th=[ 74], 20.00th=[ 81],
|
|
| 30.00th=[ 86], 40.00th=[ 91], 50.00th=[ 97], 60.00th=[ 103],
|
|
| 70.00th=[ 112], 80.00th=[ 125], 90.00th=[ 153], 95.00th=[ 196],
|
|
| 99.00th=[ 570], 99.50th=[ 865], 99.90th=[ 1860], 99.95th=[ 2376],
|
|
| 99.99th=[ 3228]
|
|
bw ( KiB/s): min=18560, max=26368, per=8.34%, avg=22680.90, stdev=1111.44, samples=1428
|
|
iops : min= 4640, max= 6592, avg=5670.21, stdev=277.87, samples=1428
|
|
lat (usec) : 50=0.15%, 100=55.56%, 250=41.57%, 500=1.64%, 750=0.28%
|
|
lat (usec) : 1000=0.43%
|
|
lat (msec) : 2=0.29%, 4=0.08%, 10=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=7299, avg=57.00, stdev=28.52
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 18], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 40],
|
|
| 30.00th=[ 44], 40.00th=[ 47], 50.00th=[ 51], 60.00th=[ 57],
|
|
| 70.00th=[ 63], 80.00th=[ 73], 90.00th=[ 89], 95.00th=[ 105],
|
|
| 99.00th=[ 141], 99.50th=[ 157], 99.90th=[ 200], 99.95th=[ 237],
|
|
| 99.99th=[ 586]
|
|
cpu : usr=2.35%, sys=16.05%, ctx=9264425, majf=0, minf=365
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,4081760,0,4081752 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=266MiB/s (279MB/s), 266MiB/s-266MiB/s (279MB/s-279MB/s), io=15.6GiB (16.7GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/8144467, merge=0/2806, ticks=19/584506, in_queue=382188, util=99.54%
|
|
s8p6-kingston-2-4k-sync-write-13: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 13 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-13: (groupid=0, jobs=13): err= 0: pid=1563194: Sat Apr 15 14:53:40 2023
|
|
write: IOPS=67.3k, BW=263MiB/s (276MB/s)(15.4GiB/60001msec); 0 zone resets
|
|
clat (usec): min=39, max=11999, avg=127.62, stdev=129.27
|
|
lat (usec): min=40, max=11999, avg=127.82, stdev=129.28
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 61], 5.00th=[ 73], 10.00th=[ 79], 20.00th=[ 87],
|
|
| 30.00th=[ 93], 40.00th=[ 99], 50.00th=[ 105], 60.00th=[ 113],
|
|
| 70.00th=[ 122], 80.00th=[ 137], 90.00th=[ 169], 95.00th=[ 215],
|
|
| 99.00th=[ 701], 99.50th=[ 906], 99.90th=[ 1876], 99.95th=[ 2409],
|
|
| 99.99th=[ 3228]
|
|
bw ( KiB/s): min=17568, max=23952, per=7.69%, avg=20712.96, stdev=957.55, samples=1547
|
|
iops : min= 4392, max= 5988, avg=5178.22, stdev=239.40, samples=1547
|
|
lat (usec) : 50=0.11%, 100=42.35%, 250=54.04%, 500=2.23%, 750=0.35%
|
|
lat (usec) : 1000=0.51%
|
|
lat (msec) : 2=0.33%, 4=0.08%, 10=0.01%, 20=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=5262, avg=63.18, stdev=34.66
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 19], 5.00th=[ 30], 10.00th=[ 36], 20.00th=[ 42],
|
|
| 30.00th=[ 46], 40.00th=[ 51], 50.00th=[ 56], 60.00th=[ 62],
|
|
| 70.00th=[ 71], 80.00th=[ 82], 90.00th=[ 101], 95.00th=[ 121],
|
|
| 99.00th=[ 163], 99.50th=[ 182], 99.90th=[ 239], 99.95th=[ 302],
|
|
| 99.99th=[ 906]
|
|
cpu : usr=2.04%, sys=16.75%, ctx=9243226, majf=0, minf=398
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,4039536,0,4039529 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=263MiB/s (276MB/s), 263MiB/s-263MiB/s (276MB/s-276MB/s), io=15.4GiB (16.5GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/8058075, merge=0/3198, ticks=26/634404, in_queue=403276, util=98.69%
|
|
s8p6-kingston-2-4k-sync-write-14: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 14 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-14: (groupid=0, jobs=14): err= 0: pid=1564558: Sat Apr 15 14:54:41 2023
|
|
write: IOPS=68.3k, BW=267MiB/s (280MB/s)(15.6GiB/60001msec); 0 zone resets
|
|
clat (usec): min=41, max=15379, avg=134.99, stdev=137.70
|
|
lat (usec): min=41, max=15379, avg=135.25, stdev=137.71
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 64], 5.00th=[ 77], 10.00th=[ 84], 20.00th=[ 94],
|
|
| 30.00th=[ 100], 40.00th=[ 108], 50.00th=[ 114], 60.00th=[ 121],
|
|
| 70.00th=[ 131], 80.00th=[ 147], 90.00th=[ 180], 95.00th=[ 219],
|
|
| 99.00th=[ 594], 99.50th=[ 922], 99.90th=[ 1958], 99.95th=[ 2540],
|
|
| 99.99th=[ 3490]
|
|
bw ( KiB/s): min=15872, max=22264, per=7.14%, avg=19510.02, stdev=805.53, samples=1668
|
|
iops : min= 3968, max= 5566, avg=4877.49, stdev=201.38, samples=1668
|
|
lat (usec) : 50=0.08%, 100=29.48%, 250=66.97%, 500=2.34%, 750=0.25%
|
|
lat (usec) : 1000=0.45%
|
|
lat (msec) : 2=0.34%, 4=0.09%, 10=0.01%, 20=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=5049, avg=67.69, stdev=39.13
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 20], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 43],
|
|
| 30.00th=[ 48], 40.00th=[ 53], 50.00th=[ 59], 60.00th=[ 66],
|
|
| 70.00th=[ 76], 80.00th=[ 89], 90.00th=[ 113], 95.00th=[ 135],
|
|
| 99.00th=[ 182], 99.50th=[ 202], 99.90th=[ 262], 99.95th=[ 330],
|
|
| 99.99th=[ 1045]
|
|
cpu : usr=1.87%, sys=17.47%, ctx=9503900, majf=0, minf=399
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,4096876,0,4096866 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=267MiB/s (280MB/s), 267MiB/s-267MiB/s (280MB/s-280MB/s), io=15.6GiB (16.8GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/8175466, merge=0/2166, ticks=23/687144, in_queue=431028, util=98.21%
|
|
s8p6-kingston-2-4k-sync-write-15: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 15 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-15: (groupid=0, jobs=15): err= 0: pid=1566254: Sat Apr 15 14:55:42 2023
|
|
write: IOPS=65.9k, BW=258MiB/s (270MB/s)(15.1GiB/60001msec); 0 zone resets
|
|
clat (usec): min=37, max=12552, avg=150.52, stdev=170.34
|
|
lat (usec): min=37, max=12553, avg=150.77, stdev=170.35
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 65], 5.00th=[ 80], 10.00th=[ 89], 20.00th=[ 100],
|
|
| 30.00th=[ 109], 40.00th=[ 116], 50.00th=[ 123], 60.00th=[ 133],
|
|
| 70.00th=[ 143], 80.00th=[ 159], 90.00th=[ 196], 95.00th=[ 243],
|
|
| 99.00th=[ 865], 99.50th=[ 1369], 99.90th=[ 2474], 99.95th=[ 2933],
|
|
| 99.99th=[ 3982]
|
|
bw ( KiB/s): min=14040, max=20344, per=6.66%, avg=17571.38, stdev=889.97, samples=1785
|
|
iops : min= 3510, max= 5086, avg=4392.83, stdev=222.49, samples=1785
|
|
lat (usec) : 50=0.09%, 100=20.47%, 250=74.79%, 500=3.00%, 750=0.38%
|
|
lat (usec) : 1000=0.54%
|
|
lat (msec) : 2=0.56%, 4=0.16%, 10=0.01%, 20=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=4832, avg=74.47, stdev=43.38
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 20], 5.00th=[ 34], 10.00th=[ 39], 20.00th=[ 46],
|
|
| 30.00th=[ 51], 40.00th=[ 58], 50.00th=[ 64], 60.00th=[ 73],
|
|
| 70.00th=[ 84], 80.00th=[ 100], 90.00th=[ 126], 95.00th=[ 149],
|
|
| 99.00th=[ 202], 99.50th=[ 225], 99.90th=[ 293], 99.95th=[ 355],
|
|
| 99.99th=[ 1057]
|
|
cpu : usr=1.77%, sys=17.68%, ctx=9281471, majf=0, minf=533
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,3956029,0,3956019 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=258MiB/s (270MB/s), 258MiB/s-258MiB/s (270MB/s-270MB/s), io=15.1GiB (16.2GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/7891066, merge=0/3365, ticks=19/744053, in_queue=470960, util=98.19%
|
|
s8p6-kingston-2-4k-sync-write-16: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
|
|
...
|
|
fio-3.12
|
|
Starting 16 processes
|
|
|
|
s8p6-kingston-2-4k-sync-write-16: (groupid=0, jobs=16): err= 0: pid=1567614: Sat Apr 15 14:56:43 2023
|
|
write: IOPS=67.7k, BW=265MiB/s (277MB/s)(15.5GiB/60001msec); 0 zone resets
|
|
clat (usec): min=39, max=17613, avg=152.69, stdev=138.23
|
|
lat (usec): min=39, max=17613, avg=152.93, stdev=138.24
|
|
clat percentiles (usec):
|
|
| 1.00th=[ 68], 5.00th=[ 84], 10.00th=[ 94], 20.00th=[ 106],
|
|
| 30.00th=[ 116], 40.00th=[ 123], 50.00th=[ 131], 60.00th=[ 141],
|
|
| 70.00th=[ 151], 80.00th=[ 169], 90.00th=[ 206], 95.00th=[ 249],
|
|
| 99.00th=[ 652], 99.50th=[ 971], 99.90th=[ 2040], 99.95th=[ 2540],
|
|
| 99.99th=[ 3523]
|
|
bw ( KiB/s): min=14832, max=19464, per=6.25%, avg=16928.06, stdev=704.59, samples=1905
|
|
iops : min= 3708, max= 4866, avg=4231.99, stdev=176.15, samples=1905
|
|
lat (usec) : 50=0.07%, 100=14.50%, 250=80.45%, 500=3.78%, 750=0.27%
|
|
lat (usec) : 1000=0.44%
|
|
lat (msec) : 2=0.37%, 4=0.10%, 10=0.01%, 20=0.01%
|
|
fsync/fdatasync/sync_file_range:
|
|
sync (usec): min=7, max=4317, avg=81.11, stdev=47.31
|
|
sync percentiles (usec):
|
|
| 1.00th=[ 22], 5.00th=[ 35], 10.00th=[ 40], 20.00th=[ 47],
|
|
| 30.00th=[ 53], 40.00th=[ 60], 50.00th=[ 69], 60.00th=[ 79],
|
|
| 70.00th=[ 93], 80.00th=[ 112], 90.00th=[ 143], 95.00th=[ 169],
|
|
| 99.00th=[ 229], 99.50th=[ 255], 99.90th=[ 322], 99.95th=[ 375],
|
|
| 99.99th=[ 1012]
|
|
cpu : usr=1.60%, sys=19.25%, ctx=9663054, majf=0, minf=540
|
|
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
|
|
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
|
|
issued rwts: total=0,4064957,0,4064944 short=0,0,0,0 dropped=0,0,0,0
|
|
latency : target=0, window=0, percentile=100.00%, depth=1
|
|
|
|
Run status group 0 (all jobs):
|
|
WRITE: bw=265MiB/s (277MB/s), 265MiB/s-265MiB/s (277MB/s-277MB/s), io=15.5GiB (16.7GB), run=60001-60001msec
|
|
|
|
Disk stats (read/write):
|
|
sdb: ios=102/8105862, merge=0/5481, ticks=20/784902, in_queue=466672, util=96.55%
|