s8p6-kingston-4k-sync-write-1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
fio-3.12
Starting 1 process

s8p6-kingston-4k-sync-write-1: (groupid=0, jobs=1): err= 0: pid=1467128: Sat Apr 15 13:45:50 2023
  write: IOPS=3094, BW=12.1MiB/s (12.7MB/s)(727MiB/60115msec); 0 zone resets
    clat (usec): min=33, max=1256.0k, avg=312.35, stdev=6195.87
     lat (usec): min=34, max=1256.0k, avg=312.58, stdev=6195.87
    clat percentiles (usec):
     |  1.00th=[    38],  5.00th=[    39], 10.00th=[    39], 20.00th=[    39],
     | 30.00th=[    40], 40.00th=[    40], 50.00th=[    40], 60.00th=[    41],
     | 70.00th=[    42], 80.00th=[    45], 90.00th=[    68], 95.00th=[   108],
     | 99.00th=[   297], 99.50th=[  1532], 99.90th=[111674], 99.95th=[132645],
     | 99.99th=[162530]
   bw (  KiB/s): min=  184, max=74656, per=100.00%, avg=12507.03, stdev=16943.83, samples=119
   iops        : min=   46, max=18664, avg=3126.76, stdev=4236.02, samples=119
  lat (usec)   : 50=83.96%, 100=10.49%, 250=4.41%, 500=0.40%, 750=0.16%
  lat (usec)   : 1000=0.05%
  lat (msec)   : 2=0.08%, 4=0.12%, 10=0.07%, 20=0.06%, 50=0.01%
  lat (msec)   : 100=0.04%, 250=0.16%, 500=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=6, max=222, avg= 8.29, stdev= 3.65
    sync percentiles (nsec):
     |  1.00th=[ 7136],  5.00th=[ 7328], 10.00th=[ 7328], 20.00th=[ 7456],
     | 30.00th=[ 7520], 40.00th=[ 7584], 50.00th=[ 7584], 60.00th=[ 7648],
     | 70.00th=[ 7712], 80.00th=[ 7904], 90.00th=[ 8512], 95.00th=[10688],
     | 99.00th=[26752], 99.50th=[34560], 99.90th=[50944], 99.95th=[60672],
     | 99.99th=[82432]
  cpu          : usr=1.45%, sys=2.65%, ctx=372123, majf=0, minf=26
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,186050,0,186049 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=12.1MiB/s (12.7MB/s), 12.1MiB/s-12.1MiB/s (12.7MB/s-12.7MB/s), io=727MiB (762MB), run=60115-60115msec

Disk stats (read/write):
  sdb: ios=19/371554, merge=0/0, ticks=5/57736, in_queue=56648, util=94.46%
s8p6-kingston-4k-sync-write-2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 2 processes

s8p6-kingston-4k-sync-write-2: (groupid=0, jobs=2): err= 0: pid=1468818: Sat Apr 15 13:46:51 2023
  write: IOPS=3644, BW=14.2MiB/s (14.9MB/s)(855MiB/60044msec); 0 zone resets
    clat (usec): min=39, max=1462.0k, avg=520.53, stdev=8517.66
     lat (usec): min=39, max=1462.0k, avg=520.79, stdev=8517.66
    clat percentiles (usec):
     |  1.00th=[    45],  5.00th=[    46], 10.00th=[    47], 20.00th=[    49],
     | 30.00th=[    50], 40.00th=[    52], 50.00th=[    53], 60.00th=[    56],
     | 70.00th=[    58], 80.00th=[    65], 90.00th=[   102], 95.00th=[   153],
     | 99.00th=[   652], 99.50th=[  4948], 99.90th=[132645], 99.95th=[139461],
     | 99.99th=[160433]
   bw (  KiB/s): min=   16, max=43832, per=51.76%, avg=7544.26, stdev=4148.07, samples=232
   iops        : min=    4, max=10958, avg=1886.04, stdev=1037.02, samples=232
  lat (usec)   : 50=31.09%, 100=58.71%, 250=8.29%, 500=0.74%, 750=0.22%
  lat (usec)   : 1000=0.07%
  lat (msec)   : 2=0.13%, 4=0.19%, 10=0.15%, 20=0.08%, 50=0.01%
  lat (msec)   : 100=0.02%, 250=0.30%, 500=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=1784, avg=15.85, stdev= 7.80
    sync percentiles (nsec):
     |  1.00th=[ 9536],  5.00th=[10176], 10.00th=[10560], 20.00th=[11456],
     | 30.00th=[12224], 40.00th=[13248], 50.00th=[14656], 60.00th=[15680],
     | 70.00th=[17024], 80.00th=[18560], 90.00th=[21888], 95.00th=[25728],
     | 99.00th=[41728], 99.50th=[48896], 99.90th=[65280], 99.95th=[72192],
     | 99.99th=[99840]
  cpu          : usr=0.72%, sys=3.40%, ctx=445983, majf=0, minf=53
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,218808,0,218806 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=14.2MiB/s (14.9MB/s), 14.2MiB/s-14.2MiB/s (14.9MB/s-14.9MB/s), io=855MiB (896MB), run=60044-60044msec

Disk stats (read/write):
  sdb: ios=54/436488, merge=0/16, ticks=12343/113031, in_queue=123396, util=97.26%
s8p6-kingston-4k-sync-write-3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 3 processes

s8p6-kingston-4k-sync-write-3: (groupid=0, jobs=3): err= 0: pid=1470151: Sat Apr 15 13:47:52 2023
  write: IOPS=5309, BW=20.7MiB/s (21.7MB/s)(1245MiB/60002msec); 0 zone resets
    clat (usec): min=42, max=211086, avg=534.01, stdev=7361.29
     lat (usec): min=42, max=211087, avg=534.27, stdev=7361.29
    clat percentiles (usec):
     |  1.00th=[    47],  5.00th=[    48], 10.00th=[    50], 20.00th=[    51],
     | 30.00th=[    53], 40.00th=[    56], 50.00th=[    58], 60.00th=[    61],
     | 70.00th=[    65], 80.00th=[    76], 90.00th=[   122], 95.00th=[   174],
     | 99.00th=[   963], 99.50th=[  6587], 99.90th=[133694], 99.95th=[143655],
     | 99.99th=[160433]
   bw (  KiB/s): min= 2032, max=43248, per=33.61%, avg=7138.30, stdev=3586.86, samples=357
   iops        : min=  508, max=10812, avg=1784.52, stdev=896.72, samples=357
  lat (usec)   : 50=13.79%, 100=73.35%, 250=10.53%, 500=1.02%, 750=0.23%
  lat (usec)   : 1000=0.08%
  lat (msec)   : 2=0.15%, 4=0.20%, 10=0.17%, 20=0.11%, 50=0.03%
  lat (msec)   : 100=0.03%, 250=0.30%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=654, avg=19.12, stdev= 8.88
    sync percentiles (usec):
     |  1.00th=[   11],  5.00th=[   12], 10.00th=[   12], 20.00th=[   13],
     | 30.00th=[   15], 40.00th=[   16], 50.00th=[   17], 60.00th=[   19],
     | 70.00th=[   21], 80.00th=[   24], 90.00th=[   30], 95.00th=[   36],
     | 99.00th=[   52], 99.50th=[   60], 99.90th=[   80], 99.95th=[   89],
     | 99.99th=[  143]
  cpu          : usr=0.75%, sys=3.60%, ctx=651038, majf=0, minf=80
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,318609,0,318606 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=20.7MiB/s (21.7MB/s), 20.7MiB/s-20.7MiB/s (21.7MB/s-21.7MB/s), io=1245MiB (1305MB), run=60002-60002msec

Disk stats (read/write):
  sdb: ios=54/637147, merge=0/44, ticks=12836/169478, in_queue=178028, util=98.88%
s8p6-kingston-4k-sync-write-4: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 4 processes

s8p6-kingston-4k-sync-write-4: (groupid=0, jobs=4): err= 0: pid=1471514: Sat Apr 15 13:48:53 2023
  write: IOPS=12.7k, BW=49.8MiB/s (52.2MB/s)(2985MiB/60001msec); 0 zone resets
    clat (usec): min=37, max=1389.9k, avg=284.98, stdev=5948.90
     lat (usec): min=37, max=1389.9k, avg=285.22, stdev=5948.91
    clat percentiles (usec):
     |  1.00th=[    48],  5.00th=[    49], 10.00th=[    50], 20.00th=[    52],
     | 30.00th=[    54], 40.00th=[    56], 50.00th=[    58], 60.00th=[    61],
     | 70.00th=[    65], 80.00th=[    72], 90.00th=[    95], 95.00th=[   149],
     | 99.00th=[   379], 99.50th=[  1188], 99.90th=[117965], 99.95th=[127402],
     | 99.99th=[141558]
   bw (  KiB/s): min=   72, max=49536, per=24.89%, avg=12679.74, stdev=13914.88, samples=468
   iops        : min=   18, max=12384, avg=3169.90, stdev=3478.75, samples=468
  lat (usec)   : 50=9.46%, 100=81.47%, 250=7.49%, 500=0.74%, 750=0.21%
  lat (usec)   : 1000=0.09%
  lat (msec)   : 2=0.13%, 4=0.12%, 10=0.09%, 20=0.03%, 50=0.01%
  lat (msec)   : 100=0.02%, 250=0.14%, 750=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=917, avg=21.54, stdev= 9.75
    sync percentiles (usec):
     |  1.00th=[   12],  5.00th=[   13], 10.00th=[   14], 20.00th=[   16],
     | 30.00th=[   17], 40.00th=[   18], 50.00th=[   19], 60.00th=[   21],
     | 70.00th=[   23], 80.00th=[   27], 90.00th=[   34], 95.00th=[   40],
     | 99.00th=[   56], 99.50th=[   64], 99.90th=[   84], 99.95th=[   94],
     | 99.99th=[  145]
  cpu          : usr=1.33%, sys=6.51%, ctx=1574673, majf=0, minf=107
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,764193,0,764189 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=49.8MiB/s (52.2MB/s), 49.8MiB/s-49.8MiB/s (52.2MB/s-52.2MB/s), io=2985MiB (3130MB), run=60001-60001msec

Disk stats (read/write):
  sdb: ios=54/1512844, merge=0/157, ticks=13458/217131, in_queue=218408, util=99.23%
s8p6-kingston-4k-sync-write-5: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 5 processes

s8p6-kingston-4k-sync-write-5: (groupid=0, jobs=5): err= 0: pid=1473170: Sat Apr 15 13:49:54 2023
  write: IOPS=52.9k, BW=206MiB/s (216MB/s)(12.1GiB/60001msec); 0 zone resets
    clat (usec): min=38, max=19544, avg=66.26, stdev=93.74
     lat (usec): min=38, max=19544, avg=66.47, stdev=93.74
    clat percentiles (usec):
     |  1.00th=[   45],  5.00th=[   47], 10.00th=[   49], 20.00th=[   52],
     | 30.00th=[   54], 40.00th=[   56], 50.00th=[   58], 60.00th=[   61],
     | 70.00th=[   64], 80.00th=[   69], 90.00th=[   77], 95.00th=[   95],
     | 99.00th=[  165], 99.50th=[  277], 99.90th=[ 1123], 99.95th=[ 1582],
     | 99.99th=[ 2900]
   bw (  KiB/s): min=37508, max=46032, per=20.02%, avg=42316.56, stdev=1471.84, samples=595
   iops        : min= 9377, max=11508, avg=10579.12, stdev=367.97, samples=595
  lat (usec)   : 50=14.91%, 100=80.78%, 250=3.76%, 500=0.18%, 750=0.16%
  lat (usec)   : 1000=0.08%
  lat (msec)   : 2=0.09%, 4=0.03%, 10=0.01%, 20=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=6, max=3164, avg=26.07, stdev=10.91
    sync percentiles (usec):
     |  1.00th=[   12],  5.00th=[   15], 10.00th=[   16], 20.00th=[   18],
     | 30.00th=[   19], 40.00th=[   22], 50.00th=[   24], 60.00th=[   28],
     | 70.00th=[   31], 80.00th=[   35], 90.00th=[   40], 95.00th=[   45],
     | 99.00th=[   58], 99.50th=[   63], 99.90th=[   81], 99.95th=[   89],
     | 99.99th=[  131]
  cpu          : usr=4.01%, sys=17.77%, ctx=6536916, majf=0, minf=141
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3171173,0,3171168 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=206MiB/s (216MB/s), 206MiB/s-206MiB/s (216MB/s-216MB/s), io=12.1GiB (12.0GB), run=60001-60001msec

Disk stats (read/write):
  sdb: ios=102/6329791, merge=0/262, ticks=21/226077, in_queue=159308, util=99.36%
s8p6-kingston-4k-sync-write-6: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 6 processes

s8p6-kingston-4k-sync-write-6: (groupid=0, jobs=6): err= 0: pid=1474531: Sat Apr 15 13:50:55 2023
  write: IOPS=56.9k, BW=222MiB/s (233MB/s)(13.0GiB/60001msec); 0 zone resets
    clat (usec): min=38, max=19770, avg=70.11, stdev=97.30
     lat (usec): min=39, max=19770, avg=70.33, stdev=97.31
    clat percentiles (usec):
     |  1.00th=[   46],  5.00th=[   49], 10.00th=[   51], 20.00th=[   54],
     | 30.00th=[   57], 40.00th=[   59], 50.00th=[   62], 60.00th=[   64],
     | 70.00th=[   68], 80.00th=[   73], 90.00th=[   83], 95.00th=[  102],
     | 99.00th=[  180], 99.50th=[  314], 99.90th=[ 1172], 99.95th=[ 1598],
     | 99.99th=[ 2999]
   bw (  KiB/s): min=31928, max=41776, per=16.66%, avg=37925.74, stdev=1494.07, samples=714
   iops        : min= 7982, max=10444, avg=9481.41, stdev=373.51, samples=714
  lat (usec)   : 50=8.23%, 100=86.53%, 250=4.63%, 500=0.22%, 750=0.16%
  lat (usec)   : 1000=0.09%
  lat (msec)   : 2=0.11%, 4=0.02%, 10=0.01%, 20=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=4575, avg=32.95, stdev=14.58
    sync percentiles (usec):
     |  1.00th=[   14],  5.00th=[   16], 10.00th=[   18], 20.00th=[   21],
     | 30.00th=[   25], 40.00th=[   29], 50.00th=[   32], 60.00th=[   36],
     | 70.00th=[   39], 80.00th=[   43], 90.00th=[   49], 95.00th=[   55],
     | 99.00th=[   70], 99.50th=[   77], 99.90th=[   99], 99.95th=[  117],
     | 99.99th=[  277]
  cpu          : usr=3.77%, sys=17.01%, ctx=7288114, majf=0, minf=167
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3414681,0,3414677 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=222MiB/s (233MB/s), 222MiB/s-222MiB/s (233MB/s-233MB/s), io=13.0GiB (13.0GB), run=60001-60001msec

Disk stats (read/write):
  sdb: ios=51/6814212, merge=0/837, ticks=10/272061, in_queue=181904, util=100.00%
s8p6-kingston-4k-sync-write-7: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 7 processes

s8p6-kingston-4k-sync-write-7: (groupid=0, jobs=7): err= 0: pid=1475984: Sat Apr 15 13:51:56 2023
  write: IOPS=59.8k, BW=234MiB/s (245MB/s)(13.7GiB/60001msec); 0 zone resets
    clat (usec): min=38, max=1232.2k, avg=76.13, stdev=1736.94
     lat (usec): min=39, max=1232.2k, avg=76.37, stdev=1736.94
    clat percentiles (usec):
     |  1.00th=[   47],  5.00th=[   50], 10.00th=[   53], 20.00th=[   57],
     | 30.00th=[   60], 40.00th=[   62], 50.00th=[   65], 60.00th=[   69],
     | 70.00th=[   73], 80.00th=[   78], 90.00th=[   88], 95.00th=[  110],
     | 99.00th=[  182], 99.50th=[  265], 99.90th=[ 1020], 99.95th=[ 1532],
     | 99.99th=[ 3032]
   bw (  KiB/s): min=11368, max=37936, per=14.52%, avg=34757.56, stdev=2509.15, samples=820
   iops        : min= 2842, max= 9484, avg=8689.37, stdev=627.30, samples=820
  lat (usec)   : 50=4.91%, 100=88.95%, 250=5.61%, 500=0.20%, 750=0.15%
  lat (usec)   : 1000=0.07%
  lat (msec)   : 2=0.08%, 4=0.02%, 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 250=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=3533, avg=38.60, stdev=16.21
    sync percentiles (usec):
     |  1.00th=[   15],  5.00th=[   18], 10.00th=[   21], 20.00th=[   28],
     | 30.00th=[   32], 40.00th=[   35], 50.00th=[   38], 60.00th=[   41],
     | 70.00th=[   45], 80.00th=[   49], 90.00th=[   56], 95.00th=[   63],
     | 99.00th=[   80], 99.50th=[   87], 99.90th=[  112], 99.95th=[  133],
     | 99.99th=[  330]
  cpu          : usr=3.38%, sys=16.55%, ctx=7827640, majf=0, minf=212
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3589783,0,3589778 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=234MiB/s (245MB/s), 234MiB/s-234MiB/s (245MB/s-245MB/s), io=13.7GiB (14.7GB), run=60001-60001msec

Disk stats (read/write):
  sdb: ios=102/7163824, merge=0/669, ticks=19/322178, in_queue=211104, util=99.99%
s8p6-kingston-4k-sync-write-8: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 8 processes

s8p6-kingston-4k-sync-write-8: (groupid=0, jobs=8): err= 0: pid=1477674: Sat Apr 15 13:52:57 2023
  write: IOPS=63.0k, BW=250MiB/s (262MB/s)(14.6GiB/60001msec); 0 zone resets
    clat (usec): min=39, max=36981, avg=79.33, stdev=115.60
     lat (usec): min=39, max=36982, avg=79.56, stdev=115.61
    clat percentiles (usec):
     |  1.00th=[   48],  5.00th=[   52], 10.00th=[   56], 20.00th=[   60],
     | 30.00th=[   63], 40.00th=[   67], 50.00th=[   70], 60.00th=[   74],
     | 70.00th=[   78], 80.00th=[   85], 90.00th=[   97], 95.00th=[  120],
     | 99.00th=[  202], 99.50th=[  334], 99.90th=[ 1123], 99.95th=[ 1582],
     | 99.99th=[ 3326]
   bw (  KiB/s): min=24455, max=34880, per=12.50%, avg=31986.29, stdev=1426.41, samples=952
   iops        : min= 6113, max= 8720, avg=7996.53, stdev=356.61, samples=952
  lat (usec)   : 50=2.85%, 100=88.38%, 250=8.10%, 500=0.29%, 750=0.15%
  lat (usec)   : 1000=0.11%
  lat (msec)   : 2=0.10%, 4=0.02%, 10=0.01%, 20=0.01%, 50=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=5285, avg=43.41, stdev=18.35
    sync percentiles (usec):
     |  1.00th=[   16],  5.00th=[   20], 10.00th=[   26], 20.00th=[   32],
     | 30.00th=[   36], 40.00th=[   39], 50.00th=[   42], 60.00th=[   45],
     | 70.00th=[   49], 80.00th=[   55], 90.00th=[   63], 95.00th=[   72],
     | 99.00th=[   92], 99.50th=[  101], 99.90th=[  130], 99.95th=[  161],
     | 99.99th=[  383]
  cpu          : usr=3.07%, sys=16.91%, ctx=8494279, majf=0, minf=259
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3839838,0,3839834 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=250MiB/s (262MB/s), 250MiB/s-250MiB/s (262MB/s-262MB/s), io=14.6GiB (15.7GB), run=60001-60001msec

Disk stats (read/write):
  sdb: ios=51/7663344, merge=0/620, ticks=10/371247, in_queue=234736, util=100.00%
s8p6-kingston-4k-sync-write-9: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 9 processes

s8p6-kingston-4k-sync-write-9: (groupid=0, jobs=9): err= 0: pid=1478990: Sat Apr 15 13:53:57 2023
  write: IOPS=67.5k, BW=264MiB/s (276MB/s)(15.4GiB/60001msec); 0 zone resets
    clat (usec): min=39, max=20346, avg=83.79, stdev=107.42
     lat (usec): min=40, max=20346, avg=84.03, stdev=107.43
    clat percentiles (usec):
     |  1.00th=[   50],  5.00th=[   56], 10.00th=[   59], 20.00th=[   64],
     | 30.00th=[   68], 40.00th=[   71], 50.00th=[   75], 60.00th=[   78],
     | 70.00th=[   83], 80.00th=[   90], 90.00th=[  104], 95.00th=[  127],
     | 99.00th=[  208], 99.50th=[  306], 99.90th=[ 1139], 99.95th=[ 1549],
     | 99.99th=[ 2999]
   bw (  KiB/s): min=26024, max=33328, per=11.11%, avg=29994.46, stdev=1003.80, samples=1071
   iops        : min= 6506, max= 8334, avg=7498.59, stdev=250.95, samples=1071
  lat (usec)   : 50=1.34%, 100=86.90%, 250=11.10%, 500=0.28%, 750=0.13%
  lat (usec)   : 1000=0.10%
  lat (msec)   : 2=0.10%, 4=0.02%, 10=0.01%, 20=0.01%, 50=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=7255, avg=47.27, stdev=19.70
    sync percentiles (usec):
     |  1.00th=[   17],  5.00th=[   24], 10.00th=[   30], 20.00th=[   35],
     | 30.00th=[   39], 40.00th=[   42], 50.00th=[   45], 60.00th=[   48],
     | 70.00th=[   53], 80.00th=[   59], 90.00th=[   69], 95.00th=[   80],
     | 99.00th=[  103], 99.50th=[  115], 99.90th=[  151], 99.95th=[  182],
     | 99.99th=[  437]
  cpu          : usr=2.95%, sys=16.90%, ctx=9012991, majf=0, minf=291
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,4048618,0,4048611 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=264MiB/s (276MB/s), 264MiB/s-264MiB/s (276MB/s-276MB/s), io=15.4GiB (16.6GB), run=60001-60001msec

Disk stats (read/write):
  sdb: ios=102/8078696, merge=0/1713, ticks=21/420687, in_queue=261196, util=100.00%
s8p6-kingston-4k-sync-write-10: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 10 processes

s8p6-kingston-4k-sync-write-10: (groupid=0, jobs=10): err= 0: pid=1480386: Sat Apr 15 13:54:59 2023
  write: IOPS=51.6k, BW=202MiB/s (211MB/s)(11.8GiB/60078msec); 0 zone resets
    clat (usec): min=41, max=263703, avg=142.26, stdev=2178.65
     lat (usec): min=41, max=263703, avg=142.49, stdev=2178.65
    clat percentiles (usec):
     |  1.00th=[    53],  5.00th=[    61], 10.00th=[    65], 20.00th=[    71],
     | 30.00th=[    75], 40.00th=[    79], 50.00th=[    83], 60.00th=[    87],
     | 70.00th=[    93], 80.00th=[   100], 90.00th=[   118], 95.00th=[   157],
     | 99.00th=[   322], 99.50th=[   725], 99.90th=[  3949], 99.95th=[ 17171],
     | 99.99th=[123208]
   bw (  KiB/s): min= 1888, max=30760, per=10.01%, avg=20662.46, stdev=10034.61, samples=1200
   iops        : min=  472, max= 7690, avg=5165.59, stdev=2508.66, samples=1200
  lat (usec)   : 50=0.35%, 100=79.36%, 250=18.65%, 500=0.98%, 750=0.19%
  lat (usec)   : 1000=0.14%
  lat (msec)   : 2=0.16%, 4=0.07%, 10=0.03%, 20=0.02%, 50=0.01%
  lat (msec)   : 100=0.01%, 250=0.02%, 500=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=2998, avg=49.03, stdev=22.68
    sync percentiles (usec):
     |  1.00th=[   18],  5.00th=[   25], 10.00th=[   30], 20.00th=[   35],
     | 30.00th=[   39], 40.00th=[   42], 50.00th=[   45], 60.00th=[   49],
     | 70.00th=[   54], 80.00th=[   61], 90.00th=[   74], 95.00th=[   87],
     | 99.00th=[  118], 99.50th=[  133], 99.90th=[  182], 99.95th=[  233],
     | 99.99th=[  611]
  cpu          : usr=2.25%, sys=12.07%, ctx=6893800, majf=0, minf=321
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3099720,0,3099710 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=202MiB/s (211MB/s), 202MiB/s-202MiB/s (211MB/s-211MB/s), io=11.8GiB (12.7GB), run=60078-60078msec

Disk stats (read/write):
  sdb: ios=102/6192205, merge=0/1935, ticks=19/500453, in_queue=372768, util=99.52%
s8p6-kingston-4k-sync-write-11: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 11 processes

s8p6-kingston-4k-sync-write-11: (groupid=0, jobs=11): err= 0: pid=1481881: Sat Apr 15 13:56:02 2023
  write: IOPS=24.0k, BW=93.8MiB/s (98.3MB/s)(5626MiB/60011msec); 0 zone resets
    clat (usec): min=43, max=1151.4k, avg=392.55, stdev=5377.74
     lat (usec): min=44, max=1151.4k, avg=392.82, stdev=5377.75
    clat percentiles (usec):
     |  1.00th=[    52],  5.00th=[    58], 10.00th=[    67], 20.00th=[    80],
     | 30.00th=[    88], 40.00th=[    93], 50.00th=[    99], 60.00th=[   105],
     | 70.00th=[   114], 80.00th=[   128], 90.00th=[   204], 95.00th=[   265],
     | 99.00th=[  1156], 99.50th=[  4883], 99.90th=[ 81265], 99.95th=[ 95945],
     | 99.99th=[116917]
   bw (  KiB/s): min=  175, max=23744, per=9.17%, avg=8801.24, stdev=2732.29, samples=1309
   iops        : min=   43, max= 5936, avg=2200.27, stdev=683.08, samples=1309
  lat (usec)   : 50=0.15%, 100=52.16%, 250=41.67%, 500=4.28%, 750=0.49%
  lat (usec)   : 1000=0.18%
  lat (msec)   : 2=0.23%, 4=0.22%, 10=0.22%, 20=0.06%, 50=0.05%
  lat (msec)   : 100=0.25%, 250=0.04%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=2802, avg=63.13, stdev=39.02
    sync percentiles (usec):
     |  1.00th=[   18],  5.00th=[   25], 10.00th=[   32], 20.00th=[   38],
     | 30.00th=[   42], 40.00th=[   47], 50.00th=[   51], 60.00th=[   58],
     | 70.00th=[   67], 80.00th=[   84], 90.00th=[  126], 95.00th=[  141],
     | 99.00th=[  172], 99.50th=[  188], 99.90th=[  269], 99.95th=[  351],
     | 99.99th=[  758]
  cpu          : usr=0.94%, sys=6.34%, ctx=3372053, majf=0, minf=319
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,1440322,0,1440311 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=93.8MiB/s (98.3MB/s), 93.8MiB/s-93.8MiB/s (98.3MB/s-98.3MB/s), io=5626MiB (5900MB), run=60011-60011msec

Disk stats (read/write):
  sdb: ios=51/2873219, merge=0/1662, ticks=8674/584844, in_queue=539088, util=99.98%
s8p6-kingston-4k-sync-write-12: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 12 processes

s8p6-kingston-4k-sync-write-12: (groupid=0, jobs=12): err= 0: pid=1483477: Sat Apr 15 13:57:04 2023
  write: IOPS=22.1k, BW=86.3MiB/s (90.5MB/s)(5180MiB/60002msec); 0 zone resets
    clat (usec): min=43, max=1800.9k, avg=468.92, stdev=7617.73
     lat (usec): min=43, max=1800.9k, avg=469.20, stdev=7617.73
    clat percentiles (usec):
     |  1.00th=[    52],  5.00th=[    57], 10.00th=[    64], 20.00th=[    81],
     | 30.00th=[    92], 40.00th=[    99], 50.00th=[   106], 60.00th=[   114],
     | 70.00th=[   123], 80.00th=[   139], 90.00th=[   227], 95.00th=[   281],
     | 99.00th=[  1418], 99.50th=[  5014], 99.90th=[103285], 99.95th=[110625],
     | 99.99th=[128451]
   bw (  KiB/s): min= 4472, max=22976, per=8.56%, avg=7567.40, stdev=2803.35, samples=1394
   iops        : min= 1118, max= 5744, avg=1891.81, stdev=700.85, samples=1394
  lat (usec)   : 50=0.14%, 100=41.01%, 250=51.28%, 500=5.69%, 750=0.58%
  lat (usec)   : 1000=0.17%
  lat (msec)   : 2=0.25%, 4=0.25%, 10=0.26%, 20=0.05%, 50=0.02%
  lat (msec)   : 100=0.20%, 250=0.11%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=8, max=4741, avg=71.19, stdev=45.40
    sync percentiles (usec):
     |  1.00th=[   18],  5.00th=[   28], 10.00th=[   34], 20.00th=[   40],
     | 30.00th=[   45], 40.00th=[   50], 50.00th=[   56], 60.00th=[   63],
     | 70.00th=[   76], 80.00th=[  102], 90.00th=[  145], 95.00th=[  157],
     | 99.00th=[  186], 99.50th=[  202], 99.90th=[  273], 99.95th=[  375],
     | 99.99th=[  922]
  cpu          : usr=0.81%, sys=5.62%, ctx=3153512, majf=0, minf=371
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,1326114,0,1326109 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=86.3MiB/s (90.5MB/s), 86.3MiB/s-86.3MiB/s (90.5MB/s-90.5MB/s), io=5180MiB (5432MB), run=60002-60002msec

Disk stats (read/write):
  sdb: ios=51/2643716, merge=0/1663, ticks=10756/641921, in_queue=600976, util=100.00%
s8p6-kingston-4k-sync-write-13: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 13 processes

s8p6-kingston-4k-sync-write-13: (groupid=0, jobs=13): err= 0: pid=1484905: Sat Apr 15 13:58:05 2023
  write: IOPS=47.3k, BW=185MiB/s (194MB/s)(10.8GiB/60001msec); 0 zone resets
    clat (usec): min=44, max=709512, avg=202.91, stdev=3378.14
     lat (usec): min=44, max=709512, avg=203.15, stdev=3378.15
    clat percentiles (usec):
     |  1.00th=[    53],  5.00th=[    62], 10.00th=[    73], 20.00th=[    85],
     | 30.00th=[    92], 40.00th=[    98], 50.00th=[   103], 60.00th=[   110],
     | 70.00th=[   118], 80.00th=[   129], 90.00th=[   159], 95.00th=[   217],
     | 99.00th=[   490], 99.50th=[   922], 99.90th=[  8455], 99.95th=[ 85459],
     | 99.99th=[110625]
   bw (  KiB/s): min=  728, max=24864, per=7.65%, avg=14469.80, stdev=7519.22, samples=1547
   iops        : min=  182, max= 6216, avg=3617.42, stdev=1879.81, samples=1547
  lat (usec)   : 50=0.09%, 100=44.75%, 250=51.76%, 500=2.42%, 750=0.28%
  lat (usec)   : 1000=0.24%
  lat (msec)   : 2=0.20%, 4=0.10%, 10=0.06%, 20=0.02%, 50=0.01%
  lat (msec)   : 100=0.05%, 250=0.02%, 750=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=2982, avg=69.55, stdev=41.59
    sync percentiles (usec):
     |  1.00th=[   20],  5.00th=[   33], 10.00th=[   37], 20.00th=[   43],
     | 30.00th=[   47], 40.00th=[   51], 50.00th=[   57], 60.00th=[   63],
     | 70.00th=[   73], 80.00th=[   89], 90.00th=[  130], 95.00th=[  165],
     | 99.00th=[  194], 99.50th=[  208], 99.90th=[  265], 99.95th=[  314],
     | 99.99th=[  791]
  cpu          : usr=1.51%, sys=12.19%, ctx=6632216, majf=0, minf=401
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,2835837,0,2835829 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=185MiB/s (194MB/s), 185MiB/s-185MiB/s (194MB/s-194MB/s), io=10.8GiB (11.6GB), run=60001-60001msec

Disk stats (read/write):
  sdb: ios=51/5665641, merge=0/3960, ticks=11258/639718, in_queue=510988, util=100.00%
s8p6-kingston-4k-sync-write-14: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 14 processes

s8p6-kingston-4k-sync-write-14: (groupid=0, jobs=14): err= 0: pid=1486299: Sat Apr 15 13:59:06 2023
  write: IOPS=73.4k, BW=287MiB/s (301MB/s)(16.8GiB/60001msec); 0 zone resets
    clat (usec): min=38, max=7145, avg=122.71, stdev=79.89
     lat (usec): min=38, max=7145, avg=122.93, stdev=79.90
    clat percentiles (usec):
     |  1.00th=[   64],  5.00th=[   77], 10.00th=[   85], 20.00th=[   93],
     | 30.00th=[  100], 40.00th=[  105], 50.00th=[  112], 60.00th=[  117],
     | 70.00th=[  125], 80.00th=[  135], 90.00th=[  159], 95.00th=[  192],
     | 99.00th=[  330], 99.50th=[  594], 99.90th=[ 1205], 99.95th=[ 1418],
     | 99.99th=[ 1926]
   bw (  KiB/s): min=18176, max=23352, per=7.14%, avg=20978.32, stdev=761.82, samples=1667
   iops        : min= 4544, max= 5838, avg=5244.56, stdev=190.47, samples=1667
  lat (usec)   : 50=0.07%, 100=31.00%, 250=66.91%, 500=1.46%, 750=0.15%
  lat (usec)   : 1000=0.26%
  lat (msec)   : 2=0.16%, 4=0.01%, 10=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=6, max=2711, avg=65.49, stdev=33.71
    sync percentiles (usec):
     |  1.00th=[   21],  5.00th=[   33], 10.00th=[   38], 20.00th=[   43],
     | 30.00th=[   47], 40.00th=[   52], 50.00th=[   57], 60.00th=[   64],
     | 70.00th=[   73], 80.00th=[   85], 90.00th=[  108], 95.00th=[  128],
     | 99.00th=[  174], 99.50th=[  194], 99.90th=[  249], 99.95th=[  302],
     | 99.99th=[  701]
  cpu          : usr=2.12%, sys=17.90%, ctx=10223642, majf=0, minf=417
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,4405859,0,4405847 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=287MiB/s (301MB/s), 287MiB/s-287MiB/s (301MB/s-301MB/s), io=16.8GiB (18.0GB), run=60001-60001msec

Disk stats (read/write):
  sdb: ios=51/8790249, merge=0/2813, ticks=10/680268, in_queue=417100, util=98.72%
s8p6-kingston-4k-sync-write-15: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 15 processes

s8p6-kingston-4k-sync-write-15: (groupid=0, jobs=15): err= 0: pid=1487948: Sat Apr 15 14:00:07 2023
  write: IOPS=69.7k, BW=272MiB/s (285MB/s)(15.9GiB/60001msec); 0 zone resets
    clat (usec): min=40, max=17553, avg=138.57, stdev=111.02
     lat (usec): min=40, max=17553, avg=138.81, stdev=111.03
    clat percentiles (usec):
     |  1.00th=[   67],  5.00th=[   81], 10.00th=[   90], 20.00th=[  100],
     | 30.00th=[  108], 40.00th=[  115], 50.00th=[  122], 60.00th=[  129],
     | 70.00th=[  139], 80.00th=[  155], 90.00th=[  188], 95.00th=[  229],
     | 99.00th=[  441], 99.50th=[  832], 99.90th=[ 1450], 99.95th=[ 1762],
     | 99.99th=[ 2999]
   bw (  KiB/s): min=13736, max=22264, per=6.67%, avg=18587.64, stdev=1182.21, samples=1788
   iops        : min= 3434, max= 5566, avg=4646.88, stdev=295.55, samples=1788
  lat (usec)   : 50=0.07%, 100=20.23%, 250=76.10%, 500=2.71%, 750=0.25%
  lat (usec)   : 1000=0.35%
  lat (msec)   : 2=0.25%, 4=0.03%, 10=0.01%, 20=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=4674, avg=74.41, stdev=41.19
    sync percentiles (usec):
     |  1.00th=[   21],  5.00th=[   35], 10.00th=[   39], 20.00th=[   46],
     | 30.00th=[   51], 40.00th=[   57], 50.00th=[   63], 60.00th=[   73],
     | 70.00th=[   84], 80.00th=[  100], 90.00th=[  127], 95.00th=[  151],
     | 99.00th=[  206], 99.50th=[  229], 99.90th=[  285], 99.95th=[  326],
     | 99.99th=[  963]
  cpu          : usr=1.76%, sys=18.82%, ctx=9821389, majf=0, minf=459
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,4179439,0,4179429 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=272MiB/s (285MB/s), 272MiB/s-272MiB/s (285MB/s-285MB/s), io=15.9GiB (17.1GB), run=60001-60001msec

Disk stats (read/write):
  sdb: ios=102/8341482, merge=0/2638, ticks=19/733146, in_queue=440784, util=97.61%
s8p6-kingston-4k-sync-write-16: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
...
fio-3.12
Starting 16 processes

s8p6-kingston-4k-sync-write-16: (groupid=0, jobs=16): err= 0: pid=1489331: Sat Apr 15 14:01:08 2023
  write: IOPS=65.9k, BW=257MiB/s (270MB/s)(15.1GiB/60001msec); 0 zone resets
    clat (usec): min=37, max=15446, avg=159.49, stdev=144.99
     lat (usec): min=38, max=15446, avg=159.74, stdev=145.00
    clat percentiles (usec):
     |  1.00th=[   68],  5.00th=[   85], 10.00th=[   95], 20.00th=[  108],
     | 30.00th=[  117], 40.00th=[  124], 50.00th=[  133], 60.00th=[  143],
     | 70.00th=[  155], 80.00th=[  176], 90.00th=[  221], 95.00th=[  281],
     | 99.00th=[  832], 99.50th=[ 1045], 99.90th=[ 1795], 99.95th=[ 2212],
     | 99.99th=[ 3621]
   bw (  KiB/s): min=12888, max=20136, per=6.25%, avg=16463.73, stdev=1146.39, samples=1906
   iops        : min= 3222, max= 5034, avg=4115.92, stdev=286.60, samples=1906
  lat (usec)   : 50=0.06%, 100=13.95%, 250=78.96%, 500=5.22%, 750=0.54%
  lat (usec)   : 1000=0.71%
  lat (msec)   : 2=0.49%, 4=0.06%, 10=0.01%, 20=0.01%
  fsync/fdatasync/sync_file_range:
    sync (usec): min=7, max=5151, avg=80.88, stdev=47.81
    sync percentiles (usec):
     |  1.00th=[   21],  5.00th=[   35], 10.00th=[   40], 20.00th=[   47],
     | 30.00th=[   53], 40.00th=[   60], 50.00th=[   69], 60.00th=[   79],
     | 70.00th=[   92], 80.00th=[  112], 90.00th=[  141], 95.00th=[  169],
     | 99.00th=[  229], 99.50th=[  253], 99.90th=[  322], 99.95th=[  383],
     | 99.99th=[  979]
  cpu          : usr=1.60%, sys=18.66%, ctx=9378803, majf=0, minf=486
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3953383,0,3953370 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=257MiB/s (270MB/s), 257MiB/s-257MiB/s (270MB/s-270MB/s), io=15.1GiB (16.2GB), run=60001-60001msec

Disk stats (read/write):
  sdb: ios=102/7884730, merge=0/3908, ticks=20/790666, in_queue=483440, util=96.93%