randrw: (g=0): rw=randrw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
...
randrw: (g=0): rw=randrw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
Starting 8 processes

randrw: (groupid=0, jobs=1): err= 0: pid=7155
  read : io=384MB, bw=62,934KB/s, iops=15,733, runt=  6243msec
    slat (usec): min=4, max=11,681, avg=167.00, stdev=448.35
    clat (usec): min=3, max=19,552, avg=2217.48, stdev=1367.27
    bw (KB/s) : min=    0, max=70143, per=1.27%, avg=6362.85, stdev=19236.22
  write: io=128MB, bw=21,046KB/s, iops=5,261, runt=  6243msec
    slat (usec): min=4, max=11,678, avg=164.73, stdev=442.99
    clat (usec): min=11, max=19,552, avg=2229.92, stdev=1367.33
    bw (KB/s) : min=    0, max=24448, per=2.03%, avg=3402.15, stdev=7878.23
  cpu          : usr=0.35%, sys=18.66%, ctx=6023, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=98224/32848, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.02%, 100=0.04%
     lat (usec): 250=0.42%, 500=2.84%, 750=3.37%, 1000=6.66%
     lat (msec): 2=37.59%, 4=39.83%, 10=8.97%, 20=0.24%
randrw: (groupid=0, jobs=1): err= 0: pid=7156
  read : io=385MB, bw=62,926KB/s, iops=15,731, runt=  6260msec
    slat (usec): min=4, max=16,646, avg=166.27, stdev=453.56
    clat (usec): min=3, max=32,886, avg=2226.99, stdev=1434.22
    bw (KB/s) : min=    0, max=69432, per=0.96%, avg=4817.50, stdev=16888.25
  write: io=127MB, bw=20,826KB/s, iops=5,206, runt=  6260msec
    slat (usec): min=4, max=10,487, avg=170.66, stdev=467.69
    clat (usec): min=23, max=32,886, avg=2227.84, stdev=1460.15
    bw (KB/s) : min=    0, max=22411, per=1.93%, avg=3227.51, stdev=7631.44
  cpu          : usr=1.10%, sys=17.53%, ctx=6050, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=98479/32593, short=0/0
     lat (usec): 4=0.01%, 20=0.01%, 50=0.01%, 100=0.02%, 250=0.39%
     lat (usec): 500=2.78%, 750=3.53%, 1000=6.63%
     lat (msec): 2=36.59%, 4=41.12%, 10=8.62%, 20=0.28%, 50=0.03%
randrw: (groupid=0, jobs=1): err= 0: pid=7158
  read : io=383MB, bw=63,262KB/s, iops=15,815, runt=  6197msec
    slat (usec): min=4, max=15,504, avg=164.81, stdev=444.28
    clat (usec): min=4, max=16,908, avg=2195.10, stdev=1334.18
    bw (KB/s) : min=    0, max=69306, per=0.98%, avg=4912.46, stdev=17117.32
  write: io=129MB, bw=21,342KB/s, iops=5,335, runt=  6197msec
    slat (usec): min=4, max=15,504, avg=162.70, stdev=447.56
    clat (usec): min=8, max=16,908, avg=2199.40, stdev=1360.04
    bw (KB/s) : min=    0, max=22996, per=2.09%, avg=3492.01, stdev=8008.36
  cpu          : usr=1.03%, sys=17.72%, ctx=6039, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=98008/33064, short=0/0
     lat (usec): 10=0.01%, 20=0.01%, 50=0.01%, 100=0.04%, 250=0.51%
     lat (usec): 500=2.81%, 750=3.79%, 1000=6.46%
     lat (msec): 2=38.05%, 4=39.50%, 10=8.63%, 20=0.19%
randrw: (groupid=0, jobs=1): err= 0: pid=7159
  read : io=385MB, bw=63,135KB/s, iops=15,783, runt=  6240msec
    slat (usec): min=4, max=13,685, avg=164.46, stdev=440.87
    clat (usec): min=3, max=23,286, avg=2209.34, stdev=1366.29
    bw (KB/s) : min=    0, max=66936, per=1.80%, avg=9013.58, stdev=22400.18
  write: io=127MB, bw=20,886KB/s, iops=5,221, runt=  6240msec
    slat (usec): min=4, max=13,685, avg=170.27, stdev=458.26
    clat (usec): min=3, max=22,950, avg=2205.22, stdev=1358.38
    bw (KB/s) : min=    0, max=22568, per=2.30%, avg=3842.18, stdev=8236.50
  cpu          : usr=0.74%, sys=17.57%, ctx=6029, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=98490/32582, short=0/0
     lat (usec): 4=0.01%, 20=0.01%, 50=0.01%, 100=0.03%, 250=0.35%
     lat (usec): 500=2.55%, 750=3.49%, 1000=6.43%
     lat (msec): 2=38.10%, 4=39.86%, 10=9.01%, 20=0.12%, 50=0.04%
randrw: (groupid=0, jobs=1): err= 0: pid=7161
  read : io=384MB, bw=62,776KB/s, iops=15,694, runt=  6266msec
    slat (usec): min=4, max=17,937, avg=164.90, stdev=456.16
    clat (usec): min=3, max=21,231, avg=2229.46, stdev=1450.21
    bw (KB/s) : min=    0, max=68712, per=1.15%, avg=5749.50, stdev=18303.03
  write: io=128MB, bw=20,896KB/s, iops=5,223, runt=  6266msec
    slat (usec): min=4, max=9,211, avg=167.28, stdev=446.50
    clat (usec): min=4, max=21,191, avg=2236.08, stdev=1467.63
    bw (KB/s) : min=    0, max=22952, per=2.19%, avg=3658.33, stdev=8053.15
  cpu          : usr=1.40%, sys=17.57%, ctx=6073, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=98339/32733, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.47%, 500=2.74%, 750=3.48%, 1000=6.63%
     lat (msec): 2=37.63%, 4=39.57%, 10=9.06%, 20=0.35%, 50=0.02%
randrw: (groupid=0, jobs=1): err= 0: pid=7162
  read : io=384MB, bw=63,143KB/s, iops=15,785, runt=  6234msec
    slat (usec): min=4, max=15,722, avg=165.04, stdev=449.99
    clat (usec): min=3, max=23,118, avg=2207.15, stdev=1373.05
    bw (KB/s) : min=    0, max=68984, per=0.77%, avg=3881.52, stdev=15316.72
  write: io=128MB, bw=20,958KB/s, iops=5,239, runt=  6234msec
    slat (usec): min=4, max=15,722, avg=164.39, stdev=456.09
    clat (usec): min=3, max=23,104, avg=2214.88, stdev=1384.18
    bw (KB/s) : min=    0, max=23712, per=2.14%, avg=3572.75, stdev=8004.58
  cpu          : usr=0.00%, sys=18.53%, ctx=6103, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=98409/32663, short=0/0
     lat (usec): 4=0.01%, 20=0.01%, 50=0.01%, 100=0.02%, 250=0.52%
     lat (usec): 500=2.81%, 750=3.54%, 1000=6.39%
     lat (msec): 2=37.81%, 4=39.58%, 10=9.07%, 20=0.22%, 50=0.02%
randrw: (groupid=0, jobs=1): err= 0: pid=7163
  read : io=384MB, bw=65,080KB/s, iops=16,269, runt=  6042msec
    slat (usec): min=4, max=15,459, avg=158.67, stdev=435.37
    clat (usec): min=19, max=17,897, avg=2140.08, stdev=1286.23
    bw (KB/s) : min=    0, max=70986, per=0.87%, avg=4344.29, stdev=16333.50
  write: io=128MB, bw=21,694KB/s, iops=5,423, runt=  6042msec
    slat (usec): min=4, max=15,458, avg=158.76, stdev=431.68
    clat (usec): min=25, max=17,850, avg=2146.92, stdev=1303.91
    bw (KB/s) : min=    0, max=24440, per=2.00%, avg=3340.78, stdev=7905.87
  cpu          : usr=0.00%, sys=16.74%, ctx=6031, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=98303/32769, short=0/0
     lat (usec): 20=0.01%, 50=0.01%, 100=0.02%, 250=0.42%, 500=2.66%
     lat (usec): 750=3.83%, 1000=6.97%
     lat (msec): 2=38.80%, 4=38.74%, 10=8.42%, 20=0.13%
randrw: (groupid=0, jobs=1): err= 0: pid=7164
  read : io=384MB, bw=62,752KB/s, iops=15,687, runt=  6267msec
    slat (usec): min=4, max=9,502, avg=166.92, stdev=452.29
    clat (usec): min=4, max=19,765, avg=2208.51, stdev=1382.61
    bw (KB/s) : min=    0, max=68439, per=1.14%, avg=5740.39, stdev=18294.01
  write: io=128MB, bw=20,907KB/s, iops=5,226, runt=  6267msec
    slat (usec): min=4, max=9,502, avg=164.06, stdev=452.04
    clat (usec): min=3, max=19,765, avg=2211.70, stdev=1381.06
    bw (KB/s) : min=    0, max=22072, per=2.22%, avg=3714.18, stdev=8116.61
  cpu          : usr=0.34%, sys=18.77%, ctx=6035, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=98316/32756, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.40%, 500=2.43%, 750=3.51%, 1000=6.98%
     lat (msec): 2=38.68%, 4=38.79%, 10=8.85%, 20=0.30%

Run status group 0 (all jobs):
   READ: io=3,073MB, aggrb=490MB/s, minb=64,257KB/s, maxb=66,641KB/s, mint=6042msec, maxt=6267msec
  WRITE: io=1,023MB, aggrb=163MB/s, minb=21,326KB/s, maxb=22,214KB/s, mint=6042msec, maxt=6267msec

Disk stats (read/write):
  sdb: ios=784970/261501, merge=117/13, ticks=662700/221522, in_queue=884812, util=98.44%