randrw: (g=0): rw=randrw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
...
randrw: (g=0): rw=randrw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
Starting 8 processes

randrw: (groupid=0, jobs=1): err= 0: pid=7215
  read : io=128MB, bw=19,811KB/s, iops=4,952, runt=  6624msec
    slat (usec): min=4, max=14,525, avg=181.82, stdev=463.25
    clat (usec): min=12, max=20,029, avg=2386.98, stdev=1442.11
    bw (KB/s) : min=    0, max=23152, per=2.02%, avg=3188.60, stdev=7446.08
  write: io=384MB, bw=59,339KB/s, iops=14,834, runt=  6624msec
    slat (usec): min=4, max=14,525, avg=180.59, stdev=457.75
    clat (usec): min=3, max=20,029, avg=2379.34, stdev=1440.41
    bw (KB/s) : min=    0, max=69792, per=0.98%, avg=4636.81, stdev=16212.49
  cpu          : usr=0.32%, sys=21.41%, ctx=6125, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=32807/98265, short=0/0
     lat (usec): 4=0.01%, 20=0.01%, 50=0.02%, 100=0.03%, 250=0.33%
     lat (usec): 500=1.94%, 750=2.67%, 1000=5.30%
     lat (msec): 2=35.56%, 4=42.91%, 10=11.03%, 20=0.19%, 50=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=7216
  read : io=128MB, bw=19,780KB/s, iops=4,944, runt=  6605msec
    slat (usec): min=4, max=9,005, avg=179.88, stdev=439.38
    clat (usec): min=4, max=14,494, avg=2389.54, stdev=1406.06
    bw (KB/s) : min=    0, max=22056, per=1.51%, avg=2386.43, stdev=6538.84
  write: io=384MB, bw=59,598KB/s, iops=14,899, runt=  6605msec
    slat (usec): min=4, max=10,318, avg=181.25, stdev=449.03
    clat (usec): min=3, max=14,494, avg=2380.70, stdev=1413.22
    bw (KB/s) : min=    0, max=67169, per=0.90%, avg=4273.31, stdev=15608.83
  cpu          : usr=0.00%, sys=21.94%, ctx=6125, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=32661/98411, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.02%, 100=0.02%
     lat (usec): 250=0.28%, 500=1.91%, 750=3.12%, 1000=6.06%
     lat (msec): 2=34.23%, 4=42.57%, 10=11.69%, 20=0.09%
randrw: (groupid=0, jobs=1): err= 0: pid=7218
  read : io=128MB, bw=20,424KB/s, iops=5,106, runt=  6394msec
    slat (usec): min=4, max=13,178, avg=174.12, stdev=471.54
    clat (usec): min=27, max=22,506, avg=2305.59, stdev=1434.24
    bw (KB/s) : min=    0, max=24391, per=3.16%, avg=4995.04, stdev=9037.65
  write: io=384MB, bw=61,573KB/s, iops=15,393, runt=  6394msec
    slat (usec): min=4, max=13,177, avg=173.35, stdev=440.90
    clat (usec): min=3, max=22,506, avg=2301.23, stdev=1427.33
    bw (KB/s) : min=    0, max=74483, per=1.14%, avg=5410.33, stdev=17718.59
  cpu          : usr=0.41%, sys=18.71%, ctx=6157, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=32648/98424, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.02%, 100=0.01%
     lat (usec): 250=0.31%, 500=1.94%, 750=2.99%, 1000=5.83%
     lat (msec): 2=37.17%, 4=41.34%, 10=10.15%, 20=0.21%, 50=0.02%
randrw: (groupid=0, jobs=1): err= 0: pid=7219
  read : io=128MB, bw=20,380KB/s, iops=5,095, runt=  6421msec
    slat (usec): min=4, max=10,035, avg=176.28, stdev=440.97
    clat (usec): min=3, max=13,759, avg=2307.50, stdev=1352.78
    bw (KB/s) : min=    0, max=22920, per=2.48%, avg=3923.44, stdev=8180.44
  write: io=384MB, bw=61,272KB/s, iops=15,318, runt=  6421msec
    slat (usec): min=4, max=10,034, avg=174.73, stdev=443.56
    clat (usec): min=3, max=13,759, avg=2312.77, stdev=1364.91
    bw (KB/s) : min=    0, max=68536, per=0.78%, avg=3680.16, stdev=14716.61
  cpu          : usr=0.79%, sys=18.27%, ctx=6140, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=32715/98357, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.02%
     lat (usec): 250=0.31%, 500=1.96%, 750=2.86%, 1000=5.61%
     lat (msec): 2=36.58%, 4=42.33%, 10=10.15%, 20=0.16%
randrw: (groupid=0, jobs=1): err= 0: pid=7220
  read : io=129MB, bw=19,864KB/s, iops=4,966, runt=  6635msec
    slat (usec): min=4, max=23,513, avg=179.83, stdev=462.13
    clat (usec): min=24, max=27,037, avg=2360.42, stdev=1496.60
    bw (KB/s) : min=    0, max=23457, per=2.52%, avg=3979.62, stdev=8156.09
  write: io=383MB, bw=59,154KB/s, iops=14,788, runt=  6635msec
    slat (usec): min=4, max=23,513, avg=182.37, stdev=477.27
    clat (usec): min=4, max=27,037, avg=2364.14, stdev=1497.99
    bw (KB/s) : min=    0, max=68279, per=1.07%, avg=5064.11, stdev=16852.94
  cpu          : usr=0.81%, sys=20.43%, ctx=6140, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=32950/98122, short=0/0
     lat (usec): 10=0.01%, 20=0.01%, 50=0.03%, 100=0.02%, 250=0.30%
     lat (usec): 500=2.24%, 750=2.83%, 1000=5.31%
     lat (msec): 2=35.94%, 4=42.00%, 10=11.09%, 20=0.22%, 50=0.02%
randrw: (groupid=0, jobs=1): err= 0: pid=7221
  read : io=128MB, bw=19,720KB/s, iops=4,930, runt=  6639msec
    slat (usec): min=4, max=12,265, avg=182.40, stdev=454.67
    clat (usec): min=19, max=20,011, avg=2350.63, stdev=1455.94
    bw (KB/s) : min=    0, max=22842, per=2.00%, avg=3165.91, stdev=7376.05
  write: io=384MB, bw=59,250KB/s, iops=14,812, runt=  6639msec
    slat (usec): min=4, max=12,266, avg=183.31, stdev=463.27
    clat (usec): min=3, max=20,048, avg=2362.69, stdev=1469.85
    bw (KB/s) : min=    0, max=68303, per=0.94%, avg=4434.98, stdev=15835.65
  cpu          : usr=1.48%, sys=19.76%, ctx=6129, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=32731/98341, short=0/0
     lat (usec): 4=0.01%, 20=0.01%, 50=0.01%, 100=0.01%, 250=0.32%
     lat (usec): 500=2.10%, 750=2.84%, 1000=6.15%
     lat (msec): 2=35.43%, 4=41.82%, 10=11.10%, 20=0.21%, 50=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=7222
  read : io=128MB, bw=20,213KB/s, iops=5,053, runt=  6496msec
    slat (usec): min=4, max=9,123, avg=176.22, stdev=446.73
    clat (usec): min=3, max=19,319, avg=2340.56, stdev=1457.01
    bw (KB/s) : min=    0, max=23105, per=2.13%, avg=3358.21, stdev=7671.12
  write: io=384MB, bw=60,496KB/s, iops=15,124, runt=  6496msec
    slat (usec): min=4, max=11,905, avg=178.51, stdev=459.69
    clat (usec): min=3, max=19,319, avg=2342.55, stdev=1446.37
    bw (KB/s) : min=    0, max=69125, per=2.69%, avg=12738.23, stdev=25281.56
  cpu          : usr=0.43%, sys=19.41%, ctx=6130, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=32826/98246, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.02%, 100=0.02%
     lat (usec): 250=0.25%, 500=1.99%, 750=2.90%, 1000=5.44%
     lat (msec): 2=36.38%, 4=42.45%, 10=10.32%, 20=0.20%
randrw: (groupid=0, jobs=1): err= 0: pid=7224
  read : io=129MB, bw=19,885KB/s, iops=4,971, runt=  6643msec
    slat (usec): min=4, max=12,139, avg=181.12, stdev=463.72
    clat (usec): min=3, max=24,060, avg=2366.15, stdev=1580.29
    bw (KB/s) : min=    0, max=22568, per=2.01%, avg=3176.32, stdev=7468.64
  write: io=383MB, bw=59,038KB/s, iops=14,759, runt=  6643msec
    slat (usec): min=4, max=12,140, avg=181.58, stdev=472.47
    clat (usec): min=11, max=24,060, avg=2370.99, stdev=1574.54
    bw (KB/s) : min=    0, max=66688, per=0.75%, avg=3573.29, stdev=14348.03
  cpu          : usr=0.29%, sys=21.18%, ctx=6200, majf=0, minf=25
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=33024/98048, short=0/0
     lat (usec): 4=0.01%, 20=0.01%, 50=0.02%, 100=0.02%, 250=0.33%
     lat (usec): 500=2.27%, 750=2.97%, 1000=5.59%
     lat (msec): 2=36.38%, 4=41.16%, 10=10.79%, 20=0.43%, 50=0.02%

Run status group 0 (all jobs):
   READ: io=1,025MB, aggrb=154MB/s, minb=20,193KB/s, maxb=20,914KB/s, mint=6394msec, maxt=6643msec
  WRITE: io=3,071MB, aggrb=462MB/s, minb=60,455KB/s, maxb=63,050KB/s, mint=6394msec, maxt=6643msec

Disk stats (read/write):
  sdb: ios=260356/780128, merge=12/127, ticks=229906/690447, in_queue=920955, util=98.57%