randrw: (g=0): rw=randrw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
...
randrw: (g=0): rw=randrw, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
Starting 16 processes

randrw: (groupid=0, jobs=1): err= 0: pid=26389
  read : io=4,072MB, bw=26,257KB/s, iops=6,564, runt=158809msec
    slat (usec): min=8, max=21,714, avg=142.35, stdev=303.00
    clat (usec): min=3, max=524K, avg=1775.66, stdev=2514.83
    bw (KB/s) : min=    0, max=66808, per=1.02%, avg=4069.12, stdev=10513.33
  write: io=12,216MB, bw=78,768KB/s, iops=19,692, runt=158809msec
    slat (usec): min=8, max=23,481, avg=143.28, stdev=308.46
    clat (usec): min=3, max=525K, avg=1779.98, stdev=2516.54
    bw (KB/s) : min=    0, max=202776, per=0.46%, avg=5490.65, stdev=21989.41
  cpu          : usr=3.50%, sys=91.64%, ctx=22229, majf=0, minf=1157
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1042460/3127268, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.02%
     lat (usec): 250=0.22%, 500=2.15%, 750=8.96%, 1000=16.28%
     lat (msec): 2=49.38%, 4=16.35%, 10=6.02%, 20=0.56%, 50=0.05%
     lat (msec): 100=0.01%, 500=0.01%, 750=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26391
  read : io=4,067MB, bw=27,476KB/s, iops=6,869, runt=151562msec
    slat (usec): min=8, max=21,141, avg=136.43, stdev=298.96
    clat (usec): min=2, max=507K, avg=1699.46, stdev=2481.95
    bw (KB/s) : min=    0, max=49680, per=1.11%, avg=4432.78, stdev=10904.19
  write: io=12,221MB, bw=82,571KB/s, iops=20,642, runt=151562msec
    slat (usec): min=8, max=31,711, avg=136.96, stdev=298.44
    clat (usec): min=2, max=505K, avg=1698.63, stdev=2254.11
    bw (KB/s) : min=    0, max=149704, per=0.50%, avg=6018.27, stdev=22991.82
  cpu          : usr=3.28%, sys=91.95%, ctx=19454, majf=0, minf=1215
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1041086/3128642, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.02%
     lat (usec): 250=0.18%, 500=1.37%, 750=7.47%, 1000=16.83%
     lat (msec): 2=55.37%, 4=13.29%, 10=4.86%, 20=0.55%, 50=0.04%
     lat (msec): 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26392
  read : io=4,069MB, bw=25,625KB/s, iops=6,406, runt=162584msec
    slat (usec): min=8, max=114K, avg=139.80, stdev=331.06
    clat (usec): min=2, max=5,816K, avg=1866.57, stdev=25145.87
    bw (KB/s) : min=    0, max=69976, per=1.01%, avg=4024.77, stdev=10464.38
  write: io=12,219MB, bw=76,961KB/s, iops=19,240, runt=162584msec
    slat (usec): min=8, max=114K, avg=140.73, stdev=332.26
    clat (usec): min=3, max=5,816K, avg=1843.61, stdev=22415.52
    bw (KB/s) : min=    0, max=212664, per=0.51%, avg=6105.10, stdev=23134.68
  cpu          : usr=3.29%, sys=87.82%, ctx=24561, majf=0, minf=1227
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1041574/3128154, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.02%
     lat (usec): 250=0.21%, 500=1.89%, 750=8.25%, 1000=16.66%
     lat (msec): 2=52.42%, 4=14.36%, 10=5.45%, 20=0.66%, 50=0.05%
     lat (msec): 100=0.01%, 250=0.01%, 500=0.01%, 1000=0.01%, >=2000=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26393
  read : io=4,077MB, bw=29,171KB/s, iops=7,292, runt=143110msec
    slat (usec): min=8, max=24,024, avg=129.42, stdev=287.12
    clat (usec): min=3, max=76,375, avg=1602.96, stdev=1485.79
    bw (KB/s) : min=    0, max=46000, per=1.15%, avg=4567.84, stdev=11275.85
  write: io=12,211MB, bw=87,375KB/s, iops=21,843, runt=143110msec
    slat (usec): min=7, max=28,954, avg=129.66, stdev=289.20
    clat (usec): min=3, max=86,283, avg=1604.15, stdev=1486.02
    bw (KB/s) : min=    0, max=141648, per=0.49%, avg=5842.31, stdev=23085.59
  cpu          : usr=3.47%, sys=91.80%, ctx=18402, majf=0, minf=1269
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1043661/3126067, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.02%
     lat (usec): 250=0.18%, 500=1.41%, 750=7.94%, 1000=17.92%
     lat (msec): 2=56.92%, 4=10.87%, 10=4.23%, 20=0.45%, 50=0.04%
     lat (msec): 100=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26394
  read : io=4,069MB, bw=25,230KB/s, iops=6,307, runt=165159msec
    slat (usec): min=7, max=37,025, avg=148.65, stdev=330.70
    clat (usec): min=3, max=258K, avg=1855.58, stdev=2150.01
    bw (KB/s) : min=    0, max=87216, per=0.94%, avg=3740.50, stdev=10288.91
  write: io=12,219MB, bw=75,757KB/s, iops=18,939, runt=165159msec
    slat (usec): min=7, max=37,025, avg=148.70, stdev=323.55
    clat (usec): min=2, max=258K, avg=1856.63, stdev=2106.39
    bw (KB/s) : min=    0, max=260432, per=0.43%, avg=5113.10, stdev=21569.01
  cpu          : usr=3.43%, sys=91.52%, ctx=29755, majf=0, minf=1195
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1041750/3127978, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.27%, 500=3.88%, 750=10.66%, 1000=15.64%
     lat (msec): 2=44.36%, 4=16.80%, 10=7.48%, 20=0.81%, 50=0.05%
     lat (msec): 100=0.01%, 250=0.01%, 500=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26395
  read : io=4,074MB, bw=26,755KB/s, iops=6,688, runt=155915msec
    slat (usec): min=8, max=30,012, avg=140.76, stdev=313.75
    clat (usec): min=3, max=102K, avg=1756.64, stdev=1718.71
    bw (KB/s) : min=    0, max=47073, per=1.06%, avg=4228.39, stdev=10600.94
  write: io=12,214MB, bw=80,220KB/s, iops=20,054, runt=155915msec
    slat (usec): min=8, max=30,013, avg=140.90, stdev=308.76
    clat (usec): min=3, max=99,616, avg=1754.12, stdev=1707.37
    bw (KB/s) : min=    0, max=139960, per=0.46%, avg=5502.34, stdev=21871.11
  cpu          : usr=3.29%, sys=91.78%, ctx=19704, majf=0, minf=1110
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1042872/3126856, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.23%, 500=1.53%, 750=7.69%, 1000=16.78%
     lat (msec): 2=53.07%, 4=14.16%, 10=5.83%, 20=0.63%, 50=0.05%
     lat (msec): 100=0.01%, 250=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26397
  read : io=4,076MB, bw=24,896KB/s, iops=6,223, runt=167668msec
    slat (usec): min=7, max=23,669, avg=144.32, stdev=324.33
    clat (usec): min=3, max=7,095K, avg=1951.10, stdev=32621.56
    bw (KB/s) : min=    0, max=106296, per=1.00%, avg=3968.05, stdev=10896.76
  write: io=12,212MB, bw=74,580KB/s, iops=18,644, runt=167668msec
    slat (usec): min=8, max=23,670, avg=144.54, stdev=321.38
    clat (usec): min=3, max=7,095K, avg=1893.69, stdev=26063.31
    bw (KB/s) : min=    0, max=319192, per=0.48%, avg=5726.40, stdev=23434.41
  cpu          : usr=3.28%, sys=87.65%, ctx=35641, majf=0, minf=1157
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1043562/3126166, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.30%, 500=4.96%, 750=10.55%, 1000=16.74%
     lat (msec): 2=44.30%, 4=14.63%, 10=7.69%, 20=0.73%, 50=0.06%
     lat (msec): 100=0.01%, 500=0.01%, >=2000=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26398
  read : io=4,074MB, bw=26,382KB/s, iops=6,595, runt=158130msec
    slat (usec): min=8, max=26,524, avg=142.40, stdev=307.29
    clat (usec): min=3, max=115K, avg=1770.74, stdev=1656.08
    bw (KB/s) : min=    0, max=51328, per=1.02%, avg=4078.83, stdev=10402.39
  write: io=12,214MB, bw=79,094KB/s, iops=19,773, runt=158130msec
    slat (usec): min=7, max=26,523, avg=142.96, stdev=310.90
    clat (usec): min=2, max=114K, avg=1773.17, stdev=1681.89
    bw (KB/s) : min=    0, max=151600, per=0.50%, avg=5960.00, stdev=22602.53
  cpu          : usr=3.42%, sys=91.96%, ctx=21402, majf=0, minf=1181
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1042930/3126798, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.22%, 500=1.51%, 750=7.43%, 1000=16.31%
     lat (msec): 2=53.13%, 4=14.74%, 10=5.96%, 20=0.61%, 50=0.05%
     lat (msec): 100=0.01%, 250=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26399
  read : io=4,074MB, bw=26,949KB/s, iops=6,737, runt=154811msec
    slat (usec): min=7, max=20,613, avg=138.20, stdev=291.93
    clat (usec): min=3, max=1,559K, avg=1738.90, stdev=6465.14
    bw (KB/s) : min=    0, max=56768, per=1.04%, avg=4154.38, stdev=10392.33
  write: io=12,214MB, bw=80,788KB/s, iops=20,197, runt=154811msec
    slat (usec): min=8, max=28,931, avg=138.65, stdev=295.06
    clat (usec): min=2, max=1,559K, avg=1738.92, stdev=6225.32
    bw (KB/s) : min=    0, max=166040, per=0.45%, avg=5376.50, stdev=21372.89
  cpu          : usr=3.34%, sys=90.87%, ctx=21127, majf=0, minf=1253
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1043004/3126724, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.22%, 500=1.49%, 750=6.76%, 1000=15.54%
     lat (msec): 2=55.58%, 4=15.04%, 10=4.84%, 20=0.45%, 50=0.04%
     lat (msec): 100=0.01%, 2000=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26400
  read : io=4,076MB, bw=30,022KB/s, iops=7,505, runt=139038msec
    slat (usec): min=8, max=28,097, avg=125.15, stdev=283.11
    clat (usec): min=3, max=947K, avg=1562.21, stdev=3596.95
    bw (KB/s) : min=    0, max=46864, per=1.25%, avg=4971.09, stdev=11911.15
  write: io=12,212MB, bw=89,937KB/s, iops=22,484, runt=139038msec
    slat (usec): min=7, max=28,101, avg=125.38, stdev=287.52
    clat (usec): min=2, max=953K, avg=1564.01, stdev=4053.41
    bw (KB/s) : min=    0, max=140096, per=0.54%, avg=6501.52, stdev=24703.32
  cpu          : usr=2.91%, sys=91.42%, ctx=17524, majf=0, minf=1217
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1043565/3126163, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.20%, 500=1.52%, 750=8.91%, 1000=19.37%
     lat (msec): 2=56.11%, 4=9.57%, 10=3.78%, 20=0.47%, 50=0.04%
     lat (msec): 100=0.01%, 250=0.01%, 1000=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26402
  read : io=4,073MB, bw=25,890KB/s, iops=6,472, runt=161111msec
    slat (usec): min=7, max=27,305, avg=139.62, stdev=318.44
    clat (usec): min=2, max=5,900K, avg=1862.48, stdev=26524.95
    bw (KB/s) : min=    0, max=84736, per=1.02%, avg=4060.42, stdev=10760.98
  write: io=12,215MB, bw=77,634KB/s, iops=19,408, runt=161111msec
    slat (usec): min=7, max=27,304, avg=140.00, stdev=314.32
    clat (usec): min=3, max=5,900K, avg=1824.57, stdev=21942.02
    bw (KB/s) : min=    0, max=254176, per=0.50%, avg=5947.74, stdev=23346.07
  cpu          : usr=3.21%, sys=88.74%, ctx=26564, majf=0, minf=1211
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1042798/3126930, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.25%, 500=3.20%, 750=10.57%, 1000=16.23%
     lat (msec): 2=49.86%, 4=12.94%, 10=6.07%, 20=0.81%, 50=0.05%
     lat (msec): 100=0.01%, >=2000=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26404
  read : io=4,073MB, bw=27,944KB/s, iops=6,986, runt=149244msec
    slat (usec): min=8, max=28,453, avg=129.65, stdev=287.74
    clat (usec): min=3, max=5,791K, avg=1688.61, stdev=21262.25
    bw (KB/s) : min=    0, max=46312, per=1.14%, avg=4531.55, stdev=11079.47
  write: io=12,215MB, bw=83,812KB/s, iops=20,952, runt=149244msec
    slat (usec): min=8, max=28,453, avg=129.91, stdev=289.11
    clat (usec): min=2, max=5,791K, avg=1705.47, stdev=23195.36
    bw (KB/s) : min=    0, max=137752, per=0.49%, avg=5818.54, stdev=22757.79
  cpu          : usr=3.25%, sys=88.14%, ctx=19889, majf=0, minf=1209
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1042637/3127091, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.02%
     lat (usec): 250=0.20%, 500=1.40%, 750=7.48%, 1000=17.11%
     lat (msec): 2=57.57%, 4=11.92%, 10=3.77%, 20=0.48%, 50=0.04%
     lat (msec): 100=0.01%, >=2000=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26406
  read : io=4,075MB, bw=28,159KB/s, iops=7,039, runt=148181msec
    slat (usec): min=8, max=31,522, avg=134.04, stdev=299.49
    clat (usec): min=2, max=116K, avg=1661.66, stdev=1604.23
    bw (KB/s) : min=    0, max=47120, per=1.09%, avg=4355.45, stdev=10927.55
  write: io=12,213MB, bw=84,399KB/s, iops=21,099, runt=148181msec
    slat (usec): min=8, max=31,523, avg=134.27, stdev=301.46
    clat (usec): min=2, max=114K, avg=1661.16, stdev=1602.61
    bw (KB/s) : min=    0, max=139544, per=0.49%, avg=5789.11, stdev=22745.02
  cpu          : usr=3.27%, sys=92.08%, ctx=18294, majf=0, minf=1250
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1043160/3126568, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.02%
     lat (usec): 250=0.18%, 500=1.39%, 750=8.03%, 1000=17.68%
     lat (msec): 2=54.94%, 4=12.61%, 10=4.52%, 20=0.59%, 50=0.05%
     lat (msec): 100=0.01%, 250=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26408
  read : io=4,070MB, bw=27,300KB/s, iops=6,825, runt=152645msec
    slat (usec): min=7, max=24,869, avg=137.85, stdev=300.47
    clat (usec): min=3, max=117K, avg=1711.33, stdev=1596.21
    bw (KB/s) : min=    0, max=46984, per=1.08%, avg=4281.09, stdev=10787.26
  write: io=12,218MB, bw=81,966KB/s, iops=20,491, runt=152645msec
    slat (usec): min=7, max=28,302, avg=138.59, stdev=303.73
    clat (usec): min=3, max=120K, avg=1712.23, stdev=1616.33
    bw (KB/s) : min=    0, max=140408, per=0.53%, avg=6355.15, stdev=23655.92
  cpu          : usr=3.23%, sys=92.26%, ctx=18064, majf=0, minf=1262
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1041807/3127921, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.02%
     lat (usec): 250=0.17%, 500=1.36%, 750=8.15%, 1000=17.41%
     lat (msec): 2=52.64%, 4=14.22%, 10=5.51%, 20=0.47%, 50=0.05%
     lat (msec): 100=0.01%, 250=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26411
  read : io=4,075MB, bw=26,861KB/s, iops=6,715, runt=155350msec
    slat (usec): min=7, max=26,509, avg=140.09, stdev=309.83
    clat (usec): min=3, max=211K, avg=1747.01, stdev=1825.79
    bw (KB/s) : min=    0, max=47392, per=1.05%, avg=4193.70, stdev=10657.56
  write: io=12,213MB, bw=80,503KB/s, iops=20,125, runt=155350msec
    slat (usec): min=7, max=26,509, avg=140.56, stdev=308.29
    clat (usec): min=2, max=210K, avg=1745.35, stdev=1806.65
    bw (KB/s) : min=    0, max=142480, per=0.47%, avg=5610.50, stdev=22231.49
  cpu          : usr=3.34%, sys=91.70%, ctx=19922, majf=0, minf=1234
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1043211/3126517, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.21%, 500=1.59%, 750=8.35%, 1000=17.44%
     lat (msec): 2=50.94%, 4=15.06%, 10=5.78%, 20=0.54%, 50=0.05%
     lat (msec): 100=0.01%, 250=0.01%
randrw: (groupid=0, jobs=1): err= 0: pid=26412
  read : io=4,074MB, bw=26,382KB/s, iops=6,595, runt=158129msec
    slat (usec): min=8, max=21,946, avg=140.47, stdev=301.38
    clat (usec): min=3, max=1,713K, avg=1765.08, stdev=5577.94
    bw (KB/s) : min=    0, max=48400, per=1.00%, avg=3978.68, stdev=10390.00
  write: io=12,214MB, bw=79,094KB/s, iops=19,773, runt=158129msec
    slat (usec): min=7, max=1,711K, avg=143.93, stdev=1960.83
    clat (usec): min=2, max=1,713K, avg=1763.04, stdev=5231.15
    bw (KB/s) : min=    0, max=145896, per=0.48%, avg=5754.93, stdev=22437.88
  cpu          : usr=3.35%, sys=90.99%, ctx=20147, majf=0, minf=1254
  IO depths    : 1=0.0%, 2=0.0%, 4=0.1%, 8=0.1%, 16=0.1%, 32=87.5%, >=64=12.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=1042952/3126776, short=0/0
     lat (usec): 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.03%
     lat (usec): 250=0.24%, 500=1.80%, 750=8.69%, 1000=17.58%
     lat (msec): 2=50.98%, 4=14.00%, 10=5.93%, 20=0.68%, 50=0.05%
     lat (msec): 100=0.01%, 250=0.01%, 2000=0.01%

Run status group 0 (all jobs):
   READ: io=65,168MB, aggrb=389MB/s, minb=25,493KB/s, maxb=30,742KB/s, mint=139038msec, maxt=167668msec
  WRITE: io=191GB, aggrb=1,166MB/s, minb=76,369KB/s, maxb=92,095KB/s, mint=139038msec, maxt=167668msec

Disk stats (read/write):
  sdb: ios=525124/1571776, merge=0/9, ticks=167454/525304, in_queue=692778, util=85.09%
  sdc: ios=525064/1571786, merge=0/5, ticks=216926/605471, in_queue=824913, util=89.19%
  sdd: ios=524042/1572890, merge=1/3, ticks=224349/650607, in_queue=875179, util=89.87%
  sde: ios=523330/1573592, merge=0/6, ticks=186353/557050, in_queue=743680, util=86.38%
  sdf: ios=524456/1572392, merge=0/2, ticks=167653/534467, in_queue=702611, util=85.26%
  sdg: ios=524724/1572127, merge=0/2, ticks=193275/580095, in_queue=773745, util=87.41%
  sdh: ios=524332/1572522, merge=0/2, ticks=198071/629634, in_queue=828185, util=88.50%
  sdi: ios=524648/1572207, merge=0/3, ticks=217532/658179, in_queue=880456, util=89.23%
  sdj: ios=525142/1571731, merge=0/3, ticks=173963/498673, in_queue=674092, util=84.72%
  sdk: ios=524743/1572101, merge=0/3, ticks=196944/544797, in_queue=742591, util=87.07%
  sdl: ios=524709/1572164, merge=0/2, ticks=198160/595749, in_queue=794145, util=88.25%
  sdm: ios=524180/1572669, merge=1/2, ticks=201995/637815, in_queue=840439, util=88.98%
  sdn: ios=522790/1574058, merge=0/5, ticks=194279/572101, in_queue=766629, util=88.04%
  sdo: ios=524223/1572631, merge=1/2, ticks=223614/603127, in_queue=829504, util=89.10%
  sdp: ios=525027/1571835, merge=1/6, ticks=163208/501028, in_queue=666764, util=83.48%
  sdq: ios=523815/1573112, merge=1/3, ticks=214284/650445, in_queue=865288, util=89.34%
  sdr: ios=524245/1572815, merge=0/5, ticks=182308/518986, in_queue=701251, util=85.35%
  sds: ios=524671/1572372, merge=0/1, ticks=196275/569763, in_queue=766303, util=87.44%
  sdt: ios=525275/1571749, merge=1/1, ticks=197651/617356, in_queue=815363, util=88.60%
  sdu: ios=524187/1572848, merge=0/2, ticks=220648/644335, in_queue=868320, util=89.26%
  sdv: ios=524712/1572326, merge=0/2, ticks=183421/559122, in_queue=744933, util=87.66%
  sdw: ios=524056/1572911, merge=1/17, ticks=413381/1212283, in_queue=1623938, util=92.74%
  sdx: ios=513201/1534943, merge=1/6, ticks=220390/669249, in_queue=890566, util=90.58%
  sdy: ios=513000/1535168, merge=0/4, ticks=233635/717875, in_queue=952996, util=91.21%
  sdz: ios=524205/1572814, merge=1/2, ticks=221065/648404, in_queue=870744, util=90.39%
  sdaa: ios=511667/1536508, merge=0/3, ticks=157582/494725, in_queue=652308, util=82.51%
  sdab: ios=511913/1536239, merge=0/0, ticks=166986/551124, in_queue=720456, util=85.29%
  sdac: ios=513297/1534856, merge=0/1, ticks=198131/567311, in_queue=765924, util=86.60%
  sdad: ios=524519/1572536, merge=1/0, ticks=231644/703731, in_queue=936830, util=91.69%
  sdae: ios=511199/1536992, merge=0/3, ticks=184996/528796, in_queue=714042, util=85.03%
  sdaf: ios=513087/1535093, merge=0/1, ticks=192418/587021, in_queue=780104, util=87.35%
  sdag: ios=513544/1534626, merge=0/1, ticks=207118/621327, in_queue=828903, util=88.26%