Skip to content

Horrendous FreeBSD bonniee++ latency

On my ZFS tank:
> bonnie++
Writing a byte at a time…done
Writing intelligently…done
Rewriting…done
Reading a byte at a time…done
Reading intelligently…done
start ’em…done…done…done…done…done…
Create files in sequential order…done.
Stat files in sequential order…done.
Delete files in sequential order…done.
Create files in random order…done.
Stat files in random order…done.
Delete files in random order…done.
Version 1.96 ——Sequential Output—— –Sequential Input- –Random-
Concurrency 1 -Per Chr- –Block– -Rewrite- -Per Chr- –Block– –Seeks–
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
fbsd2 2G 15 86 12165 15 7534 13 34 83 36594 27 76.8 10
Latency 7792ms 7856ms 9665ms 574ms 1311ms 106s
Version 1.96 ——Sequential Create—— ——–Random Create——–
fbsd2           -Create– –Read— -Delete– -Create– –Read— -Delete–
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 3696 89 13108 92 3347 92 2572 80 5668 93 1679 93
Latency 129ms 11843us 5603us 573ms 8095us 7143us
1.96,1.96,fbsd2,1,1268703835,2G,,15,86,12165,15,7534,13,34,83,36594,27,76.8,10,16,,,,,3696,89,13108,92,3347,92,2572,80,5668,93,1679,93,7792ms,7856ms,9665ms,574ms,1311ms,106s,129ms,11843us,5603us,573ms,8095us,7143us

On the SATA internal hard drive:

> bonnie++
Writing a byte at a time…done
Writing intelligently…done
Rewriting…done
Reading a byte at a time…done
Reading intelligently…done
start ’em…done…done…done…done…done…
Create files in sequential order…done.
Stat files in sequential order…done.
Delete files in sequential order…done.
Create files in random order…done.
Stat files in random order…done.
Delete files in random order…done.
Version 1.96 ——Sequential Output—— –Sequential Input- –Random-
Concurrency 1 -Per Chr- –Block– -Rewrite- -Per Chr- –Block– –Seeks–
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
fbsd2            2G 80 94 48456 34 15479 14 165 76 24437 12 119.8 7
Latency 114ms 363ms 351ms 119ms 138ms 68345ms
Version 1.96 ——Sequential Create—— ——–Random Create——–
fbsd2                -Create– –Read— -Delete– -Create– –Read— -Delete–
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 8027 70 27864 89 17448 71 6583 50 +++++ +++ 21427 86
Latency 183ms 31646us 13344us 320ms 274us 50409us
1.96,1.96,fbsd2,1,1268703414,2G,,80,94,48456,34,15479,14,165,76,24437 ,12,119.8,7,16,,,,,8027,70,27864,89,17448,71,6583,50,+++++,+++,21427,86,114ms,36 3ms,351ms,119ms,138ms,68345ms,183ms,31646us,13344us,320ms,274us,50409us

Thought maybe that automatic ZFS snapshots were getting in the way. But no:


Writing a byte at a time…done
Writing intelligently…done
Rewriting…done
Reading a byte at a time…done
Reading intelligently…done
start ’em…done…done…done…done…done…
Create files in sequential order…done.
Stat files in sequential order…done.
Delete files in sequential order…done.
Create files in random order…done.
Stat files in random order…done.
Delete files in random order…done.
Version  1.96       ——Sequential Output—— –Sequential Input- –Random-
Concurrency   1     -Per Chr- –Block– -Rewrite- -Per Chr- –Block– –Seeks–
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
fbsd             2G    16  85 12138  14  7793  12    39  92 37740  27  78.2  10
Latency              6945ms    7693ms   21537ms     569ms    1137ms      104s
Version  1.96       ——Sequential Create—— ——–Random Create——–
fbsd                -Create– –Read— -Delete– -Create– –Read— -Delete–
files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
16  4046  83 14718  93  3581  92  3546  91 12360  94  3029  92
Latency               263ms    6412us    5649us     312ms    5466us    5879us
1.96,1.96,fbsd,1,1268710009,2G,,16,85,12138,14,7793,12,39,92,37740,27,78.2,10,16,,,,,4046,83,14718,93,3581,92,3546,91,12360,94,3029,92,6945ms,7693ms,21537ms,569ms,1137ms,104s,263ms,6412us,5649us,312ms,5466us,5879us

Test with bonnie:

Writing with putc()…done
Rewriting…done
Writing intelligently…done
Reading with getc()…done
Reading intelligently…done
Seeker 1…Seeker 2…Seeker 3…start ’em…done…done…done…



——-Sequential Output——–—Sequential Input––Random–
-Per Char-–Block—-Rewrite–-Per Char-–Block—–Seeks—
MachineMBK/sec%CPUK/sec%CPUK/sec%CPUK/sec%CPUK/sec%CPU/sec%CPU
fbsd8192869834.71201714.0805012.91782864.23848325.7 54.5 1.6

Be the first to like.

Post a Comment

Your email is never published nor shared. Required fields are marked *
*
*