Poojan's Tech Blog / Horrendous FreeBSD bonniee++ latency

On my ZFS tank:
> bonnie++ Writing a byte at a time…done Writing intelligently…done Rewriting…done Reading a byte at a time…done Reading intelligently…done start ’em…done…done…done…done…done… Create files in sequential order…done. Stat files in sequential order…done. Delete files in sequential order…done. Create files in random order…done. Stat files in random order…done. Delete files in random order…done. Version 1.96 ——Sequential Output—— –Sequential Input- –Random- Concurrency 1 -Per Chr- –Block– -Rewrite- -Per Chr- –Block– –Seeks– Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP fbsd2 2G 15 86 12165 15 7534 13 34 83 36594 27 76.8 10 Latency 7792ms 7856ms 9665ms 574ms 1311ms 106s Version 1.96 ——Sequential Create—— ——–Random Create——– fbsd2 -Create– –Read— -Delete– -Create– –Read— -Delete– files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 3696 89 13108 92 3347 92 2572 80 5668 93 1679 93 Latency 129ms 11843us 5603us 573ms 8095us 7143us 1.96,1.96,fbsd2,1,1268703835,2G,,15,86,12165,15,7534,13,34,83,36594,27,76.8,10,16,,,,,3696,89,13108,92,3347,92,2572,80,5668,93,1679,93,7792ms,7856ms,9665ms,574ms,1311ms,106s,129ms,11843us,5603us,573ms,8095us,7143us
On the SATA internal hard drive:
> bonnie++ Writing a byte at a time…done Writing intelligently…done Rewriting…done Reading a byte at a time…done Reading intelligently…done start ’em…done…done…done…done…done… Create files in sequential order…done. Stat files in sequential order…done. Delete files in sequential order…done. Create files in random order…done. Stat files in random order…done. Delete files in random order…done. Version 1.96 ——Sequential Output—— –Sequential Input- –Random- Concurrency 1 -Per Chr- –Block– -Rewrite- -Per Chr- –Block– –Seeks– Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP fbsd2 2G 80 94 48456 34 15479 14 165 76 24437 12 119.8 7 Latency 114ms 363ms 351ms 119ms 138ms 68345ms Version 1.96 ——Sequential Create—— ——–Random Create——– fbsd2 -Create– –Read— -Delete– -Create– –Read— -Delete– files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 8027 70 27864 89 17448 71 6583 50 +++++ +++ 21427 86 Latency 183ms 31646us 13344us 320ms 274us 50409us 1.96,1.96,fbsd2,1,1268703414,2G,,80,94,48456,34,15479,14,165,76,24437 ,12,119.8,7,16,,,,,8027,70,27864,89,17448,71,6583,50,+++++,+++,21427,86,114ms,36 3ms,351ms,119ms,138ms,68345ms,183ms,31646us,13344us,320ms,274us,50409us

Thought maybe that automatic ZFS snapshots were getting in the way. But no:



Writing a byte at a time…done

Writing intelligently…done

Rewriting…done

Reading a byte at a time…done

Reading intelligently…done

start ’em…done…done…done…done…done…

Create files in sequential order…done.

Stat files in sequential order…done.

Delete files in sequential order…done.

Create files in random order…done.

Stat files in random order…done.

Delete files in random order…done.

Version  1.96       ——Sequential Output—— –Sequential Input- –Random-

Concurrency   1     -Per Chr- –Block– -Rewrite- -Per Chr- –Block– –Seeks–

Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP

fbsd             2G    16  85 12138  14  7793  12    39  92 37740  27  78.2  10

Latency              6945ms    7693ms   21537ms     569ms    1137ms      104s

Version  1.96       ——Sequential Create—— ——–Random Create——–

fbsd                -Create– –Read— -Delete– -Create– –Read— -Delete–

files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP

16  4046  83 14718  93  3581  92  3546  91 12360  94  3029  92

Latency               263ms    6412us    5649us     312ms    5466us    5879us

1.96,1.96,fbsd,1,1268710009,2G,,16,85,12138,14,7793,12,39,92,37740,27,78.2,10,16,,,,,4046,83,14718,93,3581,92,3546,91,12360,94,3029,92,6945ms,7693ms,21537ms,569ms,1137ms,104s,263ms,6412us,5649us,312ms,5466us,5879us

Test with bonnie:

Writing with putc()…done

Rewriting…done

Writing intelligently…done

Reading with getc()…done

Reading intelligently…done

Seeker 1…Seeker 2…Seeker 3…start ’em…done…done…done…

		——-Sequential Output——–				—Sequential Input–				–Random–
		-Per Char-		–Block—		-Rewrite–		-Per Char-		–Block—		–Seeks—
Machine	MB	K/sec	%CPU	K/sec	%CPU	K/sec	%CPU	K/sec	%CPU	K/sec	%CPU	/sec	%CPU
fbsd	8192	8698	34.7	12017	14.0	8050	12.9	17828	64.2	38483	25.7	54.5	1.6

Be the first to like.

Unlike

Poojan's Tech Blog

Horrendous FreeBSD bonniee++ latency

Post a Comment

Search

Meta

Blogroll

Top Liked Posts

Your IP Address

Categories