Thursday, October 21, 2010

ministat example for comparing performance

This is mostly a reminder to myself how to get and use FreeBSD's ministat for performance comparisons. This somewhat useless example shows that -server is apparently the default flag for java these days. Note: you have to strip out some FreeBSD-isms to get it to compile on Linux.


vocal(jason): cat mstatdemo.sh
#!/bin/sh
wget -O ministat.c 'http://www.freebsd.org/cgi/cvsweb.cgi/src/usr.bin/ministat/ministat.c?rev=1.14;content-type=text%2Fplain'
egrep -v '(FBSDID|ttycom)' ministat.c | gcc -x c -o ministat - -lm
wget -O scimark2lib.jar 'http://math.nist.gov/scimark2/scimark2lib.jar'
rm -f results-default.txt results-server.txt
for i in `seq 3`; do
echo "default $i"
java -cp scimark2lib.jar jnt.scimark2.commandline | grep Composite | awk '{print $3}' >> results-default.txt
echo "server $i"
java -server -cp scimark2lib.jar jnt.scimark2.commandline | grep Composite | awk '{print $3}' >> results-server.txt
done
ministat results-default.txt results-server.txt
vocal(jason) sh mstatdemo.sh
...
x results-default.txt
+ results-server.txt
+------------------------------------------------------------------------------+
| ++x + x x |
||_________M___|________A_____________________A|_____M________________________||
+------------------------------------------------------------------------------+
N Min Max Median Avg Stddev
x 3 518.6688 521.25366 520.35719 520.09322 1.3124921
+ 3 518.60099 520.27189 518.64299 519.17196 0.9528036
No difference proven at 95.0% confidence

No comments: