Japex Report: Test suite for XSL transformations

Description

Micro-benchmark for testing performance of various xml-parser/xsl-processor combinations.

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX
Xsl/Saxon+xerces	2749.871	23.937	803.057	3.557	84.726	0.836
Xsl/Saxon+woodstox-sax	3314.384	23.937	902.749	3.557	89.936	0.836
Xsl/Saxon+aalto-sax	3539.703	23.937	957.494	3.557	95.332	0.836

Test driver using Saxon, JDK default SAX

testCase	resultIterations	resultTime	resultValue	resultValueX
axis	239006	29.954	7979.186	0.608
brutal	64066	29.942	2139.636	6.205
chart	64448	29.952	2151.723	7.267
game	109119	29.95	3643.325	0.793
html	225778	29.941	7540.853	0.774
identity	359141	29.941	11994.947	0.203
inventory	90380	29.952	3017.515	2.02
metric	89957	29.952	3003.389	0.639
oddtemplate	288726	29.951	9640.057	0.154
priority	163422	29.95	5456.525	0.571
products	96137	29.951	3209.857	0.621
queens	3007	29.957	100.376	1.729
tower	677	29.962	22.595	69.069
trend	15929	29.952	531.826	8.067
union	295389	29.95	9862.814	0.117
xpath	296095	29.95	9886.243	0.201
xslbench1	93016	29.951	3105.642	8.688
alphabetize_db100	6259	29.952	208.964	15.669
attsets_chart	120455	29.938	4023.472	2.559
avts_db100	17284	29.95	577.097	11.568
backwards_game	58680	29.951	1959.223	2.617
creation_db100	6490	29.957	216.645	30.416
dbonerow_db10000	117	30.151	3.88	1.295
dbtail_db100	20777	29.948	693.772	5.038
decoy_db100	7082	29.954	236.428	19.745
encrypt_db100	7549	29.952	252.037	19.674
find_breadth	58045	29.95	1938.038	2.007
find_depth	51416	29.95	1716.722	3.735
functions_db100	4519	29.952	150.874	6.184
identity_db1000	1324	29.954	44.201	196.264
patterns_db100	8670	29.949	289.495	19.745
prettyprint_db100	1068	29.956	35.652	140.504
reverser_gettysburg	21184	29.95	707.315	1.293
stringsort_db1000	1210	29.976	40.366	193.333
summarize_queensXsl	76538	29.949	2555.58	0.293
total_chart	158781	29.95	5301.62	0.514
xslbench2_xslbenchdream	1862	29.957	62.155	127.817
xslbench3_xslbenchdream	5842	29.951	195.053	1.609

Test driver using Saxon, Woodstox/SAX

classPath: build/classes lib/*.jar lib/wstx4/*.jar lib/stax2/*.jar lib/saxon/*.jar
driverClass: org.codehaus.staxbind.xslt.SaxXslDriver
javax.xml.parsers.SAXParserFactory: com.ctc.wstx.sax.WstxSAXParserFactory
javax.xml.transform.TransformerFactory: net.sf.saxon.TransformerFactoryImpl

testCase	resultIterations	resultTime	resultValue	resultValueX
axis	323795	29.933	10817.421	0.608
brutal	69988	29.936	2337.927	6.205
chart	71940	29.936	2403.125	7.267
game	126324	29.936	4219.868	0.793
html	274243	29.932	9162.336	0.774
identity	458383	29.935	15312.654	0.203
inventory	105481	29.935	3523.667	2.02
metric	99790	29.934	3333.621	0.639
oddtemplate	347603	29.933	11612.808	0.154
priority	198305	29.933	6624.867	0.571
products	108152	29.933	3613.168	0.621
queens	3026	29.924	101.124	1.729
tower	699	29.967	23.326	69.069
trend	16783	29.934	560.658	8.067
union	367387	29.933	12273.704	0.117
xpath	357189	29.934	11932.552	0.201
xslbench1	101378	29.933	3386.811	8.688
alphabetize_db100	6576	29.937	219.66	15.669
attsets_chart	146568	29.933	4896.473	2.559
avts_db100	19672	29.934	657.169	11.568
backwards_game	64787	29.934	2164.336	2.617
creation_db100	7074	29.929	236.357	30.416
dbonerow_db10000	124	29.931	4.143	1.295
dbtail_db100	24518	29.934	819.069	5.038
decoy_db100	7436	29.936	248.4	19.745
encrypt_db100	8800	29.934	293.983	19.674
find_breadth	74856	29.933	2500.815	2.007
find_depth	62844	29.928	2099.813	3.735
functions_db100	4521	29.932	151.042	6.184
identity_db1000	1429	29.928	47.748	196.264
patterns_db100	9058	29.936	302.578	19.745
prettyprint_db100	1120	29.949	37.398	140.504
reverser_gettysburg	22370	29.933	747.332	1.293
stringsort_db1000	1319	29.952	44.037	193.333
summarize_queensXsl	79438	29.932	2653.935	0.293
total_chart	189147	29.932	6319.127	0.514
xslbench2_xslbenchdream	1867	29.944	62.35	127.817
xslbench3_xslbenchdream	6023	29.934	201.206	1.609

Test driver using Saxon, Aalto/SAX

classPath: build/classes lib/*.jar lib/aalto/*.jar lib/stax2/*.jar lib/saxon/*.jar
driverClass: org.codehaus.staxbind.xslt.SaxXslDriver
javax.xml.parsers.SAXParserFactory: org.codehaus.wool.sax.SAXParserFactoryImpl
javax.xml.transform.TransformerFactory: net.sf.saxon.TransformerFactoryImpl

testCase	resultIterations	resultTime	resultValue	resultValueX
axis	335537	29.923	11213.297	0.608
brutal	73956	29.919	2471.883	6.205
chart	72307	29.921	2416.621	7.267
game	138165	29.92	4617.785	0.793
html	283800	29.916	9486.576	0.774
identity	502103	29.914	16784.845	0.203
inventory	109439	29.92	3657.755	2.02
metric	102609	29.919	3429.521	0.639
oddtemplate	365983	29.919	12232.484	0.154
priority	211562	29.918	7071.277	0.571
products	117419	29.918	3924.662	0.621
queens	3040	29.925	101.589	1.729
tower	695	29.918	23.23	69.069
trend	16610	29.919	555.169	8.067
union	389231	29.917	13010.407	0.117
xpath	390455	29.916	13051.784	0.201
xslbench1	102253	29.917	3417.9	8.688
alphabetize_db100	6645	29.921	222.086	15.669
attsets_chart	151569	29.918	5066.157	2.559
avts_db100	21756	29.915	727.265	11.568
backwards_game	63804	29.916	2132.767	2.617
creation_db100	6944	29.912	232.145	30.416
dbonerow_db10000	134	29.924	4.478	1.295
dbtail_db100	27651	29.917	924.242	5.038
decoy_db100	7314	29.917	244.473	19.745
encrypt_db100	8738	29.916	292.08	19.674
find_breadth	84041	29.917	2809.185	2.007
find_depth	76859	29.918	2568.947	3.735
functions_db100	4817	29.92	160.994	6.184
identity_db1000	1553	29.922	51.902	196.264
patterns_db100	9732	29.918	325.293	19.745
prettyprint_db100	1100	29.939	36.741	140.504
reverser_gettysburg	22579	29.917	754.713	1.293
stringsort_db1000	1429	29.93	47.745	193.333
summarize_queensXsl	101922	29.916	3406.916	0.293
total_chart	200728	29.917	6709.526	0.514
xslbench2_xslbenchdream	1957	29.919	65.409	127.817
xslbench3_xslbenchdream	7745	29.919	258.863	1.609

Generated using Japex version 1.1.7