Japex Report: Test suite for XSL transformations

Description

Micro-benchmark for testing performance of various xml-parser/xsl-processor combinations.

Global Parameters

configFile: xslt-xalan.xml
chartType: barchart
dateTime: 02 Apr 2009/16:57:27 PDT
dummyResult: 1290
hostName: chromia
inputDir: data/xsltmark-data
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: i386
osName: Linux
plotDrivers: false
plotGroupSize: 10
reportsDirectory: japex-reports
resultAxis: normal
resultAxisX: normal
resultUnit: tps
resultUnitX: KB
runTime: 30
runsPerDriver: 3
singleClassLoader: false
version: 1.1.7
vmInfo: Sun Microsystems Inc. 11.2-b01
warmupTime: 5
warmupsPerDriver: 1

Result Summary (tps)

driver	resultAritMean	resultAritMeanStddev	resultAritMeanX	resultGeomMean	resultGeomMeanStddev	resultGeomMeanX	resultHarmMean	resultHarmMeanStddev	resultHarmMeanX
Xsl/Xalan+xerces-sax	3746.225	82.523	23.131	1424.676	24.697	3.187	215.871	3.715	0.76
Xsl/Xalan+woodstox-sax	4340.918	9.007	23.131	1581.602	3.84	3.187	234.508	0.236	0.76
Xsl/Xalan+aalto	4687.833	16.099	23.131	1748.754	6.134	3.187	269.985	1.273	0.76

Driver: Xsl/Xalan+xerces-sax

Test driver for Xalan w/ Xerces-sax

classPath: build/classes lib/*.jar lib/xalan/*.jar lib/xerces/*.jar
driverClass: org.codehaus.staxbind.xslt.SaxXslDriver
javax.xml.parsers.SAXParserFactory: org.apache.xerces.jaxp.SAXParserFactoryImpl
javax.xml.transform.TransformerFactory: org.apache.xalan.xsltc.trax.TransformerFactoryImpl

testCase	resultIterations	resultTime	resultValue	resultValueStddev	resultValueX
axis	331916.667	29.947	11083.461	338.568	0.608
brutal	126008.667	29.885	4216.514	93.514	3.941
chart	139993	29.884	4684.488	56.064	3.595
game	129386.667	29.882	4329.904	19.377	0.434
html	205560.333	29.881	6879.295	28.675	0.471
identity	373483.667	29.889	12495.923	127.264	0.203
inventory	149791	29.888	5011.813	62.176	2.02
metric	172260.667	29.886	5763.911	110.593	0.646
oddtemplate	353515.667	29.887	11828.715	343.409	0.154
priority	238907	29.885	7994.329	151.976	0.571
products	90571	29.884	3030.783	88.509	0.404
queens	19439.333	29.885	650.489	22.503	1.729
tower	12020.667	29.887	402.213	6.659	69.069
trend	11151.667	29.888	373.116	9.575	8.067
union	392529.667	29.885	13134.785	570.689	0.117
xpath	352705.333	29.885	11802.317	476.134	0.201
xslbench1	145492.667	29.879	4869.505	106.466	6.656
alphabetize_db100	6577	29.887	220.066	2.994	15.669
attsets_chart	167372	29.886	5600.399	63.642	2.559
avts_db100	25531.667	29.887	854.289	15.877	11.568
backwards_game	77321.333	29.886	2587.215	57.773	2.617
creation_db100	17248.333	29.886	577.152	14.109	30.416
dbonerow_db10000	289	30.022	9.626	0.176	0.886
dbtail_db100	31818.333	29.885	1064.686	8.385	5.038
decoy_db100	12753.667	29.883	426.794	6.256	19.745
encrypt_db100	11525.333	29.888	385.625	9.686	19.674
find_breadth	90266	29.888	3020.196	26.853	2.007
find_depth	78999.667	29.886	2643.414	47.274	3.735
functions_db100	9180	29.886	307.167	4.538	6.184
identity_db1000	2419.333	29.889	80.943	0.785	196.264
patterns_db100	20216	29.886	676.449	15.211	19.745
prettyprint_db100	4997.667	29.89	167.204	2.222	140.511
reverser_gettysburg	164886.333	29.886	5517.295	95.374	1.293
stringsort_db1000	2048	29.889	68.521	1.494	193.333
summarize_queensXsl	68377	29.884	2288.088	37.32	0.293
total_chart	206577	29.886	6912.178	102.979	0.337
xslbench2_xslbenchdream	5397.333	29.887	180.594	4.043	106.963
xslbench3_xslbenchdream	6484.667	29.874	217.068	6.74	1.26

Driver: Xsl/Xalan+woodstox-sax

Test driver for Xalan w/ Xerces-sax

classPath: build/classes lib/*.jar lib/xalan/*.jar lib/xerces/*.jar lib/wstx4/*.jar lib/stax2/*.jar
driverClass: org.codehaus.staxbind.xslt.SaxXslDriver
javax.xml.parsers.SAXParserFactory: com.ctc.wstx.sax.WstxSAXParserFactory
javax.xml.transform.TransformerFactory: org.apache.xalan.xsltc.trax.TransformerFactoryImpl

testCase	resultIterations	resultTime	resultValue	resultValueStddev	resultValueX
axis	412002	29.934	13763.512	14.635	0.608
brutal	140339.333	29.913	4691.552	15.774	3.941
chart	155119.667	29.915	5185.425	19.611	3.595
game	145133.667	29.914	4851.676	5.406	0.434
html	229853	29.914	7683.698	17.242	0.471
identity	452573.333	29.915	15128.593	28.582	0.203
inventory	169194.333	29.914	5655.96	9.888	2.02
metric	199285.667	29.915	6661.807	11.909	0.646
oddtemplate	417018.667	29.915	13940.303	24.514	0.154
priority	282872.333	29.915	9455.934	8.654	0.571
products	99984.333	29.915	3342.29	8.13	0.404
queens	20532.333	29.914	686.387	3.007	1.729
tower	12482	29.916	417.235	2.165	69.069
trend	11753	29.915	392.882	0.702	8.067
union	476269.333	29.915	15920.824	13.413	0.117
xpath	421960.333	29.915	14105.445	12.385	0.201
xslbench1	160484	29.908	5365.966	15.301	6.656
alphabetize_db100	6782	29.917	226.696	1.293	15.669
attsets_chart	187602.333	29.915	6271.224	24.526	2.559
avts_db100	28542	29.915	954.111	2.509	11.568
backwards_game	87382.667	29.915	2921.034	8.647	2.617
creation_db100	18576	29.913	620.997	7.371	30.416
dbonerow_db10000	316	29.98	10.54	0.008	0.886
dbtail_db100	36592.333	29.913	1223.295	6.514	5.038
decoy_db100	13998	29.912	467.975	3.705	19.745
encrypt_db100	12095.333	29.916	404.308	0.192	19.674
find_breadth	108302.667	29.915	3620.393	13.412	2.007
find_depth	91526	29.915	3059.546	23.356	3.735
functions_db100	9648.333	29.917	322.504	1.109	6.184
identity_db1000	2632.667	29.919	87.993	0.174	196.264
patterns_db100	22347.333	29.916	747.009	2.562	19.745
prettyprint_db100	5279	29.919	176.444	0.621	140.511
reverser_gettysburg	175204.333	29.915	5856.776	14.912	1.293
stringsort_db1000	2263	29.922	75.629	0.245	193.333
summarize_queensXsl	70045.333	29.914	2341.563	7.573	0.293
total_chart	236436.333	29.915	7903.681	11.495	0.337
xslbench2_xslbenchdream	5643	29.916	188.626	0.2	106.963
xslbench3_xslbenchdream	6733	29.916	225.064	0.512	1.26

Driver: Xsl/Xalan+aalto

Test driver for Xalan w/ Xerces-sax

classPath: build/classes lib/*.jar lib/xalan/*.jar lib/xerces/*.jar lib/aalto/*.jar lib/stax2/*.jar
driverClass: org.codehaus.staxbind.xslt.SaxXslDriver
javax.xml.parsers.SAXParserFactory: org.codehaus.wool.sax.SAXParserFactoryImpl
javax.xml.transform.TransformerFactory: org.apache.xalan.xsltc.trax.TransformerFactoryImpl

testCase	resultIterations	resultTime	resultValue	resultValueStddev	resultValueX
axis	431662.667	29.918	14428.002	52.264	0.608
brutal	147872.667	29.891	4947.103	14.785	3.941
chart	166415.333	29.891	5567.465	22.016	3.595
game	160099.667	29.89	5356.294	7.207	0.434
html	235527	29.892	7879.318	4.849	0.471
identity	480829.333	29.892	16085.775	36.682	0.203
inventory	186758	29.891	6247.915	67.051	2.02
metric	210802.333	29.891	7052.296	19.606	0.646
oddtemplate	435514.333	29.891	14570.036	74.51	0.154
priority	311939.667	29.888	10436.869	15.227	0.571
products	104909.667	29.892	3509.681	12.151	0.404
queens	20443	29.891	683.925	2.043	1.729
tower	12478.333	29.893	417.434	2.07	69.069
trend	11797.667	29.893	394.667	0.237	8.067
union	496354.333	29.891	16605.261	34.186	0.117
xpath	450293.667	29.891	15064.273	64.176	0.201
xslbench1	164946.667	29.885	5519.419	22.61	6.656
alphabetize_db100	7207.667	29.89	241.138	1.236	15.669
attsets_chart	204889.333	29.891	6854.54	24.815	2.559
avts_db100	33637.333	29.889	1125.408	8.554	11.568
backwards_game	93919	29.892	3141.963	10.667	2.617
creation_db100	21099.667	29.891	705.886	3.407	30.416
dbonerow_db10000	371	29.999	12.367	0.092	0.886
dbtail_db100	45519.333	29.891	1522.856	10.754	5.038
decoy_db100	15051.333	29.89	503.564	1.412	19.745
encrypt_db100	13081.667	29.892	437.625	0.377	19.674
find_breadth	138961	29.891	4648.914	16.802	2.007
find_depth	126171.333	29.891	4221.003	32.189	3.735
functions_db100	10320	29.892	345.242	0.374	6.184
identity_db1000	3096.333	29.898	103.563	0.621	196.264
patterns_db100	25633	29.892	857.534	5.657	19.745
prettyprint_db100	5437	29.892	181.887	0.771	140.511
reverser_gettysburg	180701.333	29.891	6045.33	12.625	1.293
stringsort_db1000	2562.667	29.898	85.714	0.608	193.333
summarize_queensXsl	89253.667	29.891	2985.947	3.601	0.293
total_chart	264029.333	29.889	8833.654	7.333	0.337
xslbench2_xslbenchdream	6889.667	29.891	230.493	6.97	106.963
xslbench3_xslbenchdream	8588	29.892	287.298	11.209	1.26

Results Per Test

Generated using Japex version 1.1.7