Compare commits

Home / Compare 814e382f .. 44528eb0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=0.000
σ0.370-0.371=-0.001
min53.871-53.868=0.003
max55.068-55.070=-0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.140-0.139=0.001
σ0.004-0.004=0.000
min0.137-0.135=0.002
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.008-0.006=0.002
min43.309-43.310=-0.000
max43.341-43.332=0.009
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.124-0.117=0.007
σ0.003-0.003=0.000
min0.121-0.114=0.008
max0.130-0.121=0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.309=-0.004
σ1.192-1.169=0.023
min1005.768-1005.741=0.027
max1011.305-1011.207=0.098
mean1052.900-1056.450=-3.550
σ307.306-303.674=3.633
min585.000-597.000=-12.000
max1644.000-1455.000=189.000
mean1.555-1.556=-0.001
σ0.092-0.088=0.004
min1.463-1.460=0.002
max1.798-1.760=0.037

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866-0.866=-0.000
σ0.003-0.003=-0.000
min0.864
max0.869
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean0.428-0.420=0.008
σ0.125-0.163=-0.039
min0.330-0.334=-0.003
max0.638-0.711=-0.073
name=error_case.art
mean2.337-2.338=-0.000
σ0.003-0.003=-0.000
min2.336
max2.341-2.341=-0.000
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean0.877-0.917=-0.041
σ0.092-0.160=-0.068
min0.817-0.821=-0.004
max1.039-1.201=-0.162
name=heavy_item.art
mean1.523-1.524=-0.000
σ0.002-0.002=-0.000
min1.522
max1.526-1.527=-0.001
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean0.549-0.554=-0.005
σ0.043-0.040=0.003
min0.516-0.529=-0.013
max0.622-0.623=-0.001
name=nested_use.art
mean2.360-2.360=0.000
σ0.003-0.002=0.001
min2.359
max2.365-2.363=0.002
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean0.841-0.840=0.002
σ0.037-0.045=-0.008
min0.809-0.793=0.016
max0.902-0.914=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.097=0.016
σ0.034-0.024=0.010
min964.085-964.077=0.007
max964.171-964.136=0.035
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean0.847-0.801=0.046
σ0.016-0.027=-0.011
min0.819-0.759=0.061
max0.861-0.828=0.033
name=cdr_enhanced_4k_loc.art
mean884.711-884.709=0.002
σ0.008-0.005=0.003
min884.703
max884.722-884.714=0.007
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean0.706-0.714=-0.008
σ0.049-0.024=0.025
min0.640-0.679=-0.039
max0.758-0.740=0.018

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.720=-0.003
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean4.228-4.290=-0.062
σ0.067-0.093=-0.026
min4.129-4.116=0.013
max4.470-4.617=-0.147
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean4.231-4.273=-0.041
σ0.073-0.089=-0.016
min4.075-3.961=0.114
max4.517-4.532=-0.016
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean0.734-0.750=-0.016
σ0.021-0.018=0.003
min0.698-0.721=-0.023
max0.870-0.868=0.002
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean0.695-0.718=-0.024
σ0.018-0.016=0.001
min0.599-0.693=-0.094
max0.760-0.799=-0.039

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.983-296.197=-0.214
σ0.248-0.195=0.053
min295.856-296.042=-0.186
max296.675-296.697=-0.022
mean1911.000-1912.000=-1.000
σ0.000
min1911.000-1912.000=-1.000
max1911.000-1912.000=-1.000
mean0.572-0.587=-0.015
σ0.051-0.042=0.008
min0.512-0.527=-0.015
max0.698-0.680=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.702-284.696=0.006
σ0.036-0.039=-0.002
min284.651-284.643=0.008
max284.737-284.736=0.000
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean0.399-0.393=0.006
σ0.008-0.008=0.000
min0.388-0.384=0.005
max0.406-0.404=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.078-1295.100=-0.022
σ0.109-0.072=0.037
min1294.952-1295.010=-0.058
max1295.210-1295.175=0.035
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean1.936-2.085=-0.149
σ0.118-0.064=0.054
min1.847-2.007=-0.160
max2.142-2.150=-0.008
iters=5
new-facts=6402
prior-facts=1
mean1539.195-1539.249=-0.054
σ6.869-6.813=0.055
min1535.918-1536.041=-0.123
max1551.477-1551.433=0.044
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean2.222-2.370=-0.149
σ0.189-0.172=0.017
min2.047-2.174=-0.127
max2.525-2.612=-0.087
iters=5
new-facts=6402
prior-facts=6402
mean1856.975-1856.971=0.004
σ0.059-0.079=-0.020
min1856.929-1856.854=0.075
max1857.064-1857.050=0.015
mean1773.600-1741.000=32.600
σ133.161-180.795=-47.635
min1644.000-1492.000=152.000
max1911.000-1912.000=-1.000
mean3.052-3.197=-0.145
σ0.221-0.320=-0.099
min2.873-2.831=0.041
max3.421-3.599=-0.177

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.700=-0.510
σ0.284-0.203=0.081
min0.930-1.422=-0.492
max1.654-1.879=-0.224

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.785=0.000
σ581.213-581.213=-0.000
min157.176-157.176=-0.001
max1319.604-1319.604=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean0.527-0.562=-0.035
σ0.540-0.604=-0.063
min0.254-0.258=-0.004
max1.337-1.467=-0.130
policies=20
mean1572.107-1572.097=0.010
σ0.363-0.365=-0.002
min1571.863-1571.853=0.010
max1572.646-1572.639=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean2.628-2.629=-0.001
σ0.015-0.013=0.002
min2.612-2.617=-0.005
max2.647-2.647=-0.000
policies=200
mean15729.093-15729.005=0.088
σ0.069-0.086=-0.016
min15729.043-15728.883=0.161
max15729.193-15729.069=0.124
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1455.000=189.000
σ0.000
min1644.000-1455.000=189.000
max1644.000-1455.000=189.000
mean26.585-26.472=0.113
σ0.095-0.052=0.043
min26.490-26.431=0.059
max26.695-26.548=0.147