Compare commits

Home / Compare 469ddc87 .. 5c9b0de1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.030-54.031=-0.000
σ0.368-0.369=-0.001
min53.881-53.881=-0.001
max55.077-55.081=-0.005
mean420.000
σ0.000
min420.000
max420.000
mean0.138-0.139=-0.001
σ0.005-0.005=0.000
min0.130-0.133=-0.002
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.383-43.384=-0.001
σ0.005-0.006=-0.001
min43.376-43.372=0.004
max43.391-43.389=0.002
mean420.000
σ0.000
min420.000
max420.000
mean0.123-0.123=-0.000
σ0.004-0.006=-0.002
min0.119-0.115=0.004
max0.130-0.131=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.334-1006.337=-0.003
σ0.879-0.873=0.006
min1005.830-1005.834=-0.004
max1009.970-1009.942=0.028
mean1053.000-1051.950=1.050
σ311.473-302.599=8.875
min568.000-578.000=-10.000
max1649.000-1639.000=10.000
mean1.566-1.550=0.015
σ0.108-0.058=0.050
min1.383-1.473=-0.090
max1.875-1.682=0.193

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.884=-0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.418-0.421=-0.003
σ0.135-0.133=0.002
min0.332-0.350=-0.018
max0.657-0.659=-0.002
name=error_case.art
mean2.334-2.334=0.000
σ0.003-0.003=-0.000
min2.332
max2.337-2.339=-0.001
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.885-0.891=-0.006
σ0.090-0.086=0.004
min0.827-0.825=0.002
max1.039-1.038=0.002
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.569-0.547=0.022
σ0.064-0.043=0.021
min0.508-0.512=-0.004
max0.654-0.621=0.033
name=nested_use.art
mean2.356-2.356=0.000
σ0.002-0.002=0.000
min2.355
max2.358
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.850-0.846=0.004
σ0.046-0.037=0.009
min0.817-0.818=-0.001
max0.929-0.908=0.020

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.556-963.553=0.003
σ0.030-0.027=0.003
min963.531-963.523=0.008
max963.607-963.592=0.014
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.848-0.836=0.012
σ0.008-0.018=-0.010
min0.838-0.818=0.020
max0.860-0.853=0.006
name=cdr_enhanced_4k_loc.art
mean884.857-884.856=0.001
σ0.004-0.006=-0.001
min884.851-884.847=0.004
max884.861-884.861=0.001
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.729-0.705=0.024
σ0.023-0.033=-0.010
min0.689-0.670=0.019
max0.742-0.738=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.711-7.710=0.000
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean4.233-4.262=-0.029
σ0.076-0.069=0.007
min4.117-4.123=-0.006
max4.507-4.512=-0.005
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean4.214-4.248=-0.034
σ0.078-0.067=0.010
min4.042-4.118=-0.076
max4.479-4.455=0.024
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.749-0.746=0.003
σ0.023-0.017=0.005
min0.717-0.713=0.005
max0.898-0.857=0.040
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.519-0.711=-0.192
σ0.050-0.016=0.034
min0.488-0.668=-0.180
max0.784-0.788=-0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.379-295.375=0.004
σ0.184-0.272=-0.087
min295.235-295.222=0.013
max295.858-296.131=-0.273
mean1905.000-1906.000=-1.000
σ0.000
min1905.000-1906.000=-1.000
max1905.000-1906.000=-1.000
mean0.571-0.580=-0.009
σ0.055-0.045=0.010
min0.494-0.502=-0.008
max0.677-0.637=0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.241-285.250=-0.009
σ0.033-0.041=-0.008
min285.196-285.197=-0.001
max285.282-285.295=-0.013
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.395-0.395=-0.000
σ0.011-0.007=0.004
min0.380-0.384=-0.004
max0.408-0.402=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.200-1295.200=-0.000
σ0.113-0.114=-0.001
min1295.074-1295.073=0.001
max1295.331-1295.340=-0.009
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean1.940-1.915=0.025
σ0.110-0.093=0.017
min1.815-1.818=-0.003
max2.051-2.041=0.010
iters=5
new-facts=6402
prior-facts=1
mean1538.078-1538.082=-0.005
σ4.019-4.023=-0.004
min1536.076-1536.112=-0.036
max1545.257-1545.273=-0.015
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean2.235-2.213=0.022
σ0.153-0.179=-0.026
min2.054-2.038=0.016
max2.412-2.412=-0.000
iters=5
new-facts=6402
prior-facts=6402
mean1857.109-1857.102=0.007
σ0.050-0.054=-0.003
min1857.059-1857.053=0.006
max1857.184-1857.183=0.001
mean1774.800-1775.600=-0.800
σ127.425-130.097=-2.672
min1649.000-1639.000=10.000
max1905.000-1906.000=-1.000
mean3.097-3.102=-0.005
σ0.340-0.378=-0.038
min2.857-2.879=-0.022
max3.695-3.772=-0.077

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.299-1.344=-0.044
σ0.226-0.227=-0.001
min1.103-1.106=-0.003
max1.630-1.721=-0.092

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.609-443.609=0.000
σ577.065-577.065=-0.000
min155.076-155.075=0.001
max1309.206-1309.207=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.549-0.541=0.007
σ0.578-0.562=0.016
min0.258-0.259=-0.001
max1.415-1.384=0.032
policies=20
mean1551.029-1551.025=0.003
σ0.329-0.322=0.008
min1550.804-1550.805=-0.002
max1551.518-1551.503=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean2.594-2.603=-0.009
σ0.007-0.022=-0.015
min2.588-2.589=-0.001
max2.601-2.636=-0.034
policies=200
mean15518.555-15518.390=0.165
σ0.109-0.104=0.005
min15518.425-15518.310=0.115
max15518.686-15518.531=0.155
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean26.168-26.263=-0.095
σ0.125-0.176=-0.051
min26.033-26.121=-0.088
max26.326-26.519=-0.193