Compare commits

Home / Compare cba6286a .. 305b462f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.371-0.369=0.002
min53.869-53.867=0.002
max55.070-55.062=0.007
mean417.700-414.700=3.000
σ0.483
min417.000-414.000=3.000
max418.000-415.000=3.000
mean0.139-0.140=-0.000
σ0.004-0.004=-0.000
min0.136-0.136=-0.000
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.323=0.000
σ0.006-0.006=0.000
min43.312-43.313=-0.001
max43.336-43.332=0.004
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.122-0.117=0.005
σ0.004-0.003=0.001
min0.119-0.114=0.005
max0.129-0.121=0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.305=0.001
σ1.179-1.170=0.009
min1005.768-1005.769=-0.002
max1011.242-1011.208=0.035
mean1048.350-1054.200=-5.850
σ313.433-303.029=10.404
min598.000-595.000=3.000
max1645.000-1451.000=194.000
mean1.548-1.556=-0.008
σ0.082-0.080=0.001
min1.435-1.484=-0.049
max1.776-1.747=0.030

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean0.411-0.413=-0.002
σ0.137-0.125=0.012
min0.335-0.340=-0.004
max0.655-0.635=0.020
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean0.892-0.907=-0.015
σ0.095-0.113=-0.017
min0.829-0.839=-0.010
max1.059-1.105=-0.046
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean0.542-0.541=0.002
σ0.054-0.062=-0.008
min0.505-0.484=0.021
max0.634-0.647=-0.013
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean0.840-0.837=0.002
σ0.027-0.030=-0.003
min0.823-0.814=0.008
max0.887-0.889=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.097=0.018
σ0.032-0.025=0.007
min964.087-964.077=0.010
max964.167-964.138=0.029
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean0.803-0.829=-0.027
σ0.044-0.023=0.022
min0.749-0.798=-0.049
max0.851-0.853=-0.002
name=cdr_enhanced_4k_loc.art
mean884.711-884.710=0.001
σ0.008-0.006=0.002
min884.703
max884.722-884.716=0.006
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean0.722-0.724=-0.002
σ0.027-0.037=-0.010
min0.683-0.659=0.024
max0.754-0.750=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean4.212-4.247=-0.036
σ0.075-0.094=-0.018
min4.057-4.088=-0.032
max4.461-4.587=-0.126
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean4.216-4.228=-0.012
σ0.074-0.073=0.001
min4.085-4.072=0.013
max4.461-4.464=-0.003
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean0.736-0.729=0.006
σ0.019-0.019=-0.000
min0.704-0.697=0.007
max0.858-0.859=-0.001
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean0.694-0.694=0.000
σ0.013-0.025=-0.012
min0.665-0.497=0.168
max0.763-0.779=-0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.142-296.304=-0.162
σ0.222-0.230=-0.008
min295.964-296.136=-0.172
max296.742-296.936=-0.193
mean1903.000-1908.000=-5.000
σ0.000
min1903.000-1908.000=-5.000
max1903.000-1908.000=-5.000
mean0.583-0.576=0.008
σ0.049-0.048=0.001
min0.513-0.514=-0.001
max0.692-0.677=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-284.697=-0.005
σ0.039-0.035=0.004
min284.642-284.652=-0.011
max284.741-284.739=0.002
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean0.398-0.397=0.001
σ0.012-0.010=0.002
min0.383-0.386=-0.002
max0.409-0.405=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.089=-0.012
σ0.107-0.064=0.042
min1294.962-1295.011=-0.049
max1295.210-1295.170=0.040
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean1.923-2.067=-0.144
σ0.101-0.053=0.048
min1.806-2.005=-0.199
max2.025-2.140=-0.116
iters=5
new-facts=6402
prior-facts=1
mean1539.185-1539.174=0.011
σ6.857-6.859=-0.002
min1535.944-1535.937=0.007
max1551.447-1551.439=0.007
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean2.253-2.206=0.046
σ0.225-0.170=0.055
min2.042-1.969=0.073
max2.509-2.377=0.132
iters=5
new-facts=6402
prior-facts=6402
mean1856.990-1856.980=0.010
σ0.052-0.080=-0.028
min1856.940-1856.865=0.075
max1857.063-1857.067=-0.003
mean1772.000-1746.800=25.200
σ128.183-175.252=-47.068
min1645.000-1498.000=147.000
max1903.000-1908.000=-5.000
mean3.075-3.126=-0.051
σ0.274-0.253=0.021
min2.871-2.856=0.014
max3.549-3.497=0.052

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.205-1.757=-0.552
σ0.288-0.091=0.198
min0.947-1.609=-0.661
max1.680-1.851=-0.171

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=0.001
σ581.212-581.213=-0.001
min157.176-157.176=0.001
max1319.604-1319.605=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean0.519-0.550=-0.031
σ0.509-0.579=-0.070
min0.263-0.259=0.003
max1.282-1.418=-0.136
policies=20
mean1572.104-1572.099=0.006
σ0.360-0.355=0.005
min1571.858-1571.857=0.001
max1572.639-1572.626=0.013
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean2.630-2.623=0.007
σ0.009-0.015=-0.006
min2.622-2.607=0.015
max2.641-2.640=0.001
policies=200
mean15729.098-15729.041=0.057
σ0.115-0.020=0.095
min15729.011-15729.015=-0.004
max15729.264-15729.063=0.201
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1451.000=194.000
σ0.000
min1645.000-1451.000=194.000
max1645.000-1451.000=194.000
mean26.462-26.519=-0.057
σ0.051-0.049=0.002
min26.422-26.461=-0.038
max26.529-26.564=-0.035