Compare commits

Home / Compare d1212150 .. 876eefed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=0.000
σ0.054-0.054=0.000
min35.238-35.231=0.007
max35.415-35.414=0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.084-0.085=-0.001
σ0.005-0.003=0.002
min0.078-0.083=-0.005
max0.093-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.003-0.005=-0.002
min23.766-23.766=-0.000
max23.775-23.782=-0.007
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.069=-0.004
σ0.002-0.004=-0.002
min0.061-0.066=-0.004
max0.067-0.077=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.468-1756.469=-0.001
σ0.368-0.366=0.002
min1755.896-1755.895=0.001
max1757.064-1757.041=0.022
mean1656.550-1658.400=-1.850
σ637.000-642.286=-5.285
min677.000-630.000=47.000
max2843.000-2798.000=45.000
mean2.325-2.340=-0.014
σ0.107-0.109=-0.002
min2.131-2.235=-0.104
max2.583-2.617=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.690-324.706=-0.016
σ0.051-0.022=0.029
min324.599-324.669=-0.070
max324.720-324.723=-0.003
mean2843.000-2798.000=45.000
σ0.000
min2843.000-2798.000=45.000
max2843.000-2798.000=45.000
mean0.424-0.427=-0.003
σ0.003-0.008=-0.005
min0.421-0.422=-0.001
max0.429-0.442=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.257-1985.249=0.008
σ0.005-0.015=-0.009
min1985.251-1985.225=0.026
max1985.263-1985.260=0.003
mean2843.000-2798.000=45.000
σ0.000
min2843.000-2798.000=45.000
max2843.000-2798.000=45.000
mean2.581-2.625=-0.044
σ0.074-0.090=-0.017
min2.494-2.554=-0.060
max2.671-2.754=-0.083
iters=5
new-facts=6402
prior-facts=1
mean4808.873-4808.855=0.019
σ7.625-7.716=-0.091
min4805.391-4805.382=0.009
max4822.513-4822.658=-0.145
mean2843.000-2798.000=45.000
σ0.000
min2843.000-2798.000=45.000
max2843.000-2798.000=45.000
mean9.066-9.044=0.022
σ0.348-0.186=0.161
min8.518-8.843=-0.325
max9.473-9.291=0.181
iters=5
new-facts=6402
prior-facts=6402
mean4996.398-4996.450=-0.052
σ0.140-0.017=0.123
min4996.150-4996.429=-0.279
max4996.477-4996.467=0.010
mean3051.600-3042.200=9.400
σ191.680-309.942=-118.262
min2843.000-2798.000=45.000
max3330.000-3512.000=-182.000
mean8.661-8.575=0.086
σ0.192-0.114=0.078
min8.472-8.485=-0.013
max8.889-8.763=0.126

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.036-0.945=0.091
σ0.164-0.054=0.110
min0.913-0.914=-0.002
max1.230-1.040=0.190

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.951-462.952=-0.001
σ574.253-574.254=-0.001
min175.816-175.814=0.003
max1324.331-1324.333=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2798.000=45.000
σ0.000
min2843.000-2798.000=45.000
max2843.000-2798.000=45.000
mean0.435-0.429=0.006
σ0.300-0.295=0.005
min0.282-0.279=0.004
max0.885-0.871=0.014
policies=20
mean1758.489-1758.473=0.015
σ0.351-0.354=-0.003
min1758.234-1758.229=0.005
max1759.004-1758.997=0.007
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2798.000=45.000
σ0.000
min2843.000-2798.000=45.000
max2843.000-2798.000=45.000
mean2.797-2.839=-0.042
σ0.019-0.091=-0.072
min2.774-2.788=-0.014
max2.819-2.975=-0.156
policies=200
mean17591.085-17590.102=0.983
σ0.662-0.459=0.203
min17590.274-17589.752=0.521
max17591.638-17590.778=0.860
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2798.000=45.000
σ0.000
min2843.000-2798.000=45.000
max2843.000-2798.000=45.000
mean27.941-27.425=0.516
σ0.288-0.150=0.138
min27.672-27.261=0.410
max28.294-27.566=0.727