Compare commits

Home / Compare 10ae31fb .. 382cfa61

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.957=-0.000
σ0.104-0.103=0.000
min35.915-35.915=0.000
max36.251-36.250=0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.076-0.078=-0.002
σ0.003-0.004=-0.001
min0.074-0.075=-0.001
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.204-26.202=0.001
σ0.004-0.005=-0.001
min26.197-26.196=0.001
max26.209-26.211=-0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.061-0.060=0.001
σ0.003-0.004=-0.002
min0.059-0.057=0.003
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.306-1756.303=0.003
σ0.369-0.369=-0.001
min1755.728-1755.728=0.000
max1756.897-1756.900=-0.002
mean1661.150-1679.950=-18.800
σ631.179-639.339=-8.159
min616.000-680.000=-64.000
max2730.000-2700.000=30.000
mean2.397-2.375=0.022
σ0.096-0.072=0.025
min2.301-2.283=0.018
max2.610-2.536=0.074

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.828-278.827=0.001
σ0.005-0.005=-0.001
min278.822-278.818=0.004
max278.834-278.832=0.002
mean2730.000-2700.000=30.000
σ0.000
min2730.000-2700.000=30.000
max2730.000-2700.000=30.000
mean0.418-0.410=0.008
σ0.007-0.006=0.001
min0.408-0.406=0.002
max0.426-0.418=0.009
iters=5
new-facts=1
prior-facts=6402
mean2268.888-2268.878=0.010
σ0.011-0.019=-0.007
min2268.878-2268.846=0.032
max2268.907-2268.892=0.015
mean2730.000-2700.000=30.000
σ0.000
min2730.000-2700.000=30.000
max2730.000-2700.000=30.000
mean3.125-2.936=0.189
σ0.132-0.097=0.035
min2.960-2.842=0.118
max3.239-3.099=0.140
iters=5
new-facts=6402
prior-facts=1
mean4954.173-4954.028=0.145
σ1.051-1.095=-0.044
min4953.106-4953.163=-0.057
max4955.933-4955.881=0.052
mean2730.000-2700.000=30.000
σ0.000
min2730.000-2700.000=30.000
max2730.000-2700.000=30.000
mean8.013-8.077=-0.064
σ0.334-0.273=0.061
min7.740-7.671=0.069
max8.584-8.382=0.202
iters=5
new-facts=6402
prior-facts=6402
mean5168.759-5168.823=-0.064
σ0.140-0.086=0.055
min5168.556-5168.724=-0.168
max5168.896-5168.893=0.003
mean3429.200-3450.600=-21.400
σ503.364-482.687=20.677
min2837.000-2807.000=30.000
max4171.000-4072.000=99.000
mean9.547-9.177=0.371
σ0.173-0.262=-0.089
min9.346-8.848=0.498
max9.798-9.473=0.324

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.042-1.157=-0.116
σ0.159-0.243=-0.084
min0.933-0.939=-0.006
max1.308-1.479=-0.171

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.817-459.817=0.000
σ571.590-571.586=0.003
min174.020-174.017=0.003
max1317.201-1317.196=0.005
mean79.500
σ7.000
min76.000
max90.000
mean2730.000-2700.000=30.000
σ0.000
min2730.000-2700.000=30.000
max2730.000-2700.000=30.000
mean0.525-0.540=-0.014
σ0.505-0.546=-0.041
min0.270-0.265=0.005
max1.282-1.358=-0.076
policies=20
mean1740.406-1740.408=-0.002
σ0.309-0.315=-0.007
min1740.232-1740.204=0.028
max1740.868-1740.878=-0.010
mean760.000
σ0.000
min760.000
max760.000
mean2730.000-2700.000=30.000
σ0.000
min2730.000-2700.000=30.000
max2730.000-2700.000=30.000
mean2.684-2.684=-0.000
σ0.021-0.011=0.010
min2.656-2.675=-0.019
max2.705-2.699=0.006
policies=200
mean17411.180-17411.265=-0.086
σ0.545-0.489=0.056
min17410.865-17410.965=-0.101
max17411.993-17411.995=-0.003
mean7600.000
σ0.000
min7600.000
max7600.000
mean2730.000-2700.000=30.000
σ0.000
min2730.000-2700.000=30.000
max2730.000-2700.000=30.000
mean27.076-27.039=0.038
σ0.033-0.039=-0.006
min27.032-26.996=0.036
max27.110-27.076=0.034