Compare commits

Home / Compare afcb83d0 .. 5b738507

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.956=0.001
σ0.103-0.104=-0.000
min35.912-35.913=-0.001
max36.249-36.250=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.076-0.076=0.000
σ0.004-0.005=-0.001
min0.071-0.070=0.001
max0.083-0.083=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.203-26.204=-0.001
σ0.004-0.004=0.001
min26.197-26.198=-0.001
max26.211-26.211=-0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.060-0.060=0.000
σ0.003-0.003=0.000
min0.056-0.057=-0.001
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.303-1756.305=-0.002
σ0.367-0.369=-0.001
min1755.729-1755.729=0.000
max1756.896-1756.899=-0.003
mean1655.000-1653.900=1.100
σ636.645-625.168=11.477
min609.000-611.000=-2.000
max2684.000-2696.000=-12.000
mean2.381-2.369=0.012
σ0.182-0.121=0.061
min2.258-2.259=-0.000
max3.089-2.746=0.343

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.822-278.822=-0.000
σ0.004-0.006=-0.002
min278.817-278.813=0.005
max278.828-278.829=-0.001
mean2684.000-2696.000=-12.000
σ0.000
min2684.000-2696.000=-12.000
max2684.000-2696.000=-12.000
mean0.409-0.415=-0.006
σ0.005-0.012=-0.007
min0.406-0.407=-0.000
max0.418-0.436=-0.018
iters=5
new-facts=1
prior-facts=6402
mean2268.888-2268.896=-0.008
σ0.008-0.013=-0.006
min2268.878-2268.881=-0.003
max2268.898-2268.913=-0.015
mean2684.000-2696.000=-12.000
σ0.000
min2684.000-2696.000=-12.000
max2684.000-2696.000=-12.000
mean2.966-3.207=-0.241
σ0.139-0.130=0.009
min2.891-3.069=-0.178
max3.214-3.359=-0.145
iters=5
new-facts=6402
prior-facts=1
mean4954.293-4954.063=0.230
σ1.023-1.154=-0.131
min4953.577-4952.789=0.788
max4956.100-4955.941=0.159
mean2684.000-2696.000=-12.000
σ0.000
min2684.000-2696.000=-12.000
max2684.000-2696.000=-12.000
mean8.188-8.014=0.174
σ0.711-0.357=0.353
min7.685-7.752=-0.067
max9.409-8.603=0.807
iters=5
new-facts=6402
prior-facts=6402
mean5168.832-5168.821=0.012
σ0.100-0.089=0.011
min5168.721-5168.721=-0.001
max5168.915-5168.888=0.026
mean3441.400-3333.400=108.000
σ455.336-392.528=62.808
min2789.000-2943.000=-154.000
max3975.000-3728.000=247.000
mean9.550-9.238=0.312
σ0.475-0.330=0.145
min9.000-8.949=0.051
max10.237-9.700=0.537

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.231-1.035=0.196
σ0.340-0.135=0.205
min0.940-0.943=-0.003
max1.805-1.253=0.552

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.351-459.820=0.532
σ572.662-571.587=1.075
min174.015-174.021=-0.005
max1319.345-1317.200=2.144
mean79.500
σ7.000
min76.000
max90.000
mean2684.000-2696.000=-12.000
σ0.000
min2684.000-2696.000=-12.000
max2684.000-2696.000=-12.000
mean0.564-0.547=0.016
σ0.575-0.559=0.016
min0.266-0.265=0.001
max1.426-1.386=0.041
policies=20
mean1740.415-1740.425=-0.010
σ0.321-0.318=0.003
min1740.211-1740.219=-0.008
max1740.894-1740.899=-0.005
mean760.000
σ0.000
min760.000
max760.000
mean2684.000-2696.000=-12.000
σ0.000
min2684.000-2696.000=-12.000
max2684.000-2696.000=-12.000
mean2.694-2.686=0.007
σ0.042-0.028=0.015
min2.664-2.669=-0.005
max2.756-2.727=0.029
policies=200
mean17411.238-17411.249=-0.011
σ0.502-0.469=0.033
min17410.886-17410.984=-0.099
max17411.980-17411.951=0.029
mean7600.000
σ0.000
min7600.000
max7600.000
mean2684.000-2696.000=-12.000
σ0.000
min2684.000-2696.000=-12.000
max2684.000-2696.000=-12.000
mean26.948-26.962=-0.014
σ0.113-0.072=0.041
min26.869-26.873=-0.004
max27.112-27.032=0.080