Compare commits

Home / Compare e0b66d36 .. e34ec23b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.000
σ0.054-0.054=0.001
min35.591-35.586=0.005
max35.771-35.769=0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.086-0.080=0.006
σ0.003-0.004=-0.001
min0.083-0.076=0.007
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean24.046-24.046=-0.000
σ0.003-0.004=-0.001
min24.041-24.038=0.003
max24.051-24.051=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.067-0.066=0.001
σ0.001-0.004=-0.003
min0.065-0.061=0.004
max0.068-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.493-1756.491=0.002
σ0.365-0.365=0.000
min1755.916-1755.916=-0.001
max1757.080-1757.079=0.002
mean1626.100-1647.050=-20.950
σ592.413-639.374=-46.961
min651.000-625.000=26.000
max2423.000-2822.000=-399.000
mean2.315-2.328=-0.013
σ0.077-0.075=0.002
min2.231-2.221=0.010
max2.493-2.549=-0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.775-324.766=0.009
σ0.038-0.053=-0.015
min324.707-324.671=0.036
max324.798-324.794=0.004
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean0.429-0.431=-0.002
σ0.008-0.010=-0.002
min0.423-0.423=0.000
max0.441-0.442=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.311-1985.317=-0.006
σ0.013-0.022=-0.009
min1985.299-1985.297=0.003
max1985.328-1985.343=-0.015
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean2.558-2.636=-0.078
σ0.080-0.134=-0.054
min2.477-2.518=-0.041
max2.665-2.812=-0.147
iters=5
new-facts=6402
prior-facts=1
mean4809.118-4809.120=-0.002
σ7.637-7.705=-0.069
min4805.604-4805.573=0.031
max4822.777-4822.903=-0.126
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean8.745-8.833=-0.088
σ0.532-0.473=0.059
min7.986-7.993=-0.007
max9.449-9.127=0.323
iters=5
new-facts=6402
prior-facts=6402
mean4996.631-4996.626=0.005
σ0.021-0.024=-0.003
min4996.606-4996.593=0.013
max4996.654-4996.653=0.001
mean2900.600-3054.400=-153.800
σ403.860-303.324=100.537
min2423.000-2822.000=-399.000
max3448.000-3520.000=-72.000
mean8.488-8.512=-0.024
σ0.121-0.122=-0.001
min8.421-8.410=0.011
max8.703-8.723=-0.020

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.807-0.978=0.829
σ0.045-0.068=-0.023
min1.737-0.921=0.816
max1.861-1.058=0.803

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.199-463.210=-0.011
σ574.759-574.773=-0.014
min175.815-175.814=0.002
max1325.337-1325.369=-0.032
mean86.250
σ8.500
min82.000
max99.000
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean0.548-0.434=0.114
σ0.550-0.301=0.248
min0.272-0.280=-0.008
max1.372-0.886=0.487
policies=20
mean1758.498-1758.505=-0.007
σ0.355-0.353=0.002
min1758.264-1758.269=-0.005
max1759.026-1759.030=-0.004
mean820.000
σ0.000
min820.000
max820.000
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean2.723-2.780=-0.057
σ0.021-0.006=0.015
min2.699-2.771=-0.071
max2.750-2.783=-0.034
policies=200
mean17592.060-17592.135=-0.076
σ0.484-0.487=-0.003
min17591.650-17591.828=-0.178
max17592.761-17592.861=-0.099
mean8200.000
σ0.000
min8200.000
max8200.000
mean2423.000-2822.000=-399.000
σ0.000
min2423.000-2822.000=-399.000
max2423.000-2822.000=-399.000
mean27.497-27.803=-0.305
σ0.157-0.378=-0.221
min27.327-27.465=-0.137
max27.675-28.224=-0.549