Compare commits

Home / Compare 7b2a710a .. cb84e901

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.728
σ0.613
min35.928
max37.216
mean3972.000
σ0.000
min3972.000
max3972.000
mean0.076
σ0.001
min0.075
max0.078
cache=y
dps=1
iters=10
policies=100
mean26.712
σ0.646
min26.208
max27.468
mean3972.000
σ0.000
min3972.000
max3972.000
mean0.061
σ0.001
min0.060
max0.062

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1756.306=0.060
σ0.373-0.368=0.005
min1755.794-1755.738=0.056
max1756.968-1756.904=0.065
mean1657.300-1646.200=11.100
σ629.903-619.669=10.234
min681.000-616.000=65.000
max2612.000-2693.000=-81.000
mean2.275-2.277=-0.002
σ0.163-0.135=0.028
min2.084-2.157=-0.072
max2.802-2.607=0.194

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.696-278.695=0.001
σ0.014-0.013=0.000
min278.682-278.679=0.002
max278.718-278.712=0.006
mean2612.000-2693.000=-81.000
σ0.000
min2612.000-2693.000=-81.000
max2612.000-2693.000=-81.000
mean0.416-0.420=-0.004
σ0.001-0.001=0.000
min0.415-0.420=-0.004
max0.417-0.421=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2268.868-2268.842=0.026
σ0.006-0.020=-0.014
min2268.860-2268.824=0.036
max2268.873-2268.865=0.008
mean2612.000-2693.000=-81.000
σ0.000
min2612.000-2693.000=-81.000
max2612.000-2693.000=-81.000
mean2.971-3.592=-0.621
σ0.075-0.160=-0.085
min2.925-3.462=-0.537
max3.104-3.770=-0.666
iters=5
new-facts=6402
prior-facts=1
mean4952.192-4955.943=-3.751
σ0.987-0.915=0.072
min4951.402-4955.190=-3.787
max4953.910-4957.537=-3.626
mean2612.000-2693.000=-81.000
σ0.000
min2612.000-2693.000=-81.000
max2612.000-2693.000=-81.000
mean8.267-7.891=0.376
σ0.461-0.228=0.233
min7.854-7.701=0.153
max8.915-8.236=0.679
iters=5
new-facts=6402
prior-facts=6402
mean5166.938-5170.771=-3.833
σ0.195-0.073=0.122
min5166.714-5170.674=-3.960
max5167.088-5170.827=-3.740
mean3416.200-3365.400=50.800
σ447.098-464.021=-16.923
min2808.000-2756.000=52.000
max3972.000-3984.000=-12.000
mean9.194-9.203=-0.009
σ0.370-0.392=-0.022
min8.764-8.740=0.024
max9.685-9.720=-0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.060=-0.035
σ0.129-0.126=0.003
min0.941-0.944=-0.004
max1.238-1.252=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.260-460.255=0.005
σ572.608-572.608=0.000
min173.953-173.950=0.003
max1319.172-1319.166=0.005
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.564-0.552=0.012
σ0.585-0.548=0.037
min0.264-0.268=-0.004
max1.442-1.375=0.067
policies=20
mean1740.060-1740.005=0.055
σ0.328-0.339=-0.012
min1739.833-1739.770=0.063
max1740.542-1740.503=0.039
mean760.000
σ0.000
min760.000
max760.000
mean444.500-447.500=-3.000
σ8.813-9.950=-1.137
min435.000-437.000=-2.000
max452.000-456.000=-4.000
mean2.665-2.679=-0.014
σ0.018-0.033=-0.015
min2.649-2.640=0.010
max2.690-2.721=-0.031
policies=200
mean17409.916-17409.378=0.538
σ0.066-0.075=-0.010
min17409.819-17409.288=0.530
max17409.959-17409.450=0.509
mean7600.000
σ0.000
min7600.000
max7600.000
mean488.500-491.250=-2.750
σ2.517-2.630=-0.113
min485.000-489.000=-4.000
max491.000-495.000=-4.000
mean26.843-26.983=-0.140
σ0.051-0.109=-0.058
min26.778-26.866=-0.087
max26.901-27.120=-0.220