Compare commits

Home / Compare 672c14a5 .. ef319667

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.729
σ0.851
min35.921
max38.442
mean3940.000
σ0.000
min3940.000
max3940.000
mean0.076
σ0.001
min0.075
max0.080
cache=y
dps=1
iters=10
policies=100
mean26.712
σ0.645
min26.211
max27.464
mean3940.000
σ0.000
min3940.000
max3940.000
mean0.061
σ0.000
min0.060
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1755.311=1.056
σ0.374-0.367=0.007
min1755.791-1754.736=1.055
max1756.967-1755.901=1.066
mean1656.300-1646.750=9.550
σ627.183-620.566=6.617
min683.000-653.000=30.000
max2606.000-2651.000=-45.000
mean2.278-2.283=-0.005
σ0.161-0.144=0.016
min2.119-2.161=-0.042
max2.787-2.774=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.694-277.698=0.997
σ0.014-0.012=0.002
min278.682-277.684=0.998
max278.718-277.711=1.007
mean2606.000-2651.000=-45.000
σ0.000
min2606.000-2651.000=-45.000
max2606.000-2651.000=-45.000
mean0.417-0.408=0.009
σ0.002-0.001=0.001
min0.415-0.407=0.008
max0.421-0.409=0.012
iters=5
new-facts=1
prior-facts=6402
mean2268.873-2267.873=1.001
σ0.007-0.006=0.001
min2268.865-2267.866=0.999
max2268.883-2267.879=1.004
mean2606.000-2651.000=-45.000
σ0.000
min2606.000-2651.000=-45.000
max2606.000-2651.000=-45.000
mean2.878-3.087=-0.209
σ0.107-0.211=-0.104
min2.742-2.805=-0.063
max3.019-3.359=-0.340
iters=5
new-facts=6402
prior-facts=1
mean4952.325-4951.229=1.096
σ0.892-0.756=0.136
min4951.844-4950.772=1.071
max4953.918-4952.567=1.351
mean2606.000-2651.000=-45.000
σ0.000
min2606.000-2651.000=-45.000
max2606.000-2651.000=-45.000
mean8.156-7.953=0.203
σ0.307-0.333=-0.026
min7.732-7.668=0.063
max8.584-8.489=0.095
iters=5
new-facts=6402
prior-facts=6402
mean5167.013-5165.904=1.108
σ0.145-0.127=0.018
min5166.753-5165.708=1.045
max5167.090-5166.063=1.027
mean3392.400-3391.400=1.000
σ445.064-538.011=-92.947
min2769.000-2912.000=-143.000
max3940.000-4166.000=-226.000
mean9.489-9.300=0.189
σ0.437-0.234=0.203
min9.032-9.025=0.007
max10.071-9.674=0.397

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-1.022=0.162
σ0.188-0.138=0.049
min1.057-0.933=0.124
max1.490-1.251=0.239

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.257-456.317=3.940
σ572.607-572.592=0.015
min173.953-170.018=3.935
max1319.169-1315.205=3.963
mean79.500
σ7.000
min76.000
max90.000
mean437.000-432.500=4.500
σ0.000-0.577=-0.577
min437.000-432.000=5.000
max437.000-433.000=4.000
mean0.546-0.517=0.029
σ0.548-0.499=0.049
min0.266-0.261=0.004
max1.368-1.265=0.102
policies=20
mean1740.029-1700.732=39.297
σ0.322-0.304=0.017
min1739.796-1700.509=39.287
max1740.501-1701.178=39.323
mean760.000
σ0.000
min760.000
max760.000
mean447.250-446.000=1.250
σ10.178-11.804=-1.626
min437.000-433.000=4.000
max456.000
mean2.652-2.616=0.036
σ0.023-0.006=0.017
min2.634-2.610=0.024
max2.686-2.625=0.061
policies=200
mean17409.806-17016.725=393.081
σ0.039-0.058=-0.019
min17409.763-17016.639=393.124
max17409.846-17016.763=393.083
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.750
σ2.754-2.217=0.536
min489.000
max495.000-494.000=1.000
mean26.843-26.353=0.490
σ0.107-0.134=-0.027
min26.730-26.172=0.558
max26.988-26.470=0.518