Compare commits

Home / Compare 278f61bd .. 0ab97a19

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.378=0.002
σ0.047-0.045=0.002
min70.350-70.350=0.000
max70.511-70.504=0.007
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.161-0.156=0.005
σ0.003-0.005=-0.002
min0.157-0.151=0.006
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.002-0.003=-0.001
min21.140-21.139=0.000
max21.147-21.149=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.060=0.005
σ0.002-0.002=-0.000
min0.063-0.058=0.006
max0.070-0.066=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.385-1752.385=0.000
σ0.363-0.363=0.001
min1751.818-1751.826=-0.009
max1752.975-1752.956=0.019
mean1638.550-1640.300=-1.750
σ603.622-617.921=-14.299
min633.000-631.000=2.000
max2431.000-2480.000=-49.000
mean2.765-2.790=-0.025
σ0.184-0.188=-0.004
min2.213-2.266=-0.053
max2.954-2.988=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.133-270.128=0.005
σ0.004-0.007=-0.002
min270.127-270.117=0.010
max270.137-270.135=0.002
mean2431.000-2480.000=-49.000
σ0.000
min2431.000-2480.000=-49.000
max2431.000-2480.000=-49.000
mean0.381-0.379=0.002
σ0.002-0.006=-0.003
min0.378-0.370=0.008
max0.384-0.387=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.592-1930.591=0.002
σ0.012-0.011=0.001
min1930.578-1930.577=0.001
max1930.607-1930.603=0.004
mean2431.000-2480.000=-49.000
σ0.000
min2431.000-2480.000=-49.000
max2431.000-2480.000=-49.000
mean2.610-2.495=0.114
σ0.163-0.034=0.129
min2.451-2.465=-0.014
max2.878-2.550=0.328
iters=5
new-facts=6402
prior-facts=1
mean4750.954-4751.081=-0.127
σ0.629-0.827=-0.197
min4750.478-4750.499=-0.021
max4752.059-4752.543=-0.483
mean2431.000-2480.000=-49.000
σ0.000
min2431.000-2480.000=-49.000
max2431.000-2480.000=-49.000
mean8.650-8.529=0.121
σ0.526-0.573=-0.047
min7.810-7.597=0.213
max9.076-9.093=-0.017
iters=5
new-facts=6402
prior-facts=6402
mean4941.540-4941.463=0.077
σ0.082-0.211=-0.128
min4941.469-4941.118=0.351
max4941.630-4941.636=-0.006
mean2993.800-2985.200=8.600
σ437.182-284.083=153.098
min2431.000-2596.000=-165.000
max3561.000-3321.000=240.000
mean8.711-8.550=0.161
σ0.272-0.211=0.061
min8.542-8.392=0.150
max9.191-8.820=0.371

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.774-1.809=-0.035
σ0.074-0.175=-0.101
min1.681-1.608=0.073
max1.887-1.976=-0.089

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.361-466.363=-0.002
σ575.933-575.931=0.003
min178.390-178.394=-0.004
max1330.261-1330.259=0.002
mean84.000
σ8.000
min80.000
max96.000
mean2431.000-2480.000=-49.000
σ0.000
min2431.000-2480.000=-49.000
max2431.000-2480.000=-49.000
mean0.554-0.566=-0.012
σ0.546-0.566=-0.020
min0.278-0.279=-0.001
max1.373-1.415=-0.043
policies=20
mean1784.224-1784.219=0.005
σ0.357-0.345=0.011
min1783.999-1783.998=0.001
max1784.755-1784.733=0.022
mean800.000
σ0.000
min800.000
max800.000
mean2431.000-2480.000=-49.000
σ0.000
min2431.000-2480.000=-49.000
max2431.000-2480.000=-49.000
mean2.772-2.777=-0.005
σ0.014-0.019=-0.005
min2.760-2.752=0.008
max2.792-2.799=-0.007
policies=200
mean17848.606-17848.893=-0.287
σ0.773-0.495=0.279
min17847.744-17848.618=-0.873
max17849.621-17849.634=-0.014
mean8000.000
σ0.000
min8000.000
max8000.000
mean2431.000-2480.000=-49.000
σ0.000
min2431.000-2480.000=-49.000
max2431.000-2480.000=-49.000
mean27.923-27.952=-0.029
σ0.087-0.106=-0.018
min27.846-27.815=0.031
max28.029-28.051=-0.023