Compare commits

Home / Compare 474d34a8 .. d56839e7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.974=0.000
σ0.107-0.106=0.001
min35.925-35.930=-0.004
max36.277-36.275=0.003
mean416.000
σ0.000
min416.000
max416.000
mean0.076-0.077=-0.001
σ0.004-0.004=0.000
min0.071-0.074=-0.003
max0.085-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.207-26.208=-0.000
σ0.003-0.004=-0.001
min26.201-26.202=-0.001
max26.212-26.214=-0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.061-0.061=-0.000
σ0.004-0.003=0.001
min0.056-0.059=-0.003
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.376-1758.377=-0.001
σ0.370-0.371=-0.001
min1757.798-1757.799=-0.001
max1758.951-1758.973=-0.022
mean1638.550-1658.600=-20.050
σ618.149-620.160=-2.011
min671.000-688.000=-17.000
max2753.000-2741.000=12.000
mean2.413-2.392=0.022
σ0.157-0.143=0.014
min2.280-2.262=0.019
max2.989-2.864=0.124

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.542-279.542=-0.001
σ0.007-0.010=-0.003
min279.534-279.529=0.005
max279.553-279.555=-0.003
mean2753.000-2741.000=12.000
σ0.000
min2753.000-2741.000=12.000
max2753.000-2741.000=12.000
mean0.407-0.412=-0.005
σ0.005-0.006=-0.002
min0.404-0.405=-0.001
max0.415-0.420=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2178.458-2178.452=0.006
σ0.022-0.035=-0.013
min2178.426-2178.404=0.022
max2178.485-2178.492=-0.008
mean2753.000-2741.000=12.000
σ0.000
min2753.000-2741.000=12.000
max2753.000-2741.000=12.000
mean3.323-3.311=0.011
σ0.097-0.174=-0.077
min3.232-3.091=0.142
max3.459-3.561=-0.102
iters=5
new-facts=6402
prior-facts=1
mean5056.412-5056.368=0.044
σ0.995-0.916=0.079
min5055.793-5055.834=-0.041
max5058.181-5057.994=0.186
mean2753.000-2741.000=12.000
σ0.000
min2753.000-2741.000=12.000
max2753.000-2741.000=12.000
mean8.902-8.701=0.201
σ0.671-0.407=0.264
min8.141-8.071=0.070
max9.739-9.138=0.601
iters=5
new-facts=6402
prior-facts=6402
mean5193.769-5193.710=0.059
σ0.097-0.210=-0.113
min5193.681-5193.366=0.315
max5193.891-5193.884=0.008
mean3290.000-3226.000=64.000
σ456.657-353.971=102.686
min2753.000-2841.000=-88.000
max3922.000-3760.000=162.000
mean8.933-8.723=0.211
σ0.107-0.069=0.038
min8.846-8.630=0.216
max9.116-8.814=0.303

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.008-0.999=0.009
σ0.070-0.137=-0.067
min0.947-0.934=0.012
max1.093-1.244=-0.151

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.548-465.533=0.015
σ572.684-572.656=0.028
min179.195-179.199=-0.004
max1324.574-1324.516=0.058
mean79.500
σ7.000
min76.000
max90.000
mean2753.000-2741.000=12.000
σ0.000
min2753.000-2741.000=12.000
max2753.000-2741.000=12.000
mean0.565-0.470=0.095
σ0.560-0.378=0.182
min0.282-0.279=0.003
max1.405-1.037=0.369
policies=20
mean1792.278-1792.304=-0.026
σ0.351-0.326=0.025
min1792.057-1792.112=-0.056
max1792.801-1792.791=0.010
mean760.000
σ0.000
min760.000
max760.000
mean2753.000-2741.000=12.000
σ0.000
min2753.000-2741.000=12.000
max2753.000-2741.000=12.000
mean2.793-2.796=-0.002
σ0.008-0.016=-0.008
min2.785-2.779=0.006
max2.801-2.815=-0.014
policies=200
mean17929.565-17929.430=0.135
σ0.499-0.583=-0.084
min17929.289-17929.114=0.175
max17930.313-17930.304=0.009
mean7600.000
σ0.000
min7600.000
max7600.000
mean2753.000-2741.000=12.000
σ0.000
min2753.000-2741.000=12.000
max2753.000-2741.000=12.000
mean28.202-28.139=0.062
σ0.080-0.124=-0.044
min28.114-28.005=0.109
max28.278-28.247=0.031