Compare commits

Home / Compare 1afef4d5 .. d56dc46e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.780=0.001
σ0.051-0.050=0.001
min70.754-70.751=0.002
max70.926-70.921=0.005
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.155=0.005
σ0.003-0.004=-0.000
min0.153-0.150=0.003
max0.165-0.160=0.004
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.000
σ0.003-0.003=0.000
min21.489-21.490=-0.001
max21.499-21.497=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.066-0.062=0.004
σ0.002-0.003=-0.001
min0.064-0.059=0.005
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.883-1751.880=0.003
σ0.360-0.361=-0.000
min1751.317-1751.316=0.001
max1752.464-1752.462=0.002
mean1657.150-1654.900=2.250
σ647.523-627.399=20.125
min619.000-680.000=-61.000
max2733.000-2663.000=70.000
mean2.888-2.830=0.058
σ0.232-0.183=0.049
min2.262-2.402=-0.140
max3.201-3.067=0.134

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.382-269.385=-0.003
σ0.007-0.006=0.001
min269.372-269.378=-0.006
max269.390-269.393=-0.003
mean2733.000-2663.000=70.000
σ0.000
min2733.000-2663.000=70.000
max2733.000-2663.000=70.000
mean0.378-0.380=-0.002
σ0.004-0.006=-0.001
min0.375-0.377=-0.002
max0.385-0.390=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1929.755-1929.750=0.005
σ0.011-0.017=-0.006
min1929.739-1929.729=0.009
max1929.763-1929.772=-0.009
mean2733.000-2663.000=70.000
σ0.000
min2733.000-2663.000=70.000
max2733.000-2663.000=70.000
mean3.023-2.940=0.083
σ0.323-0.303=0.021
min2.507-2.406=0.100
max3.403-3.135=0.268
iters=5
new-facts=6402
prior-facts=1
mean4750.486-4750.398=0.088
σ0.888-0.961=-0.073
min4750.048-4749.465=0.583
max4752.074-4752.028=0.047
mean2733.000-2663.000=70.000
σ0.000
min2733.000-2663.000=70.000
max2733.000-2663.000=70.000
mean8.635-8.544=0.092
σ0.327-0.295=0.032
min8.136-8.316=-0.180
max8.934-9.013=-0.079
iters=5
new-facts=6402
prior-facts=6402
mean4940.847-4940.992=-0.145
σ0.182-0.020=0.162
min4940.641-4940.964=-0.323
max4941.002-4941.014=-0.012
mean2998.400-2980.600=17.800
σ316.564-254.502=62.062
min2733.000-2663.000=70.000
max3474.000-3332.000=142.000
mean8.498-8.629=-0.131
σ0.123-0.388=-0.265
min8.415-8.400=0.016
max8.711-9.319=-0.608

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.077=-0.076
σ0.126-0.182=-0.057
min0.943-0.942=0.001
max1.226-1.296=-0.071

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.700-462.700=0.001
σ574.923-574.939=-0.016
min175.230-175.221=0.008
max1325.085-1325.108=-0.023
mean86.250
σ8.500
min82.000
max99.000
mean2733.000-2663.000=70.000
σ0.000
min2733.000-2663.000=70.000
max2733.000-2663.000=70.000
mean0.549-0.572=-0.022
σ0.548-0.597=-0.049
min0.272-0.258=0.014
max1.371-1.467=-0.096
policies=20
mean1752.534-1752.488=0.045
σ0.359-0.376=-0.017
min1752.321-1752.251=0.070
max1753.071-1753.049=0.022
mean820.000
σ0.000
min820.000
max820.000
mean2733.000-2663.000=70.000
σ0.000
min2733.000-2663.000=70.000
max2733.000-2663.000=70.000
mean2.747-2.752=-0.005
σ0.012-0.013=-0.001
min2.737-2.735=0.002
max2.763-2.767=-0.004
policies=200
mean17532.376-17532.202=0.174
σ0.344-0.423=-0.079
min17532.151-17531.856=0.295
max17532.888-17532.810=0.078
mean8200.000
σ0.000
min8200.000
max8200.000
mean2733.000-2663.000=70.000
σ0.000
min2733.000-2663.000=70.000
max2733.000-2663.000=70.000
mean27.682-27.787=-0.105
σ0.077-0.173=-0.096
min27.587-27.621=-0.034
max27.771-28.020=-0.249