Compare commits

Home / Compare 7e13285d .. dab842ed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.046=0.000
σ0.046-0.046=0.000
min73.021-73.023=-0.002
max73.177-73.176=0.001
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.163-0.161=0.002
σ0.004-0.004=0.001
min0.157-0.157=-0.000
max0.170-0.167=0.003
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=-0.001
σ0.002-0.004=-0.002
min23.737-23.736=0.001
max23.743-23.750=-0.007
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.063-0.064=-0.001
σ0.003-0.004=-0.001
min0.060-0.059=0.001
max0.067-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.787=-0.000
σ0.362-0.360=0.002
min1758.212-1758.218=-0.005
max1759.369-1759.353=0.017
mean1623.650-1661.400=-37.750
σ592.505-625.075=-32.570
min625.000-628.000=-3.000
max2412.000-2518.000=-106.000
mean2.819-2.787=0.031
σ0.153-0.189=-0.036
min2.340-2.277=0.063
max3.000-3.019=-0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.011-324.014=-0.003
σ0.056-0.050=0.006
min323.911-323.926=-0.015
max324.043-324.047=-0.004
mean2412.000-2518.000=-106.000
σ0.000
min2412.000-2518.000=-106.000
max2412.000-2518.000=-106.000
mean0.431-0.430=0.001
σ0.004-0.008=-0.003
min0.428-0.422=0.006
max0.439-0.441=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1984.596-1984.593=0.004
σ0.016-0.013=0.002
min1984.570-1984.571=-0.001
max1984.608-1984.605=0.004
mean2412.000-2518.000=-106.000
σ0.000
min2412.000-2518.000=-106.000
max2412.000-2518.000=-106.000
mean2.604-2.633=-0.029
σ0.057-0.189=-0.132
min2.552-2.427=0.124
max2.701-2.921=-0.220
iters=5
new-facts=6402
prior-facts=1
mean4808.159-4808.114=0.045
σ7.833-7.901=-0.068
min4804.155-4804.238=-0.083
max4822.161-4822.243=-0.083
mean2412.000-2518.000=-106.000
σ0.000
min2412.000-2518.000=-106.000
max2412.000-2518.000=-106.000
mean8.692-8.841=-0.149
σ0.442-0.258=0.184
min7.943-8.581=-0.638
max9.054-9.243=-0.189
iters=5
new-facts=6402
prior-facts=6402
mean4995.731-4995.803=-0.071
σ0.161-0.020=0.141
min4995.446-4995.785=-0.339
max4995.824-4995.835=-0.011
mean2973.200-3022.400=-49.200
σ261.993-328.016=-66.023
min2635.000-2575.000=60.000
max3315.000-3328.000=-13.000
mean8.671-8.729=-0.058
σ0.148-0.232=-0.084
min8.522-8.366=0.156
max8.915-9.010=-0.095

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.794-1.660=0.134
σ0.091-0.260=-0.169
min1.673-1.238=0.435
max1.915-1.858=0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.320-468.326=-0.006
σ574.225-574.231=-0.006
min181.203-181.204=-0.001
max1329.657-1329.673=-0.015
mean88.250
σ8.500
min84.000
max101.000
mean2412.000-2518.000=-106.000
σ0.000
min2412.000-2518.000=-106.000
max2412.000-2518.000=-106.000
mean0.563-0.580=-0.017
σ0.555-0.591=-0.036
min0.282-0.283=-0.001
max1.396-1.467=-0.071
policies=20
mean1812.407-1812.408=-0.002
σ0.397-0.394=0.003
min1812.140-1812.142=-0.002
max1812.992-1812.990=0.003
mean840.000
σ0.000
min840.000
max840.000
mean2412.000-2518.000=-106.000
σ0.000
min2412.000-2518.000=-106.000
max2412.000-2518.000=-106.000
mean2.834-2.835=-0.001
σ0.002-0.038=-0.036
min2.831-2.799=0.032
max2.836-2.871=-0.035
policies=200
mean18131.475-18131.483=-0.008
σ0.402-0.440=-0.038
min18131.136-18131.129=0.007
max18132.057-18132.110=-0.052
mean8400.000
σ0.000
min8400.000
max8400.000
mean2412.000-2518.000=-106.000
σ0.000
min2412.000-2518.000=-106.000
max2412.000-2518.000=-106.000
mean28.384-28.289=0.095
σ0.088-0.108=-0.020
min28.270-28.149=0.121
max28.483-28.397=0.086