Compare commits

Home / Compare 8e55cf52 .. 95f66762

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.048-0.049=-0.001
min33.951-33.951=-0.001
max34.111-34.114=-0.003
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.083-0.085=-0.002
σ0.005-0.003=0.003
min0.077-0.082=-0.005
max0.095-0.090=0.005
cache=y
dps=1
iters=10
policies=100
mean23.316-23.317=-0.001
σ0.002-0.003=-0.001
min23.313-23.312=0.001
max23.319-23.323=-0.004
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.061-0.065=-0.003
σ0.004-0.004=0.000
min0.059-0.059=-0.001
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.365-1757.304=0.061
σ0.364-0.365=-0.001
min1756.786-1756.728=0.059
max1757.950-1757.891=0.059
mean1665.500-1662.600=2.900
σ627.569-620.488=7.080
min670.000-673.000=-3.000
max2613.000-2591.000=22.000
mean2.340-2.359=-0.019
σ0.109-0.103=0.006
min2.238-2.268=-0.030
max2.648-2.714=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.522-326.448=0.075
σ0.013-0.042=-0.029
min326.502-326.375=0.127
max326.534-326.488=0.046
mean2613.000-2591.000=22.000
σ0.000
min2613.000-2591.000=22.000
max2613.000-2591.000=22.000
mean0.421-0.430=-0.010
σ0.001-0.006=-0.005
min0.419-0.427=-0.007
max0.423-0.442=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1988.681-1988.618=0.062
σ0.013-0.004=0.009
min1988.668-1988.613=0.055
max1988.697-1988.622=0.074
mean2613.000-2591.000=22.000
σ0.000
min2613.000-2591.000=22.000
max2613.000-2591.000=22.000
mean2.673-2.735=-0.062
σ0.084-0.206=-0.122
min2.560-2.570=-0.010
max2.773-3.093=-0.320
iters=5
new-facts=6402
prior-facts=1
mean4813.415-4813.457=-0.043
σ7.817-7.752=0.065
min4809.489-4809.912=-0.423
max4827.391-4827.325=0.066
mean2613.000-2591.000=22.000
σ0.000
min2613.000-2591.000=22.000
max2613.000-2591.000=22.000
mean8.875-8.610=0.265
σ0.511-0.550=-0.039
min8.409-7.847=0.563
max9.623-9.395=0.228
iters=5
new-facts=6402
prior-facts=6402
mean5001.073-5001.010=0.063
σ0.027-0.019=0.007
min5001.043-5000.990=0.053
max5001.106-5001.037=0.070
mean3018.800-2947.400=71.400
σ291.726-360.576=-68.850
min2613.000-2591.000=22.000
max3394.000-3423.000=-29.000
mean9.660-9.647=0.013
σ0.287-0.179=0.107
min9.198-9.362=-0.165
max9.924-9.811=0.113

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.203-1.257=-0.054
σ0.357-0.399=-0.042
min0.905-0.917=-0.012
max1.781-1.745=0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.505-464.437=0.067
σ574.779-574.792=-0.013
min177.109-177.037=0.072
max1326.673-1326.626=0.047
mean88.250
σ8.500
min84.000
max101.000
mean2613.000-2591.000=22.000
σ0.000
min2613.000-2591.000=22.000
max2613.000-2591.000=22.000
mean0.559-0.549=0.010
σ0.569-0.548=0.022
min0.273-0.272=0.000
max1.413-1.370=0.043
policies=20
mean1771.375-1770.764=0.612
σ0.355-0.368=-0.012
min1771.139-1770.524=0.615
max1771.903-1771.310=0.593
mean840.000
σ0.000
min840.000
max840.000
mean2613.000-2591.000=22.000
σ0.000
min2613.000-2591.000=22.000
max2613.000-2591.000=22.000
mean2.717-2.741=-0.024
σ0.027-0.008=0.019
min2.692-2.733=-0.041
max2.754-2.750=0.004
policies=200
mean17721.000-17714.923=6.077
σ0.424-0.510=-0.086
min17720.671-17714.608=6.063
max17721.621-17715.683=5.937
mean8400.000
σ0.000
min8400.000
max8400.000
mean2613.000-2591.000=22.000
σ0.000
min2613.000-2591.000=22.000
max2613.000-2591.000=22.000
mean27.461-27.555=-0.094
σ0.087-0.100=-0.013
min27.382-27.455=-0.072
max27.573-27.679=-0.106