Compare commits

Home / Compare a4e26994 .. f2a5a396

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.244=0.001
σ0.053-0.051=0.002
min35.217-35.218=-0.000
max35.394-35.387=0.007
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.085-0.086=-0.000
σ0.003-0.004=-0.000
min0.083-0.082=0.000
max0.093-0.093=0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.002-0.002=0.000
min23.766-23.767=-0.001
max23.772-23.773=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.068-0.069=-0.001
σ0.004-0.003=0.001
min0.062-0.066=-0.004
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=0.000
σ0.365-0.365=0.000
min1755.910-1755.913=-0.002
max1757.074-1757.063=0.011
mean1631.350-1658.250=-26.900
σ593.465-642.350=-48.885
min654.000-631.000=23.000
max2429.000-2800.000=-371.000
mean2.333-2.333=-0.000
σ0.093-0.145=-0.052
min2.226-2.097=0.128
max2.583-2.786=-0.203

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.702-324.692=0.011
σ0.054-0.048=0.006
min324.607-324.609=-0.003
max324.735-324.732=0.003
mean2429.000-2800.000=-371.000
σ0.000
min2429.000-2800.000=-371.000
max2429.000-2800.000=-371.000
mean0.431-0.431=-0.000
σ0.016-0.011=0.005
min0.423-0.423=-0.000
max0.459-0.448=0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.249-1985.262=-0.013
σ0.031-0.009=0.022
min1985.215-1985.247=-0.032
max1985.279-1985.269=0.010
mean2429.000-2800.000=-371.000
σ0.000
min2429.000-2800.000=-371.000
max2429.000-2800.000=-371.000
mean2.683-2.640=0.042
σ0.275-0.059=0.215
min2.452-2.590=-0.138
max3.156-2.715=0.441
iters=5
new-facts=6402
prior-facts=1
mean4808.775-4808.774=0.001
σ7.457-7.783=-0.326
min4805.374-4804.838=0.535
max4822.114-4822.688=-0.575
mean2429.000-2800.000=-371.000
σ0.000
min2429.000-2800.000=-371.000
max2429.000-2800.000=-371.000
mean9.164-9.114=0.050
σ0.300-0.179=0.122
min8.843-8.900=-0.057
max9.613-9.366=0.247
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.437=0.029
σ0.011-0.070=-0.059
min4996.455-4996.317=0.137
max4996.478-4996.492=-0.013
mean3003.800-2989.200=14.600
σ324.044-202.097=121.947
min2577.000-2800.000=-223.000
max3415.000-3291.000=124.000
mean8.657-8.687=-0.030
σ0.151-0.157=-0.005
min8.499-8.473=0.025
max8.908-8.899=0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.740-0.949=0.791
σ0.157-0.051=0.106
min1.583-0.919=0.664
max2.004-1.040=0.964

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.945-462.964=-0.019
σ574.244-574.250=-0.005
min175.818-175.833=-0.015
max1324.311-1324.338=-0.027
mean86.250
σ8.500
min82.000
max99.000
mean2429.000-2800.000=-371.000
σ0.000
min2429.000-2800.000=-371.000
max2429.000-2800.000=-371.000
mean0.548-0.430=0.118
σ0.560-0.302=0.258
min0.251-0.278=-0.027
max1.388-0.883=0.505
policies=20
mean1758.497-1758.685=-0.188
σ0.346-0.327=0.019
min1758.261-1758.470=-0.209
max1759.008-1759.170=-0.162
mean820.000
σ0.000
min820.000
max820.000
mean2429.000-2800.000=-371.000
σ0.000
min2429.000-2800.000=-371.000
max2429.000-2800.000=-371.000
mean2.712-2.832=-0.119
σ0.028-0.077=-0.048
min2.686-2.781=-0.096
max2.752-2.946=-0.194
policies=200
mean17592.347-17592.425=-0.078
σ0.452-0.542=-0.090
min17591.924-17592.064=-0.141
max17592.987-17593.231=-0.244
mean8200.000
σ0.000
min8200.000
max8200.000
mean2429.000-2800.000=-371.000
σ0.000
min2429.000-2800.000=-371.000
max2429.000-2800.000=-371.000
mean27.406-27.493=-0.087
σ0.165-0.117=0.048
min27.259-27.388=-0.129
max27.603-27.603=0.000