Compare commits

Home / Compare cdef4cee .. 0f9288fb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.564=-0.001
σ0.048-0.045=0.004
min70.535-70.537=-0.002
max70.699-70.690=0.009
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.160-0.161=-0.001
σ0.003-0.003=0.000
min0.156-0.158=-0.002
max0.167-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.287-21.289=-0.002
σ0.003-0.002=0.000
min21.283-21.285=-0.003
max21.291-21.292=-0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.063-0.066=-0.003
σ0.003-0.002=0.001
min0.058-0.064=-0.006
max0.068-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.172-1753.172=0.000
σ0.361-0.360=0.001
min1752.606-1752.601=0.005
max1753.767-1753.754=0.013
mean1646.350-1666.900=-20.550
σ632.158-625.657=6.502
min631.000-673.000=-42.000
max2769.000-2677.000=92.000
mean2.825-2.807=0.018
σ0.195-0.196=-0.001
min2.308-2.191=0.117
max3.020-3.043=-0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.619-271.621=-0.002
σ0.008-0.007=0.001
min271.609-271.614=-0.005
max271.625-271.633=-0.008
mean2769.000-2677.000=92.000
σ0.000
min2769.000-2677.000=92.000
max2769.000-2677.000=92.000
mean0.384-0.386=-0.002
σ0.008-0.007=0.002
min0.379-0.381=-0.002
max0.398-0.394=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.041-1932.049=-0.008
σ0.006-0.009=-0.003
min1932.033-1932.036=-0.003
max1932.050-1932.062=-0.013
mean2769.000-2677.000=92.000
σ0.000
min2769.000-2677.000=92.000
max2769.000-2677.000=92.000
mean2.958-3.069=-0.111
σ0.143-0.083=0.060
min2.746-2.990=-0.244
max3.143-3.160=-0.017
iters=5
new-facts=6402
prior-facts=1
mean4752.735-4752.851=-0.116
σ0.898-0.819=0.079
min4751.981-4752.401=-0.420
max4754.294-4754.314=-0.019
mean2769.000-2677.000=92.000
σ0.000
min2769.000-2677.000=92.000
max2769.000-2677.000=92.000
mean7.997-7.970=0.027
σ0.350-0.369=-0.019
min7.728-7.668=0.059
max8.610-8.608=0.003
iters=5
new-facts=6402
prior-facts=6402
mean4943.228-4943.098=0.130
σ0.024-0.328=-0.305
min4943.194-4942.511=0.683
max4943.256-4943.261=-0.005
mean3049.400-2969.800=79.600
σ339.442-316.721=22.721
min2769.000-2677.000=92.000
max3559.000-3426.000=133.000
mean8.415-8.574=-0.159
σ0.089-0.138=-0.050
min8.341-8.399=-0.058
max8.567-8.735=-0.169

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-1.176=-0.181
σ0.139-0.318=-0.178
min0.929-0.931=-0.002
max1.244-1.693=-0.449

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.291-472.294=-0.003
σ575.913-575.937=-0.024
min184.326-184.319=0.007
max1336.159-1336.199=-0.040
mean88.250
σ8.500
min84.000
max101.000
mean2769.000-2677.000=92.000
σ0.000
min2769.000-2677.000=92.000
max2769.000-2677.000=92.000
mean0.450-0.588=-0.138
σ0.301-0.607=-0.306
min0.292-0.281=0.011
max0.902-1.500=-0.597
policies=20
mean1843.573-1843.527=0.046
σ0.381-0.378=0.003
min1843.291-1843.264=0.026
max1844.130-1844.085=0.045
mean840.000
σ0.000
min840.000
max840.000
mean2769.000-2677.000=92.000
σ0.000
min2769.000-2677.000=92.000
max2769.000-2677.000=92.000
mean2.941-2.896=0.045
σ0.107-0.054=0.053
min2.856-2.862=-0.006
max3.086-2.976=0.110
policies=200
mean18442.189-18442.196=-0.007
σ0.474-0.519=-0.045
min18441.906-18441.821=0.085
max18442.895-18442.963=-0.068
mean8400.000
σ0.000
min8400.000
max8400.000
mean2769.000-2677.000=92.000
σ0.000
min2769.000-2677.000=92.000
max2769.000-2677.000=92.000
mean28.930-29.054=-0.123
σ0.055-0.167=-0.112
min28.853-28.899=-0.046
max28.977-29.236=-0.259