Compare commits

Home / Compare ceee085c .. f8087f30

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.956=0.002
σ0.102-0.102=0.000
min35.915-35.905=0.010
max36.247-36.245=0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.078-0.076=0.002
σ0.004-0.004=0.001
min0.075-0.074=0.001
max0.085-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.204-26.203=0.001
σ0.004-0.005=-0.001
min26.197-26.193=0.005
max26.209-26.208=0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.063-0.061=0.002
σ0.004-0.003=0.001
min0.060-0.059=0.001
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.266-1756.305=-38.039
σ170.184-0.368=169.815
min995.238-1755.729=-760.492
max1756.883-1756.897=-0.013
mean1616.500-1655.050=-38.550
σ618.963-630.068=-11.105
min618.000-619.000=-1.000
max2673.000-2674.000=-1.000
mean2.349-2.370=-0.021
σ0.278-0.079=0.199
min1.361-2.257=-0.896
max2.873-2.561=0.312

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.818-278.824=-0.006
σ0.019-0.007=0.011
min278.785-278.812=-0.027
max278.831-278.831=-0.001
mean2673.000-2674.000=-1.000
σ0.000
min2673.000-2674.000=-1.000
max2673.000-2674.000=-1.000
mean0.412-0.412=-0.000
σ0.002-0.004=-0.002
min0.410-0.407=0.002
max0.415-0.419=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2268.886-2268.887=-0.001
σ0.015-0.007=0.008
min2268.875-2268.878=-0.003
max2268.911-2268.893=0.018
mean2673.000-2674.000=-1.000
σ0.000
min2673.000-2674.000=-1.000
max2673.000-2674.000=-1.000
mean3.146-2.946=0.200
σ0.165-0.092=0.073
min2.918-2.881=0.037
max3.365-3.105=0.260
iters=5
new-facts=6402
prior-facts=1
mean4954.269-4954.156=0.113
σ0.951-0.594=0.357
min4953.694-4953.836=-0.141
max4955.952-4955.215=0.737
mean2673.000-2674.000=-1.000
σ0.000
min2673.000-2674.000=-1.000
max2673.000-2674.000=-1.000
mean8.117-7.947=0.170
σ0.347-0.239=0.108
min7.837-7.708=0.130
max8.608-8.342=0.266
iters=5
new-facts=6402
prior-facts=6402
mean5168.822-5168.826=-0.004
σ0.090-0.092=-0.002
min5168.719-5168.722=-0.002
max5168.897-5168.908=-0.011
mean3447.400-3363.200=84.200
σ477.946-467.063=10.883
min2890.000-2736.000=154.000
max4139.000-3969.000=170.000
mean9.221-9.089=0.132
σ0.240-0.492=-0.252
min9.015-8.412=0.603
max9.597-9.562=0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.947-1.091=-0.145
σ0.010-0.265=-0.255
min0.940-0.933=0.006
max0.964-1.556=-0.592

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.350-459.818=0.532
σ572.651-571.583=1.068
min174.015-174.017=-0.002
max1319.326-1317.193=2.134
mean79.500
σ7.000
min76.000
max90.000
mean2673.000-2674.000=-1.000
σ0.000
min2673.000-2674.000=-1.000
max2673.000-2674.000=-1.000
mean0.529-0.533=-0.004
σ0.519-0.532=-0.014
min0.267-0.263=0.004
max1.307-1.332=-0.025
policies=20
mean1740.423-1740.426=-0.003
σ0.322-0.335=-0.013
min1740.227-1740.217=0.010
max1740.904-1740.926=-0.022
mean760.000
σ0.000
min760.000
max760.000
mean2673.000-2674.000=-1.000
σ0.000
min2673.000-2674.000=-1.000
max2673.000-2674.000=-1.000
mean2.691-2.700=-0.009
σ0.010-0.026=-0.017
min2.680-2.665=0.016
max2.700-2.728=-0.027
policies=200
mean17411.315-17411.276=0.039
σ0.524-0.461=0.063
min17411.028-17411.022=0.006
max17412.100-17411.967=0.133
mean7600.000
σ0.000
min7600.000
max7600.000
mean2673.000-2674.000=-1.000
σ0.000
min2673.000-2674.000=-1.000
max2673.000-2674.000=-1.000
mean27.017-27.096=-0.079
σ0.064-0.125=-0.061
min26.928-27.001=-0.073
max27.075-27.281=-0.205