Compare commits

Home / Compare 27341c1d .. a1c0afe5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.956=0.001
σ0.101-0.102=-0.001
min35.914-35.905=0.009
max36.244-36.245=-0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.077-0.076=0.000
σ0.003-0.004=-0.000
min0.073-0.074=-0.000
max0.083-0.083=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.203-26.203=-0.000
σ0.005-0.005=0.001
min26.195-26.193=0.003
max26.210-26.208=0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.059-0.061=-0.002
σ0.003-0.003=0.000
min0.056-0.059=-0.003
max0.066-0.068=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.305-1756.305=-0.000
σ0.368-0.368=-0.001
min1755.730-1755.729=0.001
max1756.896-1756.897=-0.001
mean1635.650-1655.050=-19.400
σ632.207-630.068=2.139
min618.000-619.000=-1.000
max2695.000-2674.000=21.000
mean2.402-2.370=0.032
σ0.105-0.079=0.025
min2.286-2.257=0.029
max2.686-2.561=0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.822-278.824=-0.002
σ0.003-0.007=-0.004
min278.819-278.812=0.007
max278.827-278.831=-0.004
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean0.408-0.412=-0.004
σ0.001-0.004=-0.003
min0.407-0.407=-0.000
max0.410-0.419=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2268.876-2268.887=-0.011
σ0.013-0.007=0.007
min2268.864-2268.878=-0.014
max2268.896-2268.893=0.003
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean3.175-2.946=0.229
σ0.136-0.092=0.044
min3.036-2.881=0.156
max3.393-3.105=0.288
iters=5
new-facts=6402
prior-facts=1
mean4787.958-4954.156=-166.197
σ372.128-0.594=371.534
min4122.277-4953.836=-831.559
max4955.891-4955.215=0.676
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean7.753-7.947=-0.194
σ0.545-0.239=0.306
min6.880-7.708=-0.828
max8.358-8.342=0.016
iters=5
new-facts=6402
prior-facts=6402
mean5168.823-5168.826=-0.003
σ0.090-0.092=-0.002
min5168.718-5168.722=-0.004
max5168.891-5168.908=-0.017
mean3259.600-3363.200=-103.600
σ403.560-467.063=-63.504
min2853.000-2736.000=117.000
max3660.000-3969.000=-309.000
mean9.164-9.089=0.075
σ0.351-0.492=-0.142
min8.551-8.412=0.138
max9.378-9.562=-0.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.091=-0.119
σ0.060-0.265=-0.205
min0.935-0.933=0.002
max1.077-1.556=-0.479

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.817-459.818=-0.001
σ571.585-571.583=0.002
min174.017-174.017=0.000
max1317.194-1317.193=0.002
mean79.500
σ7.000
min76.000
max90.000
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean0.535-0.533=0.001
σ0.528-0.532=-0.004
min0.269-0.263=0.005
max1.327-1.332=-0.005
policies=20
mean1740.438-1740.426=0.012
σ0.315-0.335=-0.020
min1740.255-1740.217=0.038
max1740.909-1740.926=-0.017
mean760.000
σ0.000
min760.000
max760.000
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean2.693-2.700=-0.007
σ0.025-0.026=-0.002
min2.671-2.665=0.007
max2.724-2.728=-0.003
policies=200
mean17411.199-17411.276=-0.077
σ0.404-0.461=-0.057
min17410.969-17411.022=-0.053
max17411.802-17411.967=-0.164
mean7600.000
σ0.000
min7600.000
max7600.000
mean2695.000-2674.000=21.000
σ0.000
min2695.000-2674.000=21.000
max2695.000-2674.000=21.000
mean27.032-27.096=-0.064
σ0.074-0.125=-0.052
min26.924-27.001=-0.077
max27.089-27.281=-0.192