Compare commits

Home / Compare 6a1a4c43 .. c724b3f8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727
σ0.616
min35.918
max37.223
mean4144.000
σ0.000
min4144.000
max4144.000
mean0.075
σ0.001
min0.074
max0.076
cache=y
dps=1
iters=10
policies=100
mean26.711
σ0.645
min26.206
max27.465
mean4144.000
σ0.000
min4144.000
max4144.000
mean0.060
σ0.001
min0.059
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.358-1756.307=0.051
σ0.373-0.367=0.005
min1755.781-1755.753=0.028
max1756.973-1756.898=0.075
mean1650.350-1654.050=-3.700
σ632.471-628.537=3.934
min619.000-611.000=8.000
max2591.000-2670.000=-79.000
mean2.280-2.241=0.039
σ0.167-0.102=0.064
min2.105-2.110=-0.005
max2.704-2.516=0.187

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.676-278.695=-0.019
σ0.011-0.015=-0.003
min278.665-278.679=-0.014
max278.694-278.712=-0.018
mean2591.000-2670.000=-79.000
σ0.000
min2591.000-2670.000=-79.000
max2591.000-2670.000=-79.000
mean0.420-0.418=0.002
σ0.006-0.001=0.005
min0.415-0.417=-0.002
max0.431-0.419=0.012
iters=5
new-facts=1
prior-facts=6402
mean2268.846-2268.847=-0.001
σ0.004-0.016=-0.012
min2268.840-2268.827=0.013
max2268.851-2268.862=-0.011
mean2591.000-2670.000=-79.000
σ0.000
min2591.000-2670.000=-79.000
max2591.000-2670.000=-79.000
mean3.120-3.667=-0.547
σ0.176-0.221=-0.046
min2.923-3.430=-0.506
max3.337-3.897=-0.559
iters=5
new-facts=6402
prior-facts=1
mean4952.300-4955.932=-3.632
σ0.844-0.924=-0.080
min4951.859-4955.069=-3.210
max4953.807-4957.510=-3.703
mean2591.000-2670.000=-79.000
σ0.000
min2591.000-2670.000=-79.000
max2591.000-2670.000=-79.000
mean8.075-7.825=0.250
σ0.310-0.162=0.148
min7.764-7.646=0.117
max8.421-8.001=0.421
iters=5
new-facts=6402
prior-facts=6402
mean5166.916-5170.769=-3.853
σ0.322-0.090=0.232
min5166.340-5170.665=-4.325
max5167.085-5170.837=-3.752
mean3435.200-3433.200=2.000
σ489.734-466.431=23.304
min2855.000
max4144.000-4106.000=38.000
mean9.306-9.389=-0.083
σ0.535-0.166=0.370
min8.748-9.222=-0.474
max10.066-9.596=0.470

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.074-1.061=0.014
σ0.110-0.123=-0.013
min0.933-0.950=-0.017
max1.241-1.252=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.254-460.253=0.002
σ572.608-572.608=0.000
min173.949-173.948=0.001
max1319.166-1319.164=0.002
mean79.500
σ7.000
min76.000
max90.000
mean437.000-435.000=2.000
σ0.000
min437.000-435.000=2.000
max437.000-435.000=2.000
mean0.535-0.540=-0.005
σ0.526-0.531=-0.005
min0.267-0.272=-0.005
max1.324-1.336=-0.013
policies=20
mean1739.997-1739.984=0.012
σ0.321-0.335=-0.014
min1739.768-1739.737=0.031
max1740.468-1740.474=-0.006
mean760.000
σ0.000
min760.000
max760.000
mean447.500-445.000=2.500
σ9.950-9.381=0.569
min437.000-435.000=2.000
max456.000-453.000=3.000
mean2.646-2.663=-0.017
σ0.013-0.008=0.005
min2.629-2.653=-0.025
max2.661-2.670=-0.009
policies=200
mean17409.337-17409.278=0.059
σ0.048-0.097=-0.049
min17409.297-17409.134=0.163
max17409.403-17409.342=0.061
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.500-487.000=3.500
σ1.732-1.633=0.099
min489.000-485.000=4.000
max493.000-489.000=4.000
mean26.830-27.077=-0.248
σ0.105-0.155=-0.049
min26.732-26.884=-0.152
max26.979-27.257=-0.278