Compare commits

Home / Compare d5a3b75f .. bf98547e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-30.772=0.001
σ0.047-0.045=0.002
min30.749-30.749=-0.001
max30.906-30.899=0.006
mean410.000-413.200=-3.200
σ0.000-0.422=-0.422
min410.000-413.000=-3.000
max410.000-414.000=-4.000
mean0.078-0.075=0.003
σ0.003-0.005=-0.002
min0.076-0.070=0.006
max0.084-0.086=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.058-21.059=-0.001
σ0.002-0.002=-0.000
min21.055-21.056=-0.001
max21.061-21.062=-0.001
mean410.000-414.000=-4.000
σ0.000
min410.000-414.000=-4.000
max410.000-414.000=-4.000
mean0.063-0.063=-0.000
σ0.004-0.002=0.002
min0.057-0.061=-0.004
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.237=-0.000
σ0.362-0.364=-0.002
min1750.661-1750.669=-0.007
max1751.821-1751.828=-0.008
mean1642.250-1666.950=-24.700
σ617.812-640.248=-22.436
min676.000-680.000=-4.000
max2632.000-2697.000=-65.000
mean2.750-2.913=-0.163
σ0.239-0.071=0.169
min2.267-2.793=-0.526
max2.999-3.039=-0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-275.569=-0.003
σ0.004-0.006=-0.002
min275.563-275.562=0.001
max275.572-275.577=-0.005
mean2632.000-2697.000=-65.000
σ0.000
min2632.000-2697.000=-65.000
max2632.000-2697.000=-65.000
mean0.394-0.395=-0.002
σ0.009-0.008=0.001
min0.386-0.388=-0.002
max0.404-0.404=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2168.087-2168.093=-0.006
σ0.020-0.013=0.007
min2168.058-2168.070=-0.012
max2168.108-2168.103=0.005
mean2632.000-2697.000=-65.000
σ0.000
min2632.000-2697.000=-65.000
max2632.000-2697.000=-65.000
mean2.971-2.924=0.047
σ0.105-0.110=-0.005
min2.798-2.753=0.045
max3.062-3.039=0.024
iters=5
new-facts=6402
prior-facts=1
mean5047.688-5047.793=-0.105
σ0.357-1.013=-0.655
min5047.349-5046.754=0.594
max5048.268-5049.484=-1.216
mean2632.000-2697.000=-65.000
σ0.000
min2632.000-2697.000=-65.000
max2632.000-2697.000=-65.000
mean9.067-8.769=0.298
σ0.504-0.479=0.025
min8.330-8.090=0.240
max9.582-9.406=0.176
iters=5
new-facts=6402
prior-facts=6402
mean5179.048-5178.980=0.068
σ0.073-0.192=-0.119
min5178.965-5178.670=0.295
max5179.127-5179.145=-0.018
mean3281.400-3218.200=63.200
σ425.490-381.829=43.661
min2680.000-2697.000=-17.000
max3672.000-3699.000=-27.000
mean9.973-9.922=0.051
σ0.306-0.278=0.028
min9.611-9.431=0.180
max10.306-10.114=0.192

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-1.069=0.115
σ0.249-0.136=0.113
min0.938-0.926=0.011
max1.580-1.262=0.317

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.208=0.001
σ572.673-572.659=0.014
min176.869-176.868=0.000
max1322.218-1322.197=0.021
mean77.500
σ7.000
min74.000
max88.000
mean2632.000-2697.000=-65.000
σ0.000
min2632.000-2697.000=-65.000
max2632.000-2697.000=-65.000
mean0.563-0.539=0.024
σ0.568-0.525=0.043
min0.275-0.274=0.001
max1.415-1.327=0.088
policies=20
mean1768.974-1768.974=0.001
σ0.342-0.338=0.005
min1768.754-1768.753=0.001
max1769.485-1769.477=0.008
mean740.000
σ0.000
min740.000
max740.000
mean2632.000-2697.000=-65.000
σ0.000
min2632.000-2697.000=-65.000
max2632.000-2697.000=-65.000
mean2.756-2.764=-0.007
σ0.027-0.031=-0.004
min2.735-2.736=-0.001
max2.790-2.800=-0.009
policies=200
mean17696.172-17696.103=0.069
σ0.416-0.558=-0.142
min17695.920-17695.799=0.121
max17696.790-17696.939=-0.149
mean7400.000
σ0.000
min7400.000
max7400.000
mean2632.000-2697.000=-65.000
σ0.000
min2632.000-2697.000=-65.000
max2632.000-2697.000=-65.000
mean27.720-27.674=0.046
σ0.153-0.087=0.065
min27.595-27.592=0.002
max27.912-27.783=0.129