Compare commits

Home / Compare c0c9eb70 .. f32b7749

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-30.773=0.000
σ0.045-0.046=-0.000
min30.751-30.747=0.004
max30.902-30.902=-0.000
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.078-0.078=0.000
σ0.003-0.004=-0.001
min0.075-0.072=0.003
max0.084-0.086=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.059-21.058=0.001
σ0.003-0.003=0.000
min21.053-21.054=-0.001
max21.062-21.063=-0.001
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.061-0.063=-0.001
σ0.003-0.004=-0.001
min0.057-0.057=-0.000
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.236=0.001
σ0.366-0.363=0.003
min1750.669-1750.670=-0.002
max1751.826-1751.809=0.017
mean1636.450-1654.950=-18.500
σ614.984-643.544=-28.560
min626.000-633.000=-7.000
max2470.000-2849.000=-379.000
mean2.803-2.840=-0.037
σ0.193-0.144=0.049
min2.261-2.411=-0.150
max3.057-3.004=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-275.569=-0.003
σ0.003-0.007=-0.004
min275.562-275.562=-0.001
max275.570-275.577=-0.007
mean2470.000-2849.000=-379.000
σ0.000
min2470.000-2849.000=-379.000
max2470.000-2849.000=-379.000
mean0.393-0.391=0.001
σ0.010-0.009=0.001
min0.384-0.385=-0.001
max0.405-0.405=0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.094-2168.092=0.002
σ0.009-0.013=-0.004
min2168.083-2168.070=0.013
max2168.104-2168.104=-0.001
mean2470.000-2849.000=-379.000
σ0.000
min2470.000-2849.000=-379.000
max2470.000-2849.000=-379.000
mean3.016-2.929=0.087
σ0.179-0.123=0.056
min2.784-2.775=0.009
max3.278-3.093=0.186
iters=5
new-facts=6402
prior-facts=1
mean5047.903-5047.801=0.102
σ0.919-0.999=-0.080
min5047.336-5047.033=0.304
max5049.538-5049.550=-0.013
mean2470.000-2849.000=-379.000
σ0.000
min2470.000-2849.000=-379.000
max2470.000-2849.000=-379.000
mean9.038-8.794=0.244
σ0.507-0.593=-0.086
min8.202-8.018=0.184
max9.518-9.402=0.116
iters=5
new-facts=6402
prior-facts=6402
mean5178.979-5179.044=-0.066
σ0.187-0.082=0.104
min5178.669-5178.966=-0.296
max5179.128-5179.141=-0.013
mean3224.000-3253.400=-29.400
σ390.293-337.299=52.995
min2663.000-2849.000=-186.000
max3688.000-3711.000=-23.000
mean9.932-9.952=-0.020
σ0.219-0.161=0.058
min9.558-9.687=-0.129
max10.102-10.110=-0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.749-1.009=0.740
σ0.118-0.139=-0.022
min1.576-0.945=0.631
max1.898-1.258=0.639

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.196-463.207=-0.011
σ572.646-572.650=-0.004
min176.873-176.875=-0.002
max1322.165-1322.182=-0.017
mean77.500
σ7.000
min74.000
max88.000
mean2470.000-2849.000=-379.000
σ0.000
min2470.000-2849.000=-379.000
max2470.000-2849.000=-379.000
mean0.540-0.438=0.102
σ0.533-0.305=0.228
min0.271-0.284=-0.012
max1.340-0.895=0.444
policies=20
mean1768.956-1769.003=-0.048
σ0.329-0.338=-0.009
min1768.748-1768.785=-0.037
max1769.447-1769.506=-0.059
mean740.000
σ0.000
min740.000
max740.000
mean2470.000-2849.000=-379.000
σ0.000
min2470.000-2849.000=-379.000
max2470.000-2849.000=-379.000
mean2.738-2.817=-0.079
σ0.024-0.007=0.017
min2.704-2.808=-0.104
max2.760-2.824=-0.064
policies=200
mean17696.240-17696.139=0.101
σ0.515-0.475=0.040
min17695.958-17695.756=0.201
max17697.011-17696.822=0.189
mean7400.000
σ0.000
min7400.000
max7400.000
mean2470.000-2849.000=-379.000
σ0.000
min2470.000-2849.000=-379.000
max2470.000-2849.000=-379.000
mean27.592-28.017=-0.425
σ0.143-0.477=-0.333
min27.443-27.541=-0.098
max27.755-28.566=-0.810