Compare commits

Home / Compare d77477a7 .. ab33988b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.771-30.773=-0.002
σ0.049-0.047=0.002
min30.748-30.750=-0.002
max30.909-30.907=0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.079-0.079=-0.000
σ0.003-0.004=-0.001
min0.076-0.076=0.000
max0.084-0.087=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.061-21.059=0.002
σ0.003-0.003=-0.000
min21.056-21.054=0.003
max21.066-21.065=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.061-0.061=0.000
σ0.004-0.002=0.001
min0.057-0.057=-0.001
max0.068-0.065=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.238-1751.237=0.001
σ0.363-0.364=-0.001
min1750.665-1750.671=-0.006
max1751.824-1751.823=0.001
mean1653.150-1668.950=-15.800
σ644.696-639.428=5.268
min632.000-682.000=-50.000
max2856.000-2699.000=157.000
mean2.908-2.875=0.032
σ0.111-0.145=-0.034
min2.726-2.357=0.369
max3.254-3.042=0.213

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.567-275.566=0.001
σ0.007-0.003=0.004
min275.558-275.563=-0.005
max275.576-275.571=0.005
mean2856.000-2699.000=157.000
σ0.000
min2856.000-2699.000=157.000
max2856.000-2699.000=157.000
mean0.405-0.392=0.013
σ0.010-0.009=0.001
min0.396-0.385=0.011
max0.418-0.404=0.014
iters=5
new-facts=1
prior-facts=6402
mean2168.094-2168.086=0.008
σ0.014-0.026=-0.012
min2168.077-2168.043=0.035
max2168.114-2168.111=0.003
mean2856.000-2699.000=157.000
σ0.000
min2856.000-2699.000=157.000
max2856.000-2699.000=157.000
mean2.945-3.014=-0.069
σ0.135-0.161=-0.026
min2.792-2.804=-0.012
max3.118-3.198=-0.081
iters=5
new-facts=6402
prior-facts=1
mean5047.904-5047.673=0.232
σ0.911-1.065=-0.154
min5047.403-5046.565=0.838
max5049.525-5049.449=0.077
mean2856.000-2699.000=157.000
σ0.000
min2856.000-2699.000=157.000
max2856.000-2699.000=157.000
mean9.034-8.812=0.222
σ0.408-0.521=-0.113
min8.378-8.076=0.302
max9.464-9.478=-0.014
iters=5
new-facts=6402
prior-facts=6402
mean5179.044-5179.049=-0.004
σ0.078-0.107=-0.029
min5178.966-5178.965=0.001
max5179.127-5179.177=-0.051
mean3320.000-3230.400=89.600
σ365.580-386.896=-21.316
min2856.000-2699.000=157.000
max3675.000-3718.000=-43.000
mean9.746-10.101=-0.356
σ0.278-0.351=-0.073
min9.516-9.764=-0.249
max10.214-10.687=-0.473

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.088-1.075=0.013
σ0.107-0.133=-0.025
min0.948-0.942=0.005
max1.250-1.214=0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.213-463.204=0.009
σ572.658-572.658=-0.000
min176.877-176.863=0.014
max1322.199-1322.191=0.008
mean77.500
σ7.000
min74.000
max88.000
mean2856.000-2699.000=157.000
σ0.000
min2856.000-2699.000=157.000
max2856.000-2699.000=157.000
mean0.441-0.561=-0.120
σ0.306-0.564=-0.257
min0.285-0.276=0.009
max0.900-1.406=-0.506
policies=20
mean1769.004-1768.945=0.060
σ0.330-0.336=-0.007
min1768.773-1768.727=0.045
max1769.490-1769.446=0.043
mean740.000
σ0.000
min740.000
max740.000
mean2856.000-2699.000=157.000
σ0.000
min2856.000-2699.000=157.000
max2856.000-2699.000=157.000
mean2.838-2.742=0.096
σ0.013-0.003=0.010
min2.820-2.738=0.082
max2.849-2.746=0.104
policies=200
mean17696.209-17696.221=-0.013
σ0.406-0.536=-0.130
min17695.860-17695.940=-0.080
max17696.793-17697.024=-0.231
mean7400.000
σ0.000
min7400.000
max7400.000
mean2856.000-2699.000=157.000
σ0.000
min2856.000-2699.000=157.000
max2856.000-2699.000=157.000
mean28.262-27.759=0.504
σ0.449-0.098=0.351
min27.737-27.667=0.070
max28.682-27.862=0.820