Compare commits

Home / Compare b0b2c2b3 .. 77ef3e6c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.378-70.373=0.005
σ0.046-0.057=-0.011
min70.350-70.339=0.010
max70.506-70.532=-0.026
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.152-0.160=-0.007
σ0.005-0.002=0.003
min0.148-0.157=-0.009
max0.159-0.164=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.144-21.141=0.004
σ0.003-0.003=-0.000
min21.139-21.138=0.002
max21.148-21.145=0.003
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.064-0.059=0.005
σ0.002-0.002=-0.001
min0.063-0.058=0.005
max0.069-0.066=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.199=0.190
σ0.363-0.360=0.002
min1751.818-1751.628=0.190
max1752.977-1752.786=0.191
mean1658.350-1643.700=14.650
σ638.373-622.714=15.660
min619.000-672.000=-53.000
max2811.000-2503.000=308.000
mean2.828-2.791=0.037
σ0.144-0.189=-0.044
min2.289-2.367=-0.078
max3.053-3.158=-0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.125-269.936=0.189
σ0.009-0.010=-0.001
min270.114-269.928=0.186
max270.139-269.952=0.186
mean2811.000-2503.000=308.000
σ0.000
min2811.000-2503.000=308.000
max2811.000-2503.000=308.000
mean0.373-0.382=-0.009
σ0.001-0.010=-0.009
min0.371-0.372=-0.000
max0.373-0.398=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1930.591-1930.397=0.194
σ0.005-0.007=-0.002
min1930.587-1930.388=0.198
max1930.599-1930.407=0.192
mean2811.000-2503.000=308.000
σ0.000
min2811.000-2503.000=308.000
max2811.000-2503.000=308.000
mean2.483-2.523=-0.041
σ0.074-0.114=-0.040
min2.377-2.448=-0.072
max2.554-2.720=-0.166
iters=5
new-facts=6402
prior-facts=1
mean4751.055-4750.629=0.426
σ0.844-0.752=0.092
min4750.484-4749.903=0.581
max4752.550-4751.897=0.653
mean2811.000-2503.000=308.000
σ0.000
min2811.000-2503.000=308.000
max2811.000-2503.000=308.000
mean8.493-8.676=-0.183
σ0.583-0.655=-0.073
min7.607-7.660=-0.053
max9.078-9.246=-0.169
iters=5
new-facts=6402
prior-facts=6402
mean4941.530-4941.336=0.194
σ0.091-0.088=0.003
min4941.454-4941.266=0.188
max4941.632-4941.435=0.197
mean3031.200-3020.400=10.800
σ222.036-262.230=-40.194
min2811.000-2628.000=183.000
max3332.000-3328.000=4.000
mean8.590-8.504=0.086
σ0.185-0.116=0.069
min8.421-8.371=0.050
max8.870-8.635=0.235

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-1.661=-0.608
σ0.129-0.183=-0.053
min0.927-1.444=-0.517
max1.252-1.850=-0.598

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.362-465.903=0.459
σ575.916-575.759=0.157
min178.398-178.022=0.376
max1330.236-1329.541=0.695
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2811.000-2503.000=308.000
σ0.000
min2811.000-2503.000=308.000
max2811.000-2503.000=308.000
mean0.402-0.538=-0.136
σ0.258-0.521=-0.263
min0.265-0.278=-0.013
max0.789-1.319=-0.530
policies=20
mean1784.253-1780.476=3.777
σ0.354-0.356=-0.001
min1784.016-1780.230=3.786
max1784.776-1781.003=3.773
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2811.000-2503.000=308.000
σ0.000
min2811.000-2503.000=308.000
max2811.000-2503.000=308.000
mean2.876-2.751=0.125
σ0.119-0.012=0.107
min2.765-2.742=0.024
max3.045-2.768=0.277
policies=200
mean17848.922-17811.520=37.402
σ0.458-0.501=-0.043
min17848.648-17811.248=37.400
max17849.606-17812.270=37.336
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2811.000-2503.000=308.000
σ0.000
min2811.000-2503.000=308.000
max2811.000-2503.000=308.000
mean28.026-27.810=0.216
σ0.197-0.072=0.126
min27.856-27.735=0.121
max28.308-27.904=0.404