Compare commits

Home / Compare 3703cb5d .. 3678559d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-53.648=0.057
σ0.364-0.367=-0.003
min53.575-53.509=0.065
max54.740-54.693=0.048
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.139-0.138=0.001
σ0.004-0.005=-0.001
min0.136-0.131=0.004
max0.146-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.978-42.945=0.033
σ0.005-0.005=-0.000
min42.967-42.935=0.031
max42.984-42.953=0.031
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.119-0.129=-0.010
σ0.004-0.009=-0.005
min0.114-0.118=-0.003
max0.126-0.145=-0.019

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.894-991.864=3.030
σ1.210-1.221=-0.011
min994.366-991.328=3.038
max999.973-996.979=2.994
mean1070.250-1064.300=5.950
σ316.617-316.904=-0.287
min597.000-600.000=-3.000
max1628.000-1601.000=27.000
mean1.432-1.529=-0.097
σ0.072-0.112=-0.040
min1.376-1.419=-0.043
max1.659-1.936=-0.277

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.306-285.439=11.867
σ0.017-0.011=0.006
min297.280-285.422=11.858
max297.326-285.451=11.876
mean1628.000-1601.000=27.000
σ0.000
min1628.000-1601.000=27.000
max1628.000-1601.000=27.000
mean0.395-0.382=0.013
σ0.006-0.011=-0.006
min0.388-0.374=0.014
max0.401-0.398=0.003
iters=5
new-facts=1
prior-facts=6402
mean1298.657-1285.507=13.150
σ0.087-0.062=0.024
min1298.503-1285.399=13.103
max1298.709-1285.554=13.155
mean1628.000-1601.000=27.000
σ0.000
min1628.000-1601.000=27.000
max1628.000-1601.000=27.000
mean1.958-1.836=0.122
σ0.054-0.091=-0.037
min1.887-1.740=0.146
max2.009-1.937=0.072
iters=5
new-facts=6402
prior-facts=1
mean1718.871-1705.815=13.056
σ6.915-6.861=0.053
min1715.619-1702.638=12.980
max1731.236-1718.086=13.150
mean1628.000-1601.000=27.000
σ0.000
min1628.000-1601.000=27.000
max1628.000-1601.000=27.000
mean3.068-2.948=0.119
σ0.326-0.270=0.056
min2.660-2.681=-0.020
max3.510-3.339=0.171
iters=5
new-facts=6402
prior-facts=6402
mean1981.597-1968.449=13.148
σ0.019-0.020=-0.001
min1981.565-1968.428=13.136
max1981.612-1968.481=13.131
mean1843.800-1842.800=1.000
σ203.486-214.050=-10.563
min1628.000-1601.000=27.000
max2123.000-2120.000=3.000
mean3.133-3.318=-0.185
σ0.083-0.155=-0.072
min2.987-3.175=-0.187
max3.195-3.526=-0.331

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-1.268=-0.084
σ0.297-0.316=-0.019
min0.910-0.912=-0.002
max1.673-1.684=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.369-436.774=3.594
σ572.882-572.366=0.516
min153.920-150.586=3.334
max1299.692-1295.323=4.369
mean94.250-90.250=4.000
σ8.500
min90.000-86.000=4.000
max107.000-103.000=4.000
mean1628.000-1601.000=27.000
σ0.000
min1628.000-1601.000=27.000
max1628.000-1601.000=27.000
mean0.534-0.514=0.020
σ0.557-0.531=0.026
min0.254-0.248=0.007
max1.369-1.310=0.059
policies=20
mean1539.508-1506.180=33.328
σ0.299-0.241=0.058
min1539.326-1506.021=33.305
max1539.953-1506.539=33.415
mean900.000-860.000=40.000
σ0.000
min900.000-860.000=40.000
max900.000-860.000=40.000
mean1628.000-1601.000=27.000
σ0.000
min1628.000-1601.000=27.000
max1628.000-1601.000=27.000
mean2.564-2.522=0.042
σ0.016-0.023=-0.007
min2.550-2.497=0.054
max2.587-2.550=0.038
policies=200
mean15402.950-15069.433=333.516
σ0.133-0.128=0.005
min15402.765-15069.299=333.466
max15403.083-15069.589=333.494
mean9000.000-8600.000=400.000
σ0.000
min9000.000-8600.000=400.000
max9000.000-8600.000=400.000
mean1628.000-1601.000=27.000
σ0.000
min1628.000-1601.000=27.000
max1628.000-1601.000=27.000
mean25.986-25.517=0.469
σ0.169-0.120=0.049
min25.824-25.391=0.433
max26.193-25.674=0.519