Compare commits

Home / Compare 692430e7 .. 4bb7ff2e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.041=-0.000
σ0.050-0.050=0.000
min31.002-31.007=-0.004
max31.180-31.181=-0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.080-0.080=0.000
σ0.004-0.003=0.001
min0.076-0.077=-0.001
max0.088-0.086=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.002-0.002=-0.000
min21.140-21.139=0.001
max21.148-21.146=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.065=0.000
σ0.002-0.002=0.000
min0.063-0.063=0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.409=0.001
σ0.362-0.363=-0.001
min1750.845-1750.847=-0.002
max1751.994-1751.980=0.014
mean1638.200-1633.950=4.250
σ615.936-616.671=-0.735
min661.000-646.000=15.000
max2563.000-2469.000=94.000
mean2.814-2.777=0.037
σ0.195-0.235=-0.040
min2.324-2.179=0.145
max3.143-3.234=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.074-279.071=0.003
σ0.009-0.008=0.002
min279.063-279.060=0.003
max279.085-279.080=0.005
mean2563.000-2469.000=94.000
σ0.000
min2563.000-2469.000=94.000
max2563.000-2469.000=94.000
mean0.389-0.392=-0.003
σ0.001-0.007=-0.006
min0.387-0.386=0.001
max0.390-0.403=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1939.519-1939.515=0.004
σ0.012-0.011=0.001
min1939.509-1939.502=0.007
max1939.539-1939.529=0.010
mean2563.000-2469.000=94.000
σ0.000
min2563.000-2469.000=94.000
max2563.000-2469.000=94.000
mean2.831-3.218=-0.387
σ0.379-0.153=0.226
min2.377-3.005=-0.628
max3.228-3.415=-0.187
iters=5
new-facts=6402
prior-facts=1
mean4759.953-4760.042=-0.090
σ0.968-0.877=0.092
min4758.995-4759.556=-0.561
max4761.584-4761.607=-0.023
mean2563.000-2469.000=94.000
σ0.000
min2563.000-2469.000=94.000
max2563.000-2469.000=94.000
mean8.155-8.418=-0.263
σ0.603-0.644=-0.041
min7.713-7.729=-0.016
max9.203-9.238=-0.036
iters=5
new-facts=6402
prior-facts=6402
mean4950.464-4950.465=-0.001
σ0.087-0.076=0.011
min4950.385-4950.407=-0.022
max4950.562-4950.551=0.011
mean2946.200-2974.800=-28.600
σ353.952-340.770=13.182
min2563.000-2498.000=65.000
max3447.000-3291.000=156.000
mean8.530-8.872=-0.341
σ0.136-0.404=-0.269
min8.431-8.425=0.006
max8.760-9.411=-0.651

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.587-1.846=-0.259
σ0.404-0.044=0.360
min1.057-1.797=-0.740
max1.915-1.898=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.335-463.326=0.009
σ572.197-572.193=0.004
min177.233-177.225=0.008
max1321.631-1321.616=0.015
mean79.750
σ7.500
min76.000
max91.000
mean2563.000-2469.000=94.000
σ0.000
min2563.000-2469.000=94.000
max2563.000-2469.000=94.000
mean0.558-0.544=0.014
σ0.556-0.530=0.027
min0.277-0.275=0.003
max1.392-1.338=0.054
policies=20
mean1772.590-1772.580=0.010
σ0.333-0.344=-0.011
min1772.361-1772.351=0.010
max1773.084-1773.090=-0.006
mean760.000
σ0.000
min760.000
max760.000
mean2563.000-2469.000=94.000
σ0.000
min2563.000-2469.000=94.000
max2563.000-2469.000=94.000
mean2.754-2.755=-0.001
σ0.013-0.037=-0.025
min2.736-2.705=0.031
max2.763-2.787=-0.024
policies=200
mean17732.524-17732.374=0.150
σ0.478-0.427=0.051
min17732.234-17732.093=0.141
max17733.238-17733.007=0.232
mean7600.000
σ0.000
min7600.000
max7600.000
mean2563.000-2469.000=94.000
σ0.000
min2563.000-2469.000=94.000
max2563.000-2469.000=94.000
mean27.786-27.759=0.027
σ0.124-0.125=-0.002
min27.668-27.656=0.012
max27.907-27.941=-0.034