Compare commits

Home / Compare 353d50dc .. 87caed3c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.106-54.105=0.001
σ0.365-0.366=-0.001
min53.966-53.959=0.007
max55.144-55.145=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.141-0.140=0.001
σ0.003-0.004=-0.001
min0.139-0.135=0.003
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.380-43.379=0.000
σ0.007-0.005=0.002
min43.369-43.370=-0.002
max43.391-43.388=0.003
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.124-0.123=0.002
σ0.007-0.004=0.003
min0.119-0.119=-0.001
max0.143-0.130=0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean997.125-997.129=-0.004
σ1.194-1.182=0.012
min996.598-996.580=0.019
max1002.136-1002.090=0.047
mean1052.150-1051.250=0.900
σ304.465-310.231=-5.765
min606.000-597.000=9.000
max1652.000-1633.000=19.000
mean1.447-1.436=0.011
σ0.083-0.086=-0.003
min1.374-1.325=0.049
max1.688-1.645=0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.003-303.005=-0.002
σ0.017-0.019=-0.002
min302.975-302.973=0.002
max303.021-303.025=-0.004
mean1652.000-1633.000=19.000
σ0.000
min1652.000-1633.000=19.000
max1652.000-1633.000=19.000
mean0.397-0.399=-0.002
σ0.007-0.008=-0.000
min0.390-0.390=0.001
max0.408-0.408=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1304.267-1304.295=-0.028
σ0.090-0.101=-0.011
min1304.113-1304.114=-0.001
max1304.346-1304.352=-0.005
mean1652.000-1633.000=19.000
σ0.000
min1652.000-1633.000=19.000
max1652.000-1633.000=19.000
mean1.934-1.986=-0.051
σ0.097-0.250=-0.153
min1.880-1.823=0.057
max2.107-2.428=-0.321
iters=5
new-facts=6402
prior-facts=1
mean1724.610-1724.610=0.000
σ6.918-6.948=-0.029
min1721.341-1721.404=-0.063
max1736.979-1737.035=-0.055
mean1652.000-1633.000=19.000
σ0.000
min1652.000-1633.000=19.000
max1652.000-1633.000=19.000
mean3.221-3.154=0.066
σ0.219-0.285=-0.066
min2.898-2.887=0.011
max3.411-3.594=-0.183
iters=5
new-facts=6402
prior-facts=6402
mean1987.348-1987.318=0.030
σ0.012-0.054=-0.042
min1987.334-1987.236=0.098
max1987.360-1987.388=-0.028
mean1885.400-1830.800=54.600
σ204.967-190.156=14.811
min1652.000-1633.000=19.000
max2139.000-2109.000=30.000
mean3.287-3.371=-0.084
σ0.097-0.379=-0.282
min3.180-3.094=0.085
max3.394-4.023=-0.629

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.194-1.199=-0.005
σ0.404-0.329=0.075
min0.916-0.927=-0.011
max1.881-1.757=0.124

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.510-442.514=-0.004
σ572.886-572.885=0.002
min156.058-156.069=-0.011
max1301.839-1301.841=-0.002
mean94.250
σ8.500
min90.000
max107.000
mean1652.000-1633.000=19.000
σ0.000
min1652.000-1633.000=19.000
max1652.000-1633.000=19.000
mean0.547-0.537=0.010
σ0.573-0.549=0.024
min0.258-0.255=0.002
max1.406-1.361=0.046
policies=20
mean1560.948-1560.967=-0.019
σ0.311-0.315=-0.004
min1560.762-1560.775=-0.014
max1561.412-1561.437=-0.025
mean900.000
σ0.000
min900.000
max900.000
mean1652.000-1633.000=19.000
σ0.000
min1652.000-1633.000=19.000
max1652.000-1633.000=19.000
mean2.587-2.586=0.000
σ0.020-0.031=-0.011
min2.557-2.564=-0.007
max2.604-2.632=-0.029
policies=200
mean15617.508-15617.402=0.107
σ0.061-0.428=-0.367
min15617.426-15616.772=0.653
max15617.572-15617.708=-0.136
mean9000.000
σ0.000
min9000.000
max9000.000
mean1652.000-1633.000=19.000
σ0.000
min1652.000-1633.000=19.000
max1652.000-1633.000=19.000
mean26.153-26.279=-0.126
σ0.116-0.360=-0.244
min26.043-26.000=0.043
max26.263-26.794=-0.531