Compare commits

Home / Compare f2e3fb4c .. 353d50dc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.105-54.105=0.000
σ0.366-0.363=0.002
min53.959-53.970=-0.011
max55.145-55.138=0.006
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.140-0.137=0.003
σ0.004-0.004=0.000
min0.135-0.129=0.006
max0.147-0.143=0.004
cache=y
dps=1
iters=10
policies=100
mean43.379-43.380=-0.000
σ0.005-0.006=-0.001
min43.370-43.367=0.003
max43.388-43.388=-0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.123-0.123=-0.000
σ0.004-0.003=0.001
min0.119-0.120=-0.001
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean997.129-997.119=0.010
σ1.182-1.211=-0.029
min996.580-996.586=-0.007
max1002.090-1002.199=-0.110
mean1051.250-1048.900=2.350
σ310.231-304.618=5.612
min597.000-602.000=-5.000
max1633.000-1648.000=-15.000
mean1.436-1.439=-0.002
σ0.086-0.071=0.015
min1.325-1.347=-0.022
max1.645-1.629=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.005-303.002=0.003
σ0.019-0.036=-0.017
min302.973-302.938=0.035
max303.025-303.026=-0.001
mean1633.000-1648.000=-15.000
σ0.000
min1633.000-1648.000=-15.000
max1633.000-1648.000=-15.000
mean0.399-0.407=-0.008
σ0.008-0.011=-0.004
min0.390-0.397=-0.007
max0.408-0.427=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1304.295-1304.290=0.005
σ0.101-0.046=0.056
min1304.114-1304.235=-0.121
max1304.352-1304.359=-0.007
mean1633.000-1648.000=-15.000
σ0.000
min1633.000-1648.000=-15.000
max1633.000-1648.000=-15.000
mean1.986-1.948=0.038
σ0.250-0.107=0.143
min1.823-1.856=-0.034
max2.428-2.128=0.300
iters=5
new-facts=6402
prior-facts=1
mean1724.610-1724.614=-0.004
σ6.948-6.922=0.026
min1721.404-1721.411=-0.007
max1737.035-1736.991=0.043
mean1633.000-1648.000=-15.000
σ0.000
min1633.000-1648.000=-15.000
max1633.000-1648.000=-15.000
mean3.154-2.929=0.225
σ0.285-0.349=-0.064
min2.887-2.459=0.428
max3.594-3.406=0.188
iters=5
new-facts=6402
prior-facts=6402
mean1987.318-1987.309=0.009
σ0.054-0.049=0.005
min1987.236-1987.223=0.014
max1987.388-1987.347=0.041
mean1830.800-1868.200=-37.400
σ190.156-232.898=-42.743
min1633.000-1648.000=-15.000
max2109.000-2169.000=-60.000
mean3.371-3.188=0.183
σ0.379-0.105=0.274
min3.094-3.085=0.009
max4.023-3.365=0.658

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.199-1.296=-0.097
σ0.329-0.360=-0.031
min0.927-0.918=0.009
max1.757-1.853=-0.096

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.514-442.513=0.001
σ572.885-572.881=0.004
min156.069-156.061=0.008
max1301.841-1301.833=0.008
mean94.250
σ8.500
min90.000
max107.000
mean1633.000-1648.000=-15.000
σ0.000
min1633.000-1648.000=-15.000
max1633.000-1648.000=-15.000
mean0.537-0.551=-0.014
σ0.549-0.576=-0.027
min0.255-0.257=-0.002
max1.361-1.415=-0.054
policies=20
mean1560.967-1560.941=0.026
σ0.315-0.317=-0.002
min1560.775-1560.733=0.042
max1561.437-1561.412=0.025
mean900.000
σ0.000
min900.000
max900.000
mean1633.000-1648.000=-15.000
σ0.000
min1633.000-1648.000=-15.000
max1633.000-1648.000=-15.000
mean2.586-2.588=-0.002
σ0.031-0.023=0.008
min2.564-2.561=0.004
max2.632-2.615=0.017
policies=200
mean15617.402-15617.498=-0.096
σ0.428-0.083=0.345
min15616.772-15617.399=-0.627
max15617.708-15617.582=0.127
mean9000.000
σ0.000
min9000.000
max9000.000
mean1633.000-1648.000=-15.000
σ0.000
min1633.000-1648.000=-15.000
max1633.000-1648.000=-15.000
mean26.279-26.230=0.050
σ0.360-0.161=0.199
min26.000-26.110=-0.110
max26.794-26.459=0.335