Compare commits

Home / Compare eff0a7f2 .. 836d2d73

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.710-53.710=0.000
σ0.362-0.366=-0.004
min53.575-53.571=0.004
max54.738-54.750=-0.012
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.139-0.139=-0.000
σ0.004-0.004=-0.001
min0.135-0.134=0.001
max0.145-0.148=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.979-42.978=0.001
σ0.004-0.006=-0.002
min42.973-42.965=0.007
max42.986-42.985=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.119-0.121=-0.001
σ0.004-0.003=0.001
min0.112-0.117=-0.005
max0.125-0.126=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.223-995.221=0.003
σ1.184-1.195=-0.010
min994.685-994.684=0.002
max1000.194-1000.232=-0.038
mean1064.000-1058.850=5.150
σ317.909-312.336=5.573
min611.000-608.000=3.000
max1628.000-1630.000=-2.000
mean1.480-1.498=-0.018
σ0.088-0.085=0.003
min1.393-1.392=0.001
max1.653-1.653=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.321-297.318=0.004
σ0.010-0.008=0.002
min297.314-297.311=0.003
max297.340-297.332=0.007
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean0.386-0.386=-0.001
σ0.002-0.001=0.001
min0.383-0.385=-0.002
max0.388-0.388=0.000
iters=5
new-facts=1
prior-facts=6402
mean1299.002-1299.019=-0.017
σ0.090-0.089=0.001
min1298.847-1298.861=-0.014
max1299.064-1299.071=-0.007
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean1.888-1.994=-0.106
σ0.045-0.161=-0.116
min1.841-1.858=-0.017
max1.951-2.222=-0.271
iters=5
new-facts=6402
prior-facts=1
mean1719.170-1719.178=-0.008
σ6.932-6.926=0.006
min1715.967-1715.926=0.040
max1731.567-1731.563=0.004
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean3.087-3.206=-0.119
σ0.487-0.441=0.046
min2.701-2.764=-0.063
max3.912-3.692=0.219
iters=5
new-facts=6402
prior-facts=6402
mean1981.955-1981.925=0.030
σ0.011-0.032=-0.021
min1981.943-1981.869=0.075
max1981.969-1981.945=0.024
mean1825.200-1808.400=16.800
σ207.361-176.350=31.011
min1628.000-1630.000=-2.000
max2100.000-2060.000=40.000
mean3.255-3.298=-0.042
σ0.111-0.418=-0.308
min3.101-2.948=0.153
max3.384-4.022=-0.638

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.248-1.189=0.059
σ0.286-0.347=-0.061
min1.030-0.912=0.118
max1.703-1.756=-0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.455-440.459=-0.004
σ573.031-573.040=-0.009
min153.936-153.936=-0.000
max1300.001-1300.018=-0.017
mean94.250
σ8.500
min90.000
max107.000
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean0.551-0.540=0.011
σ0.583-0.560=0.023
min0.257-0.255=0.002
max1.425-1.380=0.045
policies=20
mean1539.587-1539.611=-0.024
σ0.297-0.299=-0.002
min1539.392-1539.424=-0.032
max1540.028-1540.057=-0.029
mean900.000
σ0.000
min900.000
max900.000
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean2.557-2.565=-0.008
σ0.013-0.006=0.007
min2.544-2.560=-0.016
max2.570-2.573=-0.003
policies=200
mean15404.084-15403.974=0.110
σ0.078-0.100=-0.022
min15403.993-15403.875=0.119
max15404.177-15404.113=0.064
mean9000.000
σ0.000
min9000.000
max9000.000
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean25.946-25.959=-0.013
σ0.171-0.153=0.018
min25.759-25.807=-0.049
max26.126-26.109=0.017