Compare commits

Home / Compare d62f8a4d .. 0db1e4df

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.710-53.709=0.001
σ0.366-0.367=-0.001
min53.570-53.569=0.001
max54.752-54.753=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.139-0.138=0.001
σ0.004-0.005=-0.001
min0.135-0.130=0.006
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean42.978-42.978=-0.000
σ0.005-0.005=-0.000
min42.968-42.967=0.001
max42.984-42.984=-0.001
mean415.000-414.100=0.900
σ0.000-0.316=-0.316
min415.000-414.000=1.000
max415.000
mean0.118-0.121=-0.003
σ0.004-0.004=0.000
min0.113-0.117=-0.003
max0.125-0.128=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.217-995.227=-0.010
σ1.193-1.170=0.022
min994.689-994.657=0.032
max1000.221-1000.135=0.085
mean1055.500-1056.800=-1.300
σ312.576-312.284=0.292
min596.000-604.000=-8.000
max1600.000-1625.000=-25.000
mean1.477-1.478=-0.001
σ0.089-0.075=0.014
min1.371-1.383=-0.012
max1.704-1.640=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.324-297.301=0.023
σ0.004-0.022=-0.018
min297.318-297.278=0.040
max297.328-297.334=-0.006
mean1600.000-1625.000=-25.000
σ0.000
min1600.000-1625.000=-25.000
max1600.000-1625.000=-25.000
mean0.406-0.391=0.015
σ0.005-0.007=-0.002
min0.400-0.387=0.013
max0.410-0.405=0.006
iters=5
new-facts=1
prior-facts=6402
mean1299.015-1299.003=0.012
σ0.100-0.093=0.007
min1298.842-1298.841=0.001
max1299.087-1299.072=0.015
mean1600.000-1625.000=-25.000
σ0.000
min1600.000-1625.000=-25.000
max1600.000-1625.000=-25.000
mean2.024-1.927=0.097
σ0.274-0.057=0.218
min1.848-1.853=-0.006
max2.506-2.009=0.497
iters=5
new-facts=6402
prior-facts=1
mean1719.181-1719.180=0.001
σ6.917-6.963=-0.046
min1715.993-1715.959=0.034
max1731.551-1731.634=-0.082
mean1600.000-1625.000=-25.000
σ0.000
min1600.000-1625.000=-25.000
max1600.000-1625.000=-25.000
mean3.097-3.109=-0.012
σ0.227-0.547=-0.320
min2.856-2.636=0.219
max3.428-4.046=-0.619
iters=5
new-facts=6402
prior-facts=6402
mean1981.942-1981.955=-0.013
σ0.009-0.009=-0.000
min1981.928-1981.949=-0.022
max1981.948-1981.970=-0.022
mean1789.800-1827.200=-37.400
σ170.539-211.772=-41.232
min1600.000-1625.000=-25.000
max2009.000-2103.000=-94.000
mean3.186-3.178=0.008
σ0.105-0.057=0.047
min3.121-3.104=0.017
max3.367-3.262=0.105

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.259-1.218=0.041
σ0.231-0.354=-0.123
min1.000-0.901=0.098
max1.515-1.763=-0.248

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.463-440.465=-0.002
σ573.039-573.037=0.002
min153.933-153.939=-0.005
max1300.022-1300.020=0.001
mean94.250
σ8.500
min90.000
max107.000
mean1600.000-1625.000=-25.000
σ0.000
min1600.000-1625.000=-25.000
max1600.000-1625.000=-25.000
mean0.543-0.558=-0.015
σ0.561-0.603=-0.042
min0.258-0.253=0.005
max1.384-1.462=-0.078
policies=20
mean1539.610-1539.613=-0.003
σ0.301-0.302=-0.000
min1539.413-1539.422=-0.009
max1540.058-1540.062=-0.004
mean900.000
σ0.000
min900.000
max900.000
mean1600.000-1625.000=-25.000
σ0.000
min1600.000-1625.000=-25.000
max1600.000-1625.000=-25.000
mean2.564-2.564=0.000
σ0.021-0.015=0.007
min2.539-2.550=-0.011
max2.590-2.581=0.009
policies=200
mean15404.107-15404.070=0.036
σ0.058-0.067=-0.009
min15404.027-15403.993=0.035
max15404.161-15404.128=0.033
mean9000.000
σ0.000
min9000.000
max9000.000
mean1600.000-1625.000=-25.000
σ0.000
min1600.000-1625.000=-25.000
max1600.000-1625.000=-25.000
mean25.946-25.843=0.103
σ0.079-0.125=-0.047
min25.881-25.732=0.149
max26.049-26.008=0.041