Compare commits

Home / Compare b97b4d65 .. 5d48553e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.959-35.969=-0.009
σ0.103-0.105=-0.001
min35.912-35.920=-0.007
max36.252-36.266=-0.013
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.077-0.072=0.005
σ0.004-0.004=0.001
min0.074-0.070=0.004
max0.084-0.080=0.005
cache=y
dps=1
iters=10
policies=100
mean26.201-26.208=-0.007
σ0.003-0.005=-0.001
min26.195-26.202=-0.007
max26.206-26.218=-0.011
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.060-0.059=0.001
σ0.003-0.003=-0.000
min0.058-0.056=0.002
max0.067-0.065=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.659-1757.760=-0.101
σ0.371-0.369=0.002
min1757.081-1757.184=-0.103
max1758.257-1758.358=-0.101
mean1654.000-1652.750=1.250
σ623.090-633.272=-10.181
min680.000-618.000=62.000
max2658.000-2779.000=-121.000
mean2.360-2.377=-0.018
σ0.093-0.124=-0.031
min2.269-2.242=0.027
max2.577-2.822=-0.245

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.070-280.286=-0.216
σ0.016-0.010=0.006
min280.050-280.273=-0.224
max280.093-280.300=-0.208
mean2658.000-2779.000=-121.000
σ0.000
min2658.000-2779.000=-121.000
max2658.000-2779.000=-121.000
mean0.415-0.410=0.004
σ0.004-0.002=0.002
min0.410-0.408=0.002
max0.419-0.412=0.007
iters=5
new-facts=1
prior-facts=6402
mean2270.157-2270.319=-0.162
σ0.012-0.025=-0.013
min2270.138-2270.287=-0.149
max2270.170-2270.355=-0.185
mean2658.000-2779.000=-121.000
σ0.000
min2658.000-2779.000=-121.000
max2658.000-2779.000=-121.000
mean3.547-3.210=0.336
σ0.140-0.320=-0.180
min3.427-2.861=0.566
max3.778-3.643=0.135
iters=5
new-facts=6402
prior-facts=1
mean5139.001-5147.357=-8.356
σ1.057-1.169=-0.112
min5137.939-5146.539=-8.600
max5140.780-5149.381=-8.601
mean2658.000-2779.000=-121.000
σ0.000
min2658.000-2779.000=-121.000
max2658.000-2779.000=-121.000
mean8.576-8.759=-0.183
σ0.418-0.626=-0.208
min8.146-8.157=-0.012
max9.039-9.629=-0.590
iters=5
new-facts=6402
prior-facts=6402
mean5277.153-5285.582=-8.429
σ0.125-0.220=-0.095
min5276.974-5285.224=-8.250
max5277.324-5285.765=-8.440
mean3482.800-3448.200=34.600
σ529.530-414.639=114.890
min2773.000-2836.000=-63.000
max3984.000-3918.000=66.000
mean10.222-10.083=0.139
σ0.434-0.326=0.108
min9.616-9.617=-0.001
max10.836-10.508=0.328

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.034=0.164
σ0.411-0.065=0.345
min0.949-0.954=-0.005
max1.926-1.084=0.842

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.169-464.303=-0.134
σ572.655-572.662=-0.007
min177.838-177.963=-0.125
max1323.152-1323.296=-0.144
mean81.500
σ7.000
min78.000
max92.000
mean2658.000-2779.000=-121.000
σ0.000
min2658.000-2779.000=-121.000
max2658.000-2779.000=-121.000
mean0.560-0.442=0.118
σ0.562-0.308=0.254
min0.275-0.282=-0.006
max1.403-0.903=0.500
policies=20
mean1778.617-1779.957=-1.340
σ0.369-0.365=0.005
min1778.401-1779.714=-1.313
max1779.170-1780.489=-1.319
mean780.000
σ0.000
min780.000
max780.000
mean2658.000-2779.000=-121.000
σ0.000
min2658.000-2779.000=-121.000
max2658.000-2779.000=-121.000
mean2.766-2.853=-0.087
σ0.023-0.070=-0.047
min2.737-2.798=-0.061
max2.786-2.952=-0.166
policies=200
mean17793.071-17805.993=-12.922
σ0.539-0.532=0.007
min17792.721-17805.659=-12.938
max17793.870-17806.781=-12.912
mean7800.000
σ0.000
min7800.000
max7800.000
mean2658.000-2779.000=-121.000
σ0.000
min2658.000-2779.000=-121.000
max2658.000-2779.000=-121.000
mean27.967-28.007=-0.040
σ0.087-0.120=-0.033
min27.837-27.893=-0.056
max28.021-28.143=-0.122