Compare commits

Home / Compare 83e21e2a .. 8d162a79

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=-0.001
σ0.047-0.048=-0.002
min33.950-33.945=0.005
max34.107-34.110=-0.004
mean413.600-416.000=-2.400
σ0.516-0.000=0.516
min413.000-416.000=-3.000
max414.000-416.000=-2.000
mean0.082-0.084=-0.002
σ0.005-0.003=0.002
min0.075-0.082=-0.006
max0.090-0.090=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.003=0.001
min23.313-23.313=-0.000
max23.324-23.320=0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.066-0.064=0.002
σ0.002-0.003=-0.001
min0.064-0.059=0.004
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.430=-0.001
σ0.364-0.364=-0.000
min1756.855-1756.854=0.001
max1758.020-1758.019=0.002
mean1662.200-1665.050=-2.850
σ626.630-624.964=1.666
min668.000-673.000=-5.000
max2608.000-2606.000=2.000
mean2.346-2.367=-0.021
σ0.136-0.098=0.038
min2.067-2.250=-0.184
max2.678-2.671=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.568-326.570=-0.002
σ0.062-0.039=0.023
min326.459-326.503=-0.044
max326.605-326.603=0.003
mean2608.000-2606.000=2.000
σ0.000
min2608.000-2606.000=2.000
max2608.000-2606.000=2.000
mean0.434-0.425=0.009
σ0.013-0.003=0.010
min0.422-0.421=0.000
max0.448-0.429=0.019
iters=5
new-facts=1
prior-facts=6402
mean1988.746-1988.730=0.016
σ0.008-0.009=-0.001
min1988.736-1988.718=0.018
max1988.758-1988.739=0.018
mean2608.000-2606.000=2.000
σ0.000
min2608.000-2606.000=2.000
max2608.000-2606.000=2.000
mean2.707-2.790=-0.083
σ0.116-0.147=-0.030
min2.582-2.671=-0.089
max2.846-2.963=-0.117
iters=5
new-facts=6402
prior-facts=1
mean4813.575-4813.503=0.072
σ7.706-7.763=-0.057
min4810.076-4809.471=0.605
max4827.359-4827.378=-0.019
mean2608.000-2606.000=2.000
σ0.000
min2608.000-2606.000=2.000
max2608.000-2606.000=2.000
mean8.789-8.279=0.510
σ0.267-0.515=-0.248
min8.585-7.818=0.767
max9.217-9.021=0.196
iters=5
new-facts=6402
prior-facts=6402
mean5001.137-5001.130=0.007
σ0.019-0.022=-0.003
min5001.118-5001.101=0.017
max5001.159-5001.156=0.004
mean3005.000-2972.200=32.800
σ258.996-398.920=-139.924
min2620.000-2606.000=14.000
max3312.000-3534.000=-222.000
mean9.541-9.785=-0.243
σ0.583-0.211=0.372
min8.585-9.446=-0.861
max10.018-10.024=-0.006

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.246-1.260=-0.013
σ0.398-0.411=-0.013
min0.920-0.919=0.001
max1.815-1.806=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.568-464.569=-0.001
σ574.792-574.791=0.001
min177.165-177.168=-0.003
max1326.756-1326.755=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2608.000-2606.000=2.000
σ0.000
min2608.000-2606.000=2.000
max2608.000-2606.000=2.000
mean0.547-0.548=-0.001
σ0.555-0.556=-0.001
min0.258-0.262=-0.004
max1.379-1.382=-0.002
policies=20
mean1772.035-1772.017=0.018
σ0.354-0.363=-0.009
min1771.797-1771.778=0.019
max1772.561-1772.557=0.004
mean840.000
σ0.000
min840.000
max840.000
mean2608.000-2606.000=2.000
σ0.000
min2608.000-2606.000=2.000
max2608.000-2606.000=2.000
mean2.708-2.727=-0.019
σ0.007-0.017=-0.010
min2.700-2.707=-0.007
max2.715-2.745=-0.030
policies=200
mean17727.538-17727.422=0.115
σ0.364-0.397=-0.033
min17727.326-17727.198=0.128
max17728.083-17728.017=0.066
mean8400.000
σ0.000
min8400.000
max8400.000
mean2608.000-2606.000=2.000
σ0.000
min2608.000-2606.000=2.000
max2608.000-2606.000=2.000
mean27.423-27.571=-0.148
σ0.140-0.113=0.027
min27.310-27.463=-0.153
max27.600-27.672=-0.073