Compare commits

Home / Compare 8d0f5ad7 .. 2d58e54d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.708-53.708=-0.000
σ0.364-0.365=-0.001
min53.575-53.576=-0.001
max54.743-54.745=-0.002
mean413.500-416.000=-2.500
σ0.527-0.000=0.527
min413.000-416.000=-3.000
max414.000-416.000=-2.000
mean0.135-0.137=-0.001
σ0.004-0.005=-0.001
min0.130-0.130=-0.000
max0.142-0.146=-0.004
cache=y
dps=1
iters=10
policies=100
mean42.978-42.977=0.001
σ0.006-0.006=-0.000
min42.969-42.965=0.004
max42.989-42.987=0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.121-0.118=0.003
σ0.003-0.003=0.000
min0.118-0.114=0.004
max0.128-0.124=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.528-1017.533=-0.004
σ1.220-1.206=0.014
min1016.934-1017.000=-0.066
max1022.633-1022.582=0.051
mean1064.650-1064.800=-0.150
σ312.155-312.594=-0.439
min606.000
max1638.000-1640.000=-2.000
mean1.565-1.547=0.018
σ0.059-0.042=0.017
min1.495-1.503=-0.008
max1.724-1.621=0.102

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean337.456-337.531=-0.075
σ0.232-0.252=-0.019
min337.316-337.312=0.004
max338.103-338.188=-0.086
mean2150.000-2114.000=36.000
σ0.000
min2150.000-2114.000=36.000
max2150.000-2114.000=36.000
mean0.747-0.818=-0.071
σ0.017-0.048=-0.031
min0.720-0.696=0.024
max0.766-0.849=-0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.570-297.581=-0.011
σ0.028-0.026=0.002
min297.521-297.537=-0.016
max297.586-297.606=-0.020
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.390-0.396=-0.006
σ0.006-0.010=-0.004
min0.386-0.386=-0.000
max0.400-0.410=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1320.535-1320.528=0.007
σ0.089-0.072=0.017
min1320.376-1320.410=-0.034
max1320.586-1320.595=-0.009
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean2.070-2.009=0.061
σ0.246-0.243=0.003
min1.842-1.845=-0.003
max2.431-2.430=0.001
iters=5
new-facts=6402
prior-facts=1
mean1740.718-1740.712=0.006
σ6.903-6.929=-0.026
min1737.515-1737.505=0.011
max1753.063-1753.103=-0.040
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean3.074-3.226=-0.152
σ0.280-0.252=0.028
min2.825-2.997=-0.171
max3.450-3.565=-0.115
iters=5
new-facts=6402
prior-facts=6402
mean2003.488-2003.497=-0.009
σ0.013-0.013=0.000
min2003.473-2003.482=-0.009
max2003.504-2003.515=-0.011
mean1889.400-1854.800=34.600
σ215.703-191.316=24.387
min1638.000-1640.000=-2.000
max2150.000-2114.000=36.000
mean3.321-3.336=-0.015
σ0.060-0.155=-0.095
min3.232-3.132=0.100
max3.384-3.540=-0.156

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.070=0.110
σ0.285-0.169=0.115
min0.897-0.930=-0.033
max1.565-1.364=0.200

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean441.100-441.107=-0.007
σ573.041-573.029=0.012
min154.575-154.582=-0.008
max1300.662-1300.651=0.012
mean94.250
σ8.500
min90.000
max107.000
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.542-0.525=0.017
σ0.552-0.525=0.026
min0.258-0.261=-0.003
max1.369-1.313=0.056
policies=20
mean1546.056-1546.061=-0.005
σ0.339-0.347=-0.008
min1545.859-1545.849=0.010
max1546.563-1546.580=-0.017
mean900.000
σ0.000
min900.000
max900.000
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean2.642-2.655=-0.013
σ0.011-0.018=-0.006
min2.630-2.639=-0.010
max2.652-2.672=-0.020
policies=200
mean15468.294-15468.208=0.087
σ0.052-0.091=-0.038
min15468.233-15468.140=0.092
max15468.351-15468.336=0.015
mean9000.000
σ0.000
min9000.000
max9000.000
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean26.647-26.699=-0.051
σ0.120-0.086=0.034
min26.538-26.624=-0.087
max26.779-26.778=0.001