Compare commits

Home / Compare dc400bc9 .. 7e721e63

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.781=-0.079
σ0.047-0.046=0.001
min70.672-70.751=-0.079
max70.832-70.909=-0.077
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.161-0.158=0.003
σ0.004-0.003=0.000
min0.157-0.152=0.005
max0.167-0.162=0.005
cache=y
dps=1
iters=10
policies=100
mean21.408-21.493=-0.084
σ0.002-0.002=-0.000
min21.405-21.490=-0.085
max21.411-21.496=-0.085
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.001
min0.063-0.059=0.005
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.092=0.839
σ0.363-0.361=0.001
min1754.363-1753.524=0.838
max1755.519-1754.676=0.843
mean1666.200-1669.050=-2.850
σ636.621-645.386=-8.764
min669.000-665.000=4.000
max2699.000-2655.000=44.000
mean2.821-2.845=-0.023
σ0.222-0.131=0.091
min2.260-2.528=-0.269
max3.123-3.135=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-271.955=0.801
σ0.007-0.009=-0.002
min272.747-271.942=0.805
max272.764-271.964=0.800
mean2699.000-2655.000=44.000
σ0.000
min2699.000-2655.000=44.000
max2699.000-2655.000=44.000
mean0.383-0.383=0.000
σ0.005-0.007=-0.002
min0.380-0.379=0.001
max0.392-0.396=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.159-1932.322=0.837
σ0.014-0.006=0.008
min1933.140-1932.313=0.827
max1933.174-1932.328=0.845
mean2699.000-2655.000=44.000
σ0.000
min2699.000-2655.000=44.000
max2699.000-2655.000=44.000
mean3.114-2.933=0.181
σ0.080-0.309=-0.228
min3.029-2.391=0.638
max3.207-3.145=0.062
iters=5
new-facts=6402
prior-facts=1
mean4756.922-4753.127=3.795
σ7.634-0.839=6.794
min4753.441-4752.588=0.853
max4770.577-4754.613=15.964
mean2699.000-2655.000=44.000
σ0.000
min2699.000-2655.000=44.000
max2699.000-2655.000=44.000
mean8.573-8.287=0.286
σ0.406-0.526=-0.120
min7.941-7.581=0.360
max8.937-8.971=-0.034
iters=5
new-facts=6402
prior-facts=6402
mean4944.387-4943.488=0.899
σ0.018-0.146=-0.129
min4944.368-4943.228=1.141
max4944.413-4943.574=0.839
mean3019.600-3019.200=0.400
σ349.647-273.507=76.140
min2699.000-2655.000=44.000
max3530.000-3339.000=191.000
mean8.477-8.556=-0.080
σ0.132-0.146=-0.014
min8.369-8.391=-0.022
max8.706-8.713=-0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.015-1.222=-0.207
σ0.143-0.271=-0.127
min0.911-0.924=-0.014
max1.226-1.646=-0.420

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.331-468.657=-0.327
σ574.270-574.936=-0.665
min181.188-181.187=0.001
max1329.736-1331.061=-1.325
mean88.250
σ8.500
min84.000
max101.000
mean2699.000-2655.000=44.000
σ0.000
min2699.000-2655.000=44.000
max2699.000-2655.000=44.000
mean0.557-0.560=-0.003
σ0.542-0.556=-0.014
min0.285-0.275=0.009
max1.370-1.394=-0.024
policies=20
mean1812.189-1812.203=-0.014
σ0.380-0.375=0.005
min1811.934-1811.953=-0.019
max1812.752-1812.757=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2699.000-2655.000=44.000
σ0.000
min2699.000-2655.000=44.000
max2699.000-2655.000=44.000
mean2.825-2.848=-0.023
σ0.013-0.029=-0.015
min2.808-2.818=-0.010
max2.836-2.884=-0.049
policies=200
mean18129.052-18129.230=-0.178
σ0.450-0.433=0.018
min18128.786-18128.917=-0.131
max18129.725-18129.868=-0.144
mean8400.000
σ0.000
min8400.000
max8400.000
mean2699.000-2655.000=44.000
σ0.000
min2699.000-2655.000=44.000
max2699.000-2655.000=44.000
mean28.358-28.631=-0.272
σ0.098-0.109=-0.011
min28.248-28.496=-0.248
max28.452-28.740=-0.288