Compare commits

Home / Compare e5639cf4 .. 30e71ddc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.706-70.706=0.000
σ0.047-0.048=-0.001
min70.673-70.672=0.001
max70.836-70.838=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.158-0.159=-0.000
σ0.006-0.004=0.002
min0.149-0.154=-0.005
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.412-21.412=0.000
σ0.002-0.003=-0.001
min21.408-21.408=0.000
max21.413-21.416=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.063-0.063=0.000
σ0.004-0.004=0.000
min0.059-0.058=0.001
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.933=-0.001
σ0.359-0.364=-0.005
min1754.357-1754.368=-0.011
max1755.500-1755.533=-0.033
mean1646.750-1658.050=-11.300
σ632.917-616.333=16.584
min623.000-622.000=1.000
max2772.000-2493.000=279.000
mean2.846-2.797=0.048
σ0.148-0.222=-0.075
min2.447-2.192=0.255
max3.171-3.054=0.117

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.794-272.793=0.001
σ0.006-0.008=-0.002
min272.786-272.784=0.002
max272.803-272.804=-0.001
mean2772.000-2493.000=279.000
σ0.000
min2772.000-2493.000=279.000
max2772.000-2493.000=279.000
mean0.387-0.384=0.003
σ0.009-0.007=0.002
min0.378-0.379=-0.001
max0.399-0.394=0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.228-1933.225=0.004
σ0.012-0.016=-0.004
min1933.208-1933.199=0.009
max1933.238-1933.238=0.000
mean2772.000-2493.000=279.000
σ0.000
min2772.000-2493.000=279.000
max2772.000-2493.000=279.000
mean3.056-3.034=0.021
σ0.156-0.142=0.014
min2.879-2.807=0.072
max3.302-3.173=0.128
iters=5
new-facts=6402
prior-facts=1
mean4757.039-4756.713=0.326
σ7.555-7.716=-0.162
min4753.563-4752.936=0.627
max4770.553-4770.507=0.046
mean2772.000-2493.000=279.000
σ0.000
min2772.000-2493.000=279.000
max2772.000-2493.000=279.000
mean8.084-8.844=-0.761
σ0.365-0.215=0.150
min7.750-8.567=-0.817
max8.699-9.022=-0.323
iters=5
new-facts=6402
prior-facts=6402
mean4944.312-4944.379=-0.067
σ0.184-0.171=0.013
min4944.097-4944.075=0.022
max4944.468-4944.477=-0.009
mean3050.200-2922.000=128.200
σ327.312-320.153=7.159
min2772.000-2493.000=279.000
max3509.000-3359.000=150.000
mean8.477-8.478=-0.001
σ0.159-0.149=0.011
min8.308-8.231=0.077
max8.735-8.601=0.135

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.006-1.621=-0.615
σ0.136-0.157=-0.021
min0.908-1.353=-0.445
max1.226-1.763=-0.537

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.323-468.305=0.018
σ574.233-574.228=0.006
min181.201-181.183=0.018
max1329.673-1329.647=0.026
mean88.250
σ8.500
min84.000
max101.000
mean2772.000-2493.000=279.000
σ0.000
min2772.000-2493.000=279.000
max2772.000-2493.000=279.000
mean0.442-0.550=-0.107
σ0.296-0.525=-0.229
min0.288-0.285=0.003
max0.887-1.337=-0.450
policies=20
mean1812.349-1812.177=0.172
σ0.393-0.394=-0.001
min1812.070-1811.913=0.158
max1812.924-1812.760=0.164
mean840.000
σ0.000
min840.000
max840.000
mean2772.000-2493.000=279.000
σ0.000
min2772.000-2493.000=279.000
max2772.000-2493.000=279.000
mean2.879-2.809=0.070
σ0.023-0.020=0.003
min2.849-2.786=0.064
max2.904-2.833=0.070
policies=200
mean18129.146-18129.153=-0.007
σ0.527-0.438=0.089
min18128.687-18128.852=-0.166
max18129.905-18129.804=0.101
mean8400.000
σ0.000
min8400.000
max8400.000
mean2772.000-2493.000=279.000
σ0.000
min2772.000-2493.000=279.000
max2772.000-2493.000=279.000
mean28.435-28.433=0.003
σ0.124-0.089=0.035
min28.293-28.359=-0.066
max28.556-28.557=-0.001