Compare commits

Home / Compare af16434b .. 805a0451

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.700=0.002
σ0.048-0.045=0.003
min70.667-70.672=-0.005
max70.834-70.826=0.008
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.161-0.154=0.008
σ0.003-0.005=-0.002
min0.159-0.149=0.010
max0.167-0.160=0.007
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.000
σ0.002-0.001=0.001
min21.404-21.406=-0.002
max21.411-21.410=0.001
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.065-0.063=0.001
σ0.003-0.004=-0.001
min0.060-0.059=0.001
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.932=-0.001
σ0.360-0.361=-0.000
min1754.356-1754.358=-0.002
max1755.529-1755.529=-0.000
mean1641.750-1639.200=2.550
σ635.020-630.548=4.472
min628.000-624.000=4.000
max2795.000-2787.000=8.000
mean2.825-2.848=-0.024
σ0.259-0.150=0.109
min2.153-2.520=-0.368
max3.382-3.058=0.324

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.730=0.025
σ0.006-0.004=0.001
min272.751-272.723=0.028
max272.762-272.733=0.029
mean2795.000-2787.000=8.000
σ0.000
min2795.000-2787.000=8.000
max2795.000-2787.000=8.000
mean0.384-0.385=-0.001
σ0.009-0.009=-0.000
min0.379-0.379=-0.000
max0.400-0.401=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.161-1933.174=-0.012
σ0.012-0.012=0.000
min1933.145-1933.155=-0.010
max1933.174-1933.186=-0.012
mean2795.000-2787.000=8.000
σ0.000
min2795.000-2787.000=8.000
max2795.000-2787.000=8.000
mean3.065-2.943=0.122
σ0.074-0.319=-0.245
min2.997-2.482=0.515
max3.156-3.225=-0.069
iters=5
new-facts=6402
prior-facts=1
mean4756.907-4756.950=-0.043
σ7.659-7.594=0.065
min4753.400-4753.407=-0.007
max4770.608-4770.534=0.074
mean2795.000-2787.000=8.000
σ0.000
min2795.000-2787.000=8.000
max2795.000-2787.000=8.000
mean8.620-8.168=0.452
σ0.520-0.540=-0.019
min7.759-7.733=0.026
max9.102-9.012=0.089
iters=5
new-facts=6402
prior-facts=6402
mean4944.394-4944.400=-0.006
σ0.019-0.013=0.006
min4944.368-4944.380=-0.013
max4944.411-4944.415=-0.004
mean3004.200-3039.200=-35.000
σ272.549-281.575=-9.026
min2795.000-2787.000=8.000
max3419.000-3430.000=-11.000
mean8.369-8.517=-0.148
σ0.050-0.108=-0.059
min8.322-8.363=-0.041
max8.452-8.662=-0.209

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.974-0.978=-0.004
σ0.145-0.148=-0.002
min0.903-0.907=-0.004
max1.234-1.242=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.338-468.339=-0.001
σ574.256-574.258=-0.003
min181.198-181.203=-0.005
max1329.721-1329.726=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2795.000-2787.000=8.000
σ0.000
min2795.000-2787.000=8.000
max2795.000-2787.000=8.000
mean0.439-0.445=-0.006
σ0.292-0.297=-0.006
min0.291-0.293=-0.002
max0.876-0.891=-0.014
policies=20
mean1812.361-1812.217=0.143
σ0.406-0.338=0.068
min1812.088-1811.990=0.098
max1812.960-1812.710=0.250
mean840.000
σ0.000
min840.000
max840.000
mean2795.000-2787.000=8.000
σ0.000
min2795.000-2787.000=8.000
max2795.000-2787.000=8.000
mean2.920-2.859=0.061
σ0.076-0.112=-0.036
min2.874-2.777=0.096
max3.033-3.024=0.009
policies=200
mean18128.988-18128.895=0.093
σ0.574-0.609=-0.034
min18128.516-18128.436=0.080
max18129.825-18129.780=0.044
mean8400.000
σ0.000
min8400.000
max8400.000
mean2795.000-2787.000=8.000
σ0.000
min2795.000-2787.000=8.000
max2795.000-2787.000=8.000
mean28.314-28.415=-0.100
σ0.134-0.102=0.033
min28.188-28.347=-0.159
max28.504-28.565=-0.061