Compare commits

Home / Compare 025695fa .. c98aa044

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.710=-0.056
σ0.373-0.365=0.007
min53.516-53.569=-0.053
max54.714-54.750=-0.036
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.137-0.139=-0.003
σ0.005-0.003=0.002
min0.129-0.136=-0.007
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean42.981-42.977=0.004
σ0.006-0.006=-0.000
min42.974-42.969=0.004
max42.992-42.986=0.005
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.121-0.121=0.001
σ0.004-0.003=0.000
min0.118-0.118=0.000
max0.128-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.700-995.215=18.485
σ1.207-1.218=-0.011
min1013.159-994.689=18.470
max1018.749-1000.325=18.424
mean1049.100-1073.050=-23.950
σ313.783-319.946=-6.163
min607.000-595.000=12.000
max1651.000-1632.000=19.000
mean1.621-1.492=0.128
σ0.084-0.072=0.013
min1.494-1.405=0.089
max1.840-1.670=0.170

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean334.293
σ0.225
min334.076
max334.885
mean2080.000
σ0.000
min2080.000
max2080.000
mean0.768
σ0.045
min0.722
max0.850

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.412-297.316=-2.904
σ0.012-0.003=0.008
min294.396-297.312=-2.916
max294.426-297.319=-2.893
mean1651.000-1632.000=19.000
σ0.000
min1651.000-1632.000=19.000
max1651.000-1632.000=19.000
mean0.382-0.388=-0.007
σ0.002-0.000=0.001
min0.379-0.388=-0.009
max0.383-0.389=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1316.732-1299.020=17.712
σ0.051-0.069=-0.018
min1316.646-1298.902=17.744
max1316.770-1299.067=17.702
mean1651.000-1632.000=19.000
σ0.000
min1651.000-1632.000=19.000
max1651.000-1632.000=19.000
mean1.888-1.916=-0.029
σ0.065-0.118=-0.053
min1.839-1.833=0.006
max1.990-2.124=-0.134
iters=5
new-facts=6402
prior-facts=1
mean1736.953-1719.185=17.768
σ6.921-6.860=0.060
min1733.744-1715.996=17.747
max1749.329-1731.454=17.875
mean1651.000-1632.000=19.000
σ0.000
min1651.000-1632.000=19.000
max1651.000-1632.000=19.000
mean2.964-2.943=0.021
σ0.430-0.252=0.177
min2.538-2.602=-0.064
max3.685-3.214=0.471
iters=5
new-facts=6402
prior-facts=6402
mean1999.622-1981.915=17.707
σ0.033-0.029=0.004
min1999.585-1981.869=17.716
max1999.667-1981.941=17.726
mean1806.000-1803.000=3.000
σ184.352-200.858=-16.507
min1651.000-1632.000=19.000
max2080.000-2101.000=-21.000
mean3.305-3.405=-0.100
σ0.144-0.392=-0.248
min3.152-3.091=0.061
max3.533-4.077=-0.544

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.183=0.025
σ0.308-0.315=-0.007
min0.918-0.915=0.003
max1.720-1.678=0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean441.084-440.457=0.628
σ573.034-573.037=-0.002
min154.562-153.929=0.633
max1300.636-1300.012=0.624
mean94.250
σ8.500
min90.000
max107.000
mean1651.000-1632.000=19.000
σ0.000
min1651.000-1632.000=19.000
max1651.000-1632.000=19.000
mean0.476-0.559=-0.083
σ0.432-0.609=-0.177
min0.259-0.252=0.007
max1.124-1.473=-0.349
policies=20
mean1545.926-1539.571=6.356
σ0.321-0.293=0.029
min1545.739-1539.383=6.356
max1546.407-1540.006=6.401
mean900.000
σ0.000
min900.000
max900.000
mean1651.000-1632.000=19.000
σ0.000
min1651.000-1632.000=19.000
max1651.000-1632.000=19.000
mean2.608-2.549=0.059
σ0.015-0.013=0.002
min2.597-2.537=0.060
max2.630-2.565=0.065
policies=200
mean15467.102-15403.662=63.440
σ0.034-0.124=-0.089
min15467.069-15403.501=63.568
max15467.142-15403.764=63.378
mean9000.000
σ0.000
min9000.000
max9000.000
mean1651.000-1632.000=19.000
σ0.000
min1651.000-1632.000=19.000
max1651.000-1632.000=19.000
mean26.627-26.160=0.468
σ0.095-0.310=-0.215
min26.512-25.826=0.686
max26.723-26.470=0.253