Compare commits

Home / Compare aa7010d1 .. af16434b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.700-70.701=-0.001
σ0.045-0.045=0.001
min70.672-70.673=-0.001
max70.826-70.825=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.154-0.160=-0.006
σ0.005-0.004=0.001
min0.149-0.153=-0.004
max0.160-0.167=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.000
σ0.001-0.004=-0.003
min21.406-21.401=0.005
max21.410-21.414=-0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.064=-0.001
σ0.004-0.003=0.001
min0.059-0.059=-0.000
max0.073-0.068=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.928=0.003
σ0.361-0.359=0.001
min1754.358-1754.371=-0.013
max1755.529-1755.514=0.015
mean1639.200-1649.550=-10.350
σ630.548-631.950=-1.402
min624.000-632.000=-8.000
max2787.000-2774.000=13.000
mean2.848-2.832=0.016
σ0.150-0.250=-0.100
min2.520-2.183=0.337
max3.058-3.462=-0.403

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.730-272.755=-0.025
σ0.004-0.003=0.001
min272.723-272.752=-0.029
max272.733-272.760=-0.026
mean2787.000-2774.000=13.000
σ0.000
min2787.000-2774.000=13.000
max2787.000-2774.000=13.000
mean0.385-0.387=-0.002
σ0.009-0.009=0.001
min0.379-0.380=-0.001
max0.401-0.398=0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.174-1933.161=0.013
σ0.012-0.016=-0.004
min1933.155-1933.143=0.012
max1933.186-1933.179=0.007
mean2787.000-2774.000=13.000
σ0.000
min2787.000-2774.000=13.000
max2787.000-2774.000=13.000
mean2.943-2.955=-0.012
σ0.319-0.122=0.197
min2.482-2.738=-0.256
max3.225-3.028=0.197
iters=5
new-facts=6402
prior-facts=1
mean4756.950-4756.908=0.042
σ7.594-7.654=-0.060
min4753.407-4753.365=0.042
max4770.534-4770.599=-0.065
mean2787.000-2774.000=13.000
σ0.000
min2787.000-2774.000=13.000
max2787.000-2774.000=13.000
mean8.168-8.843=-0.675
σ0.540-0.405=0.135
min7.733-8.372=-0.639
max9.012-9.355=-0.343
iters=5
new-facts=6402
prior-facts=6402
mean4944.400-4944.393=0.007
σ0.013-0.013=-0.000
min4944.380-4944.378=0.002
max4944.415-4944.409=0.006
mean3039.200-3030.400=8.800
σ281.575-320.196=-38.620
min2787.000-2774.000=13.000
max3430.000-3520.000=-90.000
mean8.517-8.539=-0.022
σ0.108-0.255=-0.146
min8.363-8.323=0.040
max8.662-8.857=-0.196

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.978-0.994=-0.017
σ0.148-0.130=0.018
min0.907-0.907=0.001
max1.242-1.202=0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.339-468.338=0.001
σ574.258-574.255=0.004
min181.203-181.201=0.003
max1329.726-1329.720=0.006
mean88.250
σ8.500
min84.000
max101.000
mean2787.000-2774.000=13.000
σ0.000
min2787.000-2774.000=13.000
max2787.000-2774.000=13.000
mean0.445-0.442=0.003
σ0.297-0.303=-0.006
min0.293-0.286=0.007
max0.891-0.896=-0.006
policies=20
mean1812.217-1812.346=-0.128
σ0.338-0.395=-0.057
min1811.990-1812.069=-0.079
max1812.710-1812.927=-0.217
mean840.000
σ0.000
min840.000
max840.000
mean2787.000-2774.000=13.000
σ0.000
min2787.000-2774.000=13.000
max2787.000-2774.000=13.000
mean2.859-2.887=-0.028
σ0.112-0.003=0.109
min2.777-2.883=-0.106
max3.024-2.890=0.134
policies=200
mean18128.895-18129.142=-0.247
σ0.609-0.508=0.101
min18128.436-18128.798=-0.362
max18129.780-18129.886=-0.106
mean8400.000
σ0.000
min8400.000
max8400.000
mean2787.000-2774.000=13.000
σ0.000
min2787.000-2774.000=13.000
max2787.000-2774.000=13.000
mean28.415-28.494=-0.079
σ0.102-0.215=-0.113
min28.347-28.200=0.147
max28.565-28.667=-0.101