Compare commits

Home / Compare c9239e3a .. d8dece59

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.822=0.001
σ0.368-0.367=0.001
min53.679-53.677=0.002
max54.870-54.866=0.004
mean420.000-414.700=5.300
σ0.000-0.483=-0.483
min420.000-414.000=6.000
max420.000-415.000=5.000
mean0.137-0.139=-0.002
σ0.007-0.004=0.003
min0.130-0.136=-0.006
max0.151-0.145=0.006
cache=y
dps=1
iters=10
policies=100
mean43.210-43.208=0.003
σ0.006-0.005=0.001
min43.200-43.199=0.001
max43.217-43.217=0.000
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.127-0.120=0.007
σ0.010-0.004=0.006
min0.117-0.114=0.003
max0.139-0.126=0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.176-1016.176=-0.000
σ1.168-1.174=-0.006
min1015.628-1015.613=0.015
max1021.069-1021.089=-0.020
mean1045.800-1047.600=-1.800
σ311.387-312.129=-0.742
min592.000-555.000=37.000
max1638.000-1514.000=124.000
mean1.568-1.554=0.014
σ0.097-0.054=0.043
min1.454-1.484=-0.029
max1.847-1.678=0.168

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.123-301.147=-0.024
σ0.186-0.245=-0.059
min300.942-300.913=0.029
max301.564-301.789=-0.225
mean2028.000-2038.000=-10.000
σ0.000
min2028.000-2038.000=-10.000
max2028.000-2038.000=-10.000
mean0.540-0.550=-0.010
σ0.029-0.028=0.001
min0.507-0.508=-0.001
max0.578-0.578=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.699-300.693=0.006
σ0.028-0.043=-0.015
min300.658-300.624=0.035
max300.729-300.737=-0.008
mean1638.000-1514.000=124.000
σ0.000
min1638.000-1514.000=124.000
max1638.000-1514.000=124.000
mean0.403-0.407=-0.004
σ0.014-0.015=-0.001
min0.388-0.392=-0.004
max0.421-0.431=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1322.858-1322.861=-0.003
σ0.099-0.085=0.014
min1322.809-1322.819=-0.010
max1323.036-1323.013=0.023
mean1638.000-1514.000=124.000
σ0.000
min1638.000-1514.000=124.000
max1638.000-1514.000=124.000
mean1.947-1.886=0.061
σ0.116-0.075=0.042
min1.828-1.817=0.011
max2.091-1.977=0.115
iters=5
new-facts=6402
prior-facts=1
mean1561.298-1561.329=-0.031
σ6.912-6.898=0.014
min1557.985-1558.030=-0.046
max1573.658-1573.665=-0.007
mean1638.000-1514.000=124.000
σ0.000
min1638.000-1514.000=124.000
max1638.000-1514.000=124.000
mean2.268-2.361=-0.093
σ0.279-0.324=-0.045
min2.083-2.044=0.039
max2.750-2.737=0.013
iters=5
new-facts=6402
prior-facts=6402
mean1890.790-1890.793=-0.003
σ0.013-0.020=-0.007
min1890.770-1890.774=-0.003
max1890.803-1890.819=-0.016
mean1773.200-1734.000=39.200
σ166.677-214.936=-48.259
min1638.000-1514.000=124.000
max2028.000-2038.000=-10.000
mean2.894-2.892=0.003
σ0.115-0.031=0.084
min2.744-2.857=-0.114
max3.068-2.926=0.142

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.557=-0.396
σ0.252-0.295=-0.043
min0.919-1.214=-0.295
max1.527-1.813=-0.286

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.045-443.038=0.008
σ573.416-573.399=0.016
min156.331-156.333=-0.002
max1303.169-1303.137=0.032
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1514.000=124.000
σ0.000
min1638.000-1514.000=124.000
max1638.000-1514.000=124.000
mean0.542-0.532=0.011
σ0.558-0.536=0.022
min0.260-0.257=0.003
max1.379-1.336=0.043
policies=20
mean1563.625-1563.624=0.000
σ0.338-0.345=-0.007
min1563.430-1563.406=0.024
max1564.130-1564.139=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1514.000=124.000
σ0.000
min1638.000-1514.000=124.000
max1638.000-1514.000=124.000
mean2.628-2.629=-0.001
σ0.012-0.010=0.002
min2.611-2.620=-0.009
max2.636-2.640=-0.005
policies=200
mean15643.966-15644.172=-0.206
σ0.231-0.092=0.139
min15643.712-15644.106=-0.394
max15644.173-15644.308=-0.135
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1514.000=124.000
σ0.000
min1638.000-1514.000=124.000
max1638.000-1514.000=124.000
mean26.635-26.569=0.066
σ0.220-0.181=0.039
min26.427-26.322=0.105
max26.886-26.732=0.154