Compare commits

Home / Compare 0b7dca70 .. de76a9a1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.654=0.000
σ0.367-0.367=-0.000
min53.517-53.513=0.003
max54.699-54.699=0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.138-0.138=0.000
σ0.003-0.004=-0.002
min0.135-0.132=0.004
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.981-42.981=-0.000
σ0.007-0.007=0.000
min42.973-42.972=0.001
max42.996-42.996=0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.120-0.121=-0.001
σ0.003-0.003=-0.000
min0.118-0.118=-0.000
max0.127-0.126=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.971-1013.972=-0.001
σ1.203-1.182=0.020
min1013.427-1013.426=0.001
max1019.013-1018.921=0.092
mean1057.800-1054.600=3.200
σ320.540-308.115=12.426
min549.000-580.000=-31.000
max1664.000-1653.000=11.000
mean1.652-1.627=0.025
σ0.112-0.113=-0.001
min1.559-1.403=0.156
max1.900-1.910=-0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.358-299.115=0.243
σ0.198-0.245=-0.047
min299.130-298.924=0.206
max299.805-299.793=0.012
mean1950.000-1970.000=-20.000
σ0.000
min1950.000-1970.000=-20.000
max1950.000-1970.000=-20.000
mean0.597-0.573=0.024
σ0.048-0.019=0.029
min0.551-0.552=-0.001
max0.721-0.599=0.122

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.678-294.677=0.001
σ0.011-0.015=-0.004
min294.664-294.659=0.005
max294.694-294.698=-0.004
mean1664.000-1653.000=11.000
σ0.000
min1664.000-1653.000=11.000
max1664.000-1653.000=11.000
mean0.387-0.382=0.005
σ0.008-0.002=0.006
min0.380-0.381=-0.001
max0.399-0.385=0.013
iters=5
new-facts=1
prior-facts=6402
mean1316.937-1316.942=-0.005
σ0.101-0.104=-0.003
min1316.881-1316.882=-0.001
max1317.117-1317.126=-0.010
mean1664.000-1653.000=11.000
σ0.000
min1664.000-1653.000=11.000
max1664.000-1653.000=11.000
mean1.980-1.956=0.023
σ0.059-0.059=0.001
min1.913-1.860=0.053
max2.074-2.003=0.070
iters=5
new-facts=6402
prior-facts=1
mean1555.308-1555.296=0.012
σ6.843-6.887=-0.044
min1551.998-1551.950=0.048
max1567.543-1567.609=-0.066
mean1664.000-1653.000=11.000
σ0.000
min1664.000-1653.000=11.000
max1664.000-1653.000=11.000
mean2.337-2.380=-0.043
σ0.167-0.324=-0.157
min2.104-2.039=0.065
max2.575-2.833=-0.259
iters=5
new-facts=6402
prior-facts=6402
mean1884.776-1884.777=-0.001
σ0.023-0.027=-0.004
min1884.752-1884.756=-0.004
max1884.813-1884.825=-0.012
mean1797.000-1788.400=8.600
σ144.738-116.154=28.583
min1664.000-1653.000=11.000
max1950.000-1970.000=-20.000
mean3.105-2.961=0.144
σ0.295-0.187=0.108
min2.870-2.679=0.191
max3.618-3.175=0.442

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.238-1.124=0.114
σ0.282-0.240=0.042
min0.913-0.901=0.012
max1.627-1.494=0.132

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.568-440.567=0.001
σ573.034-573.037=-0.003
min154.044-154.045=-0.001
max1300.120-1300.123=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1664.000-1653.000=11.000
σ0.000
min1664.000-1653.000=11.000
max1664.000-1653.000=11.000
mean0.559-0.523=0.036
σ0.586-0.522=0.064
min0.259-0.260=-0.000
max1.438-1.306=0.132
policies=20
mean1540.667-1540.699=-0.032
σ0.311-0.304=0.007
min1540.472-1540.530=-0.058
max1541.131-1541.154=-0.023
mean920.000
σ0.000
min920.000
max920.000
mean1664.000-1653.000=11.000
σ0.000
min1664.000-1653.000=11.000
max1664.000-1653.000=11.000
mean2.589-2.591=-0.003
σ0.005-0.005=0.001
min2.583-2.585=-0.002
max2.595-2.597=-0.002
policies=200
mean15414.807-15414.728=0.079
σ0.104-0.234=-0.130
min15414.681-15414.378=0.303
max15414.899-15414.873=0.026
mean9200.000
σ0.000
min9200.000
max9200.000
mean1664.000-1653.000=11.000
σ0.000
min1664.000-1653.000=11.000
max1664.000-1653.000=11.000
mean26.197-26.239=-0.042
σ0.142-0.118=0.024
min26.072-26.108=-0.036
max26.349-26.345=0.004