Compare commits

Home / Compare 48746f6a .. 9c307c42

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.049-53.823=0.226
σ0.370-0.367=0.003
min53.905-53.680=0.225
max55.103-54.868=0.235
mean417.000-418.800=-1.800
σ0.000-0.422=-0.422
min417.000-418.000=-1.000
max417.000-419.000=-2.000
mean0.137-0.140=-0.003
σ0.005-0.004=0.001
min0.130-0.131=-0.001
max0.144-0.147=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.342-43.208=0.133
σ0.008-0.005=0.003
min43.324-43.199=0.125
max43.353-43.218=0.135
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.120-0.122=-0.002
σ0.005-0.004=0.002
min0.113-0.116=-0.003
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.198-1016.176=1.022
σ1.175-1.190=-0.015
min1016.625-1015.604=1.021
max1022.125-1021.165=0.960
mean1057.850-1052.050=5.800
σ313.527-312.089=1.438
min562.000-559.000=3.000
max1518.000
mean1.516-1.555=-0.039
σ0.065-0.061=0.004
min1.436-1.481=-0.044
max1.616-1.684=-0.068

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.046-301.441=0.605
σ0.257-0.223=0.035
min301.821-301.228=0.593
max302.751-302.000=0.751
mean2061.000-1933.000=128.000
σ0.000
min2061.000-1933.000=128.000
max2061.000-1933.000=128.000
mean0.583-0.543=0.039
σ0.025-0.041=-0.017
min0.542-0.496=0.046
max0.605-0.599=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.786-300.701=3.085
σ0.054-0.026=0.028
min303.698-300.667=3.031
max303.835-300.738=3.097
mean1518.000
σ0.000
min1518.000
max1518.000
mean0.399-0.397=0.002
σ0.009-0.008=0.001
min0.392-0.389=0.003
max0.410-0.406=0.005
iters=5
new-facts=1
prior-facts=6402
mean1326.328-1322.865=3.463
σ0.103-0.102=0.001
min1326.193-1322.809=3.385
max1326.451-1323.047=3.404
mean1518.000
σ0.000
min1518.000
max1518.000
mean1.937-1.949=-0.012
σ0.102-0.131=-0.029
min1.818-1.833=-0.015
max2.053-2.173=-0.120
iters=5
new-facts=6402
prior-facts=1
mean1564.447-1561.317=3.130
σ6.905-6.910=-0.005
min1561.139-1557.993=3.146
max1576.795-1573.671=3.124
mean1518.000
σ0.000
min1518.000
max1518.000
mean2.482-2.338=0.144
σ0.338-0.321=0.017
min2.072-2.084=-0.012
max2.826-2.892=-0.066
iters=5
new-facts=6402
prior-facts=6402
mean1894.278-1890.800=3.478
σ0.068-0.018=0.050
min1894.159-1890.787=3.372
max1894.322-1890.829=3.493
mean1743.200-1750.600=-7.400
σ218.714-142.207=76.507
min1518.000-1539.000=-21.000
max2061.000-1933.000=128.000
mean2.998-2.998=0.000
σ0.168-0.122=0.046
min2.873-2.887=-0.014
max3.265-3.164=0.101

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.591-1.550=0.040
σ0.307-0.323=-0.016
min1.255-1.185=0.070
max1.889-1.877=0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.166-443.036=5.130
σ581.462-573.402=8.059
min157.431-156.332=1.099
max1320.358-1303.140=17.218
mean96.250
σ8.500
min92.000
max109.000
mean1518.000
σ0.000
min1518.000
max1518.000
mean0.543-0.519=0.024
σ0.553-0.514=0.039
min0.261-0.259=0.002
max1.373-1.291=0.082
policies=20
mean1574.592-1563.613=10.980
σ0.339-0.326=0.013
min1574.376-1563.404=10.972
max1575.098-1564.099=10.999
mean920.000
σ0.000
min920.000
max920.000
mean1518.000
σ0.000
min1518.000
max1518.000
mean2.620-2.603=0.017
σ0.009-0.017=-0.008
min2.607-2.586=0.021
max2.628-2.626=0.002
policies=200
mean15754.224-15644.170=110.054
σ0.135-0.076=0.059
min15754.069-15644.110=109.959
max15754.387-15644.279=110.108
mean9200.000
σ0.000
min9200.000
max9200.000
mean1518.000
σ0.000
min1518.000
max1518.000
mean26.591-26.562=0.029
σ0.077-0.213=-0.136
min26.500-26.331=0.169
max26.683-26.845=-0.161