Compare commits

Home / Compare 4c02dbb3 .. dfc5246a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.050-54.048=0.002
σ0.369-0.368=0.001
min53.905-53.909=-0.004
max55.099-55.096=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.139-0.138=0.002
σ0.003-0.005=-0.001
min0.135-0.130=0.006
max0.146-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.341-43.342=-0.001
σ0.005-0.008=-0.003
min43.333-43.335=-0.002
max43.349-43.362=-0.013
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.117-0.122=-0.004
σ0.004-0.004=0.000
min0.114-0.115=-0.002
max0.124-0.128=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.201-1017.195=0.006
σ1.160-1.190=-0.030
min1016.627-1016.653=-0.026
max1022.056-1022.186=-0.129
mean1051.400-1050.050=1.350
σ319.904-303.485=16.419
min589.000-592.000=-3.000
max1611.000-1637.000=-26.000
mean1.546-1.549=-0.003
σ0.095-0.083=0.012
min1.462-1.433=0.029
max1.782-1.782=-0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.904-301.967=-0.063
σ0.253-0.261=-0.008
min301.642-301.722=-0.080
max302.446-302.667=-0.220
mean2071.000-2060.000=11.000
σ0.000
min2071.000-2060.000=11.000
max2071.000-2060.000=11.000
mean0.582-0.561=0.021
σ0.036-0.035=0.001
min0.505-0.509=-0.003
max0.608-0.599=0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.781-303.781=0.000
σ0.065-0.062=0.003
min303.678-303.682=-0.004
max303.843-303.841=0.002
mean1611.000-1637.000=-26.000
σ0.000
min1611.000-1637.000=-26.000
max1611.000-1637.000=-26.000
mean0.394-0.394=0.000
σ0.009-0.008=0.000
min0.389-0.389=0.000
max0.409-0.408=0.001
iters=5
new-facts=1
prior-facts=6402
mean1326.333-1326.329=0.004
σ0.106-0.105=0.001
min1326.199-1326.192=0.007
max1326.463-1326.447=0.017
mean1611.000-1637.000=-26.000
σ0.000
min1611.000-1637.000=-26.000
max1611.000-1637.000=-26.000
mean1.943-1.933=0.010
σ0.107-0.102=0.005
min1.823-1.823=0.000
max2.040-2.047=-0.007
iters=5
new-facts=6402
prior-facts=1
mean1564.464-1564.409=0.054
σ6.823-6.864=-0.041
min1561.268-1561.150=0.117
max1576.666-1576.685=-0.019
mean1611.000-1637.000=-26.000
σ0.000
min1611.000-1637.000=-26.000
max1611.000-1637.000=-26.000
mean2.394-2.331=0.063
σ0.333-0.248=0.085
min2.081-2.056=0.026
max2.864-2.706=0.158
iters=5
new-facts=6402
prior-facts=6402
mean1894.284-1894.282=0.001
σ0.073-0.071=0.003
min1894.155-1894.159=-0.004
max1894.336-1894.332=0.004
mean1796.600-1803.000=-6.400
σ200.651-184.172=16.478
min1611.000-1637.000=-26.000
max2071.000-2060.000=11.000
mean3.036-3.058=-0.023
σ0.125-0.122=0.003
min2.882-2.911=-0.029
max3.223-3.211=0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.349-1.236=0.113
σ0.318-0.302=0.016
min1.036-0.939=0.097
max1.683-1.577=0.106

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.339-448.337=0.001
σ581.803-581.794=0.009
min157.435-157.432=0.003
max1321.044-1321.029=0.015
mean96.250
σ8.500
min92.000
max109.000
mean1611.000-1637.000=-26.000
σ0.000
min1611.000-1637.000=-26.000
max1611.000-1637.000=-26.000
mean0.517-0.522=-0.005
σ0.511-0.517=-0.006
min0.260-0.259=0.000
max1.284-1.298=-0.014
policies=20
mean1574.596-1574.587=0.009
σ0.322-0.327=-0.005
min1574.404-1574.388=0.016
max1575.078-1575.076=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1611.000-1637.000=-26.000
σ0.000
min1611.000-1637.000=-26.000
max1611.000-1637.000=-26.000
mean2.609-2.614=-0.005
σ0.015-0.026=-0.011
min2.594-2.589=0.005
max2.629-2.642=-0.013
policies=200
mean15754.078-15754.121=-0.043
σ0.090-0.105=-0.015
min15753.987-15753.974=0.013
max15754.189-15754.219=-0.030
mean9200.000
σ0.000
min9200.000
max9200.000
mean1611.000-1637.000=-26.000
σ0.000
min1611.000-1637.000=-26.000
max1611.000-1637.000=-26.000
mean26.520-26.499=0.021
σ0.186-0.108=0.077
min26.315-26.395=-0.080
max26.757-26.598=0.159