Compare commits

Home / Compare ef0876d9 .. 1ec60fd4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.050-54.049=0.000
σ0.369-0.370=-0.001
min53.905-53.910=-0.005
max55.099-55.101=-0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.139-0.139=0.000
σ0.003-0.004=-0.000
min0.135-0.136=-0.000
max0.146-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.341-43.342=-0.001
σ0.005-0.007=-0.002
min43.333-43.331=0.002
max43.349-43.356=-0.007
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.117-0.122=-0.004
σ0.004-0.004=-0.000
min0.114-0.113=0.000
max0.124-0.129=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.201-1017.197=0.004
σ1.160-1.189=-0.028
min1016.627-1016.638=-0.011
max1022.056-1022.182=-0.126
mean1051.400-1056.400=-5.000
σ319.904-313.833=6.071
min589.000-587.000=2.000
max1611.000-1574.000=37.000
mean1.546-1.531=0.015
σ0.095-0.080=0.015
min1.462-1.361=0.101
max1.782-1.720=0.061

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.904-301.954=-0.050
σ0.253-0.245=0.008
min301.642-301.758=-0.116
max302.446-302.609=-0.163
mean2071.000-2067.000=4.000
σ0.000
min2071.000-2067.000=4.000
max2071.000-2067.000=4.000
mean0.582-0.590=-0.008
σ0.036-0.016=0.020
min0.505-0.549=-0.043
max0.608-0.602=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.781-303.789=-0.008
σ0.065-0.051=0.014
min303.678-303.714=-0.036
max303.843-303.845=-0.002
mean1611.000-1574.000=37.000
σ0.000
min1611.000-1574.000=37.000
max1611.000-1574.000=37.000
mean0.394-0.393=0.002
σ0.009-0.005=0.004
min0.389-0.390=-0.001
max0.409-0.401=0.008
iters=5
new-facts=1
prior-facts=6402
mean1326.333-1326.324=0.009
σ0.106-0.104=0.002
min1326.199-1326.195=0.004
max1326.463-1326.456=0.007
mean1611.000-1574.000=37.000
σ0.000
min1611.000-1574.000=37.000
max1611.000-1574.000=37.000
mean1.943-1.931=0.013
σ0.107-0.143=-0.037
min1.823-1.784=0.039
max2.040-2.098=-0.058
iters=5
new-facts=6402
prior-facts=1
mean1564.464-1564.386=0.077
σ6.823-6.903=-0.080
min1561.268-1561.117=0.151
max1576.666-1576.731=-0.065
mean1611.000-1574.000=37.000
σ0.000
min1611.000-1574.000=37.000
max1611.000-1574.000=37.000
mean2.394-2.306=0.089
σ0.333-0.300=0.033
min2.081-2.050=0.032
max2.864-2.652=0.212
iters=5
new-facts=6402
prior-facts=6402
mean1894.284-1894.258=0.025
σ0.073-0.065=0.008
min1894.155-1894.158=-0.003
max1894.336-1894.318=0.018
mean1796.600-1757.000=39.600
σ200.651-206.987=-6.336
min1611.000-1574.000=37.000
max2071.000-2067.000=4.000
mean3.036-2.971=0.064
σ0.125-0.152=-0.027
min2.882-2.842=0.040
max3.223-3.214=0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.349-1.458=-0.109
σ0.318-0.335=-0.018
min1.036-1.072=-0.036
max1.683-1.890=-0.208

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.339-448.328=0.010
σ581.803-581.791=0.012
min157.435-157.431=0.004
max1321.044-1321.015=0.028
mean96.250
σ8.500
min92.000
max109.000
mean1611.000-1574.000=37.000
σ0.000
min1611.000-1574.000=37.000
max1611.000-1574.000=37.000
mean0.517-0.563=-0.046
σ0.511-0.598=-0.086
min0.260-0.264=-0.004
max1.284-1.460=-0.176
policies=20
mean1574.596-1574.590=0.006
σ0.322-0.346=-0.024
min1574.404-1574.375=0.029
max1575.078-1575.107=-0.029
mean920.000
σ0.000
min920.000
max920.000
mean1611.000-1574.000=37.000
σ0.000
min1611.000-1574.000=37.000
max1611.000-1574.000=37.000
mean2.609-2.629=-0.020
σ0.015-0.011=0.004
min2.594-2.615=-0.021
max2.629-2.642=-0.014
policies=200
mean15754.078-15754.048=0.030
σ0.090-0.084=0.006
min15753.987-15753.980=0.007
max15754.189-15754.157=0.032
mean9200.000
σ0.000
min9200.000
max9200.000
mean1611.000-1574.000=37.000
σ0.000
min1611.000-1574.000=37.000
max1611.000-1574.000=37.000
mean26.520-26.663=-0.143
σ0.186-0.156=0.030
min26.315-26.477=-0.162
max26.757-26.809=-0.052