Compare commits

Home / Compare 3c3ff419 .. c3eff250

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.040-54.039=0.001
σ0.369-0.370=-0.001
min53.898-53.894=0.004
max55.089-55.092=-0.003
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.138-0.137=0.000
σ0.006-0.005=0.000
min0.132-0.130=0.002
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.342-43.343=-0.001
σ0.007-0.009=-0.002
min43.333-43.329=0.004
max43.356-43.361=-0.005
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.122-0.124=-0.003
σ0.004-0.009=-0.005
min0.116-0.115=0.000
max0.128-0.144=-0.016

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.203-1017.204=-0.001
σ1.189-1.160=0.028
min1016.661-1016.627=0.034
max1022.186-1022.060=0.125
mean1054.450-1055.300=-0.850
σ317.780-310.286=7.494
min539.000-563.000=-24.000
max1628.000-1512.000=116.000
mean1.549-1.555=-0.006
σ0.080-0.048=0.031
min1.371-1.481=-0.110
max1.742-1.653=0.089

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.093-302.198=-0.105
σ0.257-0.191=0.066
min301.884-302.024=-0.141
max302.795-302.701=0.094
mean2021.000-2111.000=-90.000
σ0.000
min2021.000-2111.000=-90.000
max2021.000-2111.000=-90.000
mean0.598-0.595=0.003
σ0.007-0.007=0.000
min0.581-0.579=0.002
max0.606-0.602=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.792-303.788=0.004
σ0.048-0.050=-0.003
min303.720-303.717=0.002
max303.841-303.842=-0.001
mean1628.000-1512.000=116.000
σ0.000
min1628.000-1512.000=116.000
max1628.000-1512.000=116.000
mean0.391-0.392=-0.001
σ0.001-0.007=-0.006
min0.389-0.388=0.001
max0.392-0.404=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1326.336-1326.337=-0.001
σ0.114-0.109=0.005
min1326.197-1326.201=-0.004
max1326.476-1326.470=0.006
mean1628.000-1512.000=116.000
σ0.000
min1628.000-1512.000=116.000
max1628.000-1512.000=116.000
mean1.926-1.884=0.042
σ0.080-0.059=0.021
min1.835-1.807=0.028
max2.021-1.936=0.084
iters=5
new-facts=6402
prior-facts=1
mean1564.401-1564.373=0.028
σ6.884-6.922=-0.038
min1561.118-1561.072=0.045
max1576.710-1576.751=-0.041
mean1628.000-1512.000=116.000
σ0.000
min1628.000-1512.000=116.000
max1628.000-1512.000=116.000
mean2.311-2.282=0.029
σ0.194-0.297=-0.103
min2.060-2.019=0.041
max2.547-2.676=-0.129
iters=5
new-facts=6402
prior-facts=6402
mean1894.285-1894.272=0.013
σ0.072-0.065=0.007
min1894.159-1894.161=-0.001
max1894.326-1894.318=0.007
mean1781.600-1751.000=30.600
σ172.570-241.674=-69.105
min1628.000-1512.000=116.000
max2021.000-2111.000=-90.000
mean3.129-2.927=0.202
σ0.236-0.115=0.121
min2.883-2.820=0.063
max3.499-3.099=0.400

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.292-1.569=-0.277
σ0.320-0.287=0.034
min0.943-1.252=-0.309
max1.676-1.836=-0.159

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.063-448.044=0.019
σ581.233-581.224=0.009
min157.443-157.429=0.014
max1319.912-1319.880=0.032
mean96.250
σ8.500
min92.000
max109.000
mean1628.000-1512.000=116.000
σ0.000
min1628.000-1512.000=116.000
max1628.000-1512.000=116.000
mean0.546-0.532=0.015
σ0.559-0.532=0.027
min0.263-0.262=0.001
max1.385-1.330=0.055
policies=20
mean1574.631-1574.573=0.058
σ0.345-0.349=-0.004
min1574.423-1574.342=0.081
max1575.147-1575.093=0.054
mean920.000
σ0.000
min920.000
max920.000
mean1628.000-1512.000=116.000
σ0.000
min1628.000-1512.000=116.000
max1628.000-1512.000=116.000
mean2.643-2.632=0.010
σ0.006-0.010=-0.003
min2.635-2.619=0.017
max2.650-2.641=0.009
policies=200
mean15754.337-15753.973=0.364
σ0.076-0.166=-0.090
min15754.250-15753.832=0.419
max15754.435-15754.192=0.242
mean9200.000
σ0.000
min9200.000
max9200.000
mean1628.000-1512.000=116.000
σ0.000
min1628.000-1512.000=116.000
max1628.000-1512.000=116.000
mean26.762-26.681=0.081
σ0.082-0.139=-0.058
min26.678-26.479=0.200
max26.857-26.796=0.061