Compare commits

Home / Compare 1dbeb0e7 .. e32ca798

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.050-54.048=0.002
σ0.368-0.368=0.000
min53.907-53.909=-0.002
max55.098-55.096=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.140-0.138=0.002
σ0.004-0.005=-0.001
min0.135-0.130=0.006
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.342-43.342=-0.000
σ0.007-0.008=-0.000
min43.332-43.335=-0.003
max43.357-43.362=-0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.119-0.122=-0.002
σ0.001-0.004=-0.004
min0.118-0.115=0.002
max0.121-0.128=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.196-1017.195=0.000
σ1.182-1.190=-0.009
min1016.654-1016.653=0.001
max1022.150-1022.186=-0.036
mean1057.250-1050.050=7.200
σ312.302-303.485=8.817
min589.000-592.000=-3.000
max1575.000-1637.000=-62.000
mean1.530-1.549=-0.018
σ0.084-0.083=0.002
min1.462-1.433=0.029
max1.819-1.782=0.037

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.974-301.967=0.007
σ0.205-0.261=-0.056
min301.804-301.722=0.082
max302.521-302.667=-0.146
mean2036.000-2060.000=-24.000
σ0.000
min2036.000-2060.000=-24.000
max2036.000-2060.000=-24.000
mean0.578-0.561=0.017
σ0.041-0.035=0.006
min0.496-0.509=-0.013
max0.604-0.599=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.791-303.781=0.010
σ0.052-0.062=-0.011
min303.717-303.682=0.034
max303.847-303.841=0.006
mean1575.000-1637.000=-62.000
σ0.000
min1575.000-1637.000=-62.000
max1575.000-1637.000=-62.000
mean0.395-0.394=0.001
σ0.007-0.008=-0.001
min0.390-0.389=0.001
max0.407-0.408=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1326.336-1326.329=0.007
σ0.110-0.105=0.006
min1326.198-1326.192=0.007
max1326.458-1326.447=0.011
mean1575.000-1637.000=-62.000
σ0.000
min1575.000-1637.000=-62.000
max1575.000-1637.000=-62.000
mean1.952-1.933=0.019
σ0.099-0.102=-0.003
min1.839-1.823=0.016
max2.031-2.047=-0.016
iters=5
new-facts=6402
prior-facts=1
mean1564.454-1564.409=0.045
σ6.846-6.864=-0.019
min1561.225-1561.150=0.075
max1576.696-1576.685=0.012
mean1575.000-1637.000=-62.000
σ0.000
min1575.000-1637.000=-62.000
max1575.000-1637.000=-62.000
mean2.404-2.331=0.072
σ0.276-0.248=0.028
min2.056-2.056=0.000
max2.683-2.706=-0.023
iters=5
new-facts=6402
prior-facts=6402
mean1894.281-1894.282=-0.001
σ0.066-0.071=-0.005
min1894.165-1894.159=0.006
max1894.324-1894.332=-0.007
mean1775.800-1803.000=-27.200
σ196.926-184.172=12.753
min1575.000-1637.000=-62.000
max2036.000-2060.000=-24.000
mean3.033-3.058=-0.025
σ0.097-0.122=-0.026
min2.914-2.911=0.003
max3.140-3.211=-0.071

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.356-1.236=0.120
σ0.415-0.302=0.113
min0.924-0.939=-0.015
max1.845-1.577=0.268

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.341-448.337=0.004
σ581.803-581.794=0.008
min157.435-157.432=0.004
max1321.045-1321.029=0.016
mean96.250
σ8.500
min92.000
max109.000
mean1575.000-1637.000=-62.000
σ0.000
min1575.000-1637.000=-62.000
max1575.000-1637.000=-62.000
mean0.538-0.522=0.016
σ0.542-0.517=0.024
min0.261-0.259=0.002
max1.350-1.298=0.052
policies=20
mean1574.631-1574.587=0.044
σ0.334-0.327=0.008
min1574.423-1574.388=0.035
max1575.130-1575.076=0.055
mean920.000
σ0.000
min920.000
max920.000
mean1575.000-1637.000=-62.000
σ0.000
min1575.000-1637.000=-62.000
max1575.000-1637.000=-62.000
mean2.609-2.614=-0.005
σ0.008-0.026=-0.017
min2.599-2.589=0.010
max2.619-2.642=-0.022
policies=200
mean15754.485-15754.121=0.363
σ0.111-0.105=0.006
min15754.320-15753.974=0.347
max15754.561-15754.219=0.342
mean9200.000
σ0.000
min9200.000
max9200.000
mean1575.000-1637.000=-62.000
σ0.000
min1575.000-1637.000=-62.000
max1575.000-1637.000=-62.000
mean26.595-26.499=0.096
σ0.260-0.108=0.152
min26.362-26.395=-0.034
max26.938-26.598=0.340