Compare commits

Home / Compare f9297c15 .. 1dbeb0e7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.048-54.049=-0.001
σ0.368-0.369=-0.001
min53.909-53.908=0.001
max55.096-55.100=-0.004
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.138-0.139=-0.001
σ0.005-0.004=0.001
min0.130-0.136=-0.006
max0.146-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.342-43.343=-0.001
σ0.008-0.007=0.001
min43.335-43.331=0.004
max43.362-43.357=0.004
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.122-0.123=-0.001
σ0.004-0.003=0.001
min0.115-0.119=-0.004
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.195-1017.196=-0.001
σ1.190-1.165=0.025
min1016.653-1016.625=0.028
max1022.186-1022.080=0.106
mean1050.050-1056.750=-6.700
σ303.485-316.477=-12.991
min592.000-590.000=2.000
max1637.000-1612.000=25.000
mean1.549-1.532=0.017
σ0.083-0.095=-0.012
min1.433-1.424=0.009
max1.782-1.785=-0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.967-302.036=-0.069
σ0.261-0.232=0.029
min301.722-301.907=-0.185
max302.667-302.685=-0.019
mean2060.000-2068.000=-8.000
σ0.000
min2060.000-2068.000=-8.000
max2060.000-2068.000=-8.000
mean0.561-0.508=0.053
σ0.035-0.008=0.027
min0.509-0.497=0.012
max0.599-0.521=0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.781-303.796=-0.015
σ0.062-0.047=0.015
min303.682-303.727=-0.045
max303.841-303.852=-0.011
mean1637.000-1612.000=25.000
σ0.000
min1637.000-1612.000=25.000
max1637.000-1612.000=25.000
mean0.394-0.397=-0.003
σ0.008-0.008=0.000
min0.389-0.391=-0.003
max0.408-0.411=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1326.329-1326.325=0.003
σ0.105-0.114=-0.010
min1326.192-1326.188=0.003
max1326.447-1326.443=0.003
mean1637.000-1612.000=25.000
σ0.000
min1637.000-1612.000=25.000
max1637.000-1612.000=25.000
mean1.933-1.921=0.012
σ0.102-0.092=0.010
min1.823-1.821=0.001
max2.047-2.029=0.017
iters=5
new-facts=6402
prior-facts=1
mean1564.409-1564.384=0.025
σ6.864-6.907=-0.043
min1561.150-1561.077=0.073
max1576.685-1576.734=-0.049
mean1637.000-1612.000=25.000
σ0.000
min1637.000-1612.000=25.000
max1637.000-1612.000=25.000
mean2.331-2.264=0.067
σ0.248-0.223=0.026
min2.056-2.013=0.043
max2.706-2.563=0.143
iters=5
new-facts=6402
prior-facts=6402
mean1894.282-1894.275=0.007
σ0.071-0.062=0.009
min1894.159-1894.167=-0.008
max1894.332-1894.313=0.019
mean1803.000-1764.400=38.600
σ184.172-194.774=-10.601
min1637.000-1612.000=25.000
max2060.000-2068.000=-8.000
mean3.058-2.978=0.080
σ0.122-0.168=-0.045
min2.911-2.847=0.064
max3.211-3.267=-0.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.236-1.313=-0.077
σ0.302-0.365=-0.063
min0.939-0.937=0.001
max1.577-1.832=-0.255

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.337-448.342=-0.005
σ581.794-581.801=-0.007
min157.432-157.433=-0.001
max1321.029-1321.044=-0.015
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1612.000=25.000
σ0.000
min1637.000-1612.000=25.000
max1637.000-1612.000=25.000
mean0.522-0.533=-0.011
σ0.517-0.538=-0.021
min0.259-0.257=0.003
max1.298-1.340=-0.043
policies=20
mean1574.587-1574.612=-0.026
σ0.327-0.321=0.006
min1574.388-1574.419=-0.031
max1575.076-1575.092=-0.017
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1612.000=25.000
σ0.000
min1637.000-1612.000=25.000
max1637.000-1612.000=25.000
mean2.614-2.606=0.008
σ0.026-0.021=0.005
min2.589-2.578=0.011
max2.642-2.627=0.014
policies=200
mean15754.121-15754.265=-0.144
σ0.105-0.068=0.037
min15753.974-15754.193=-0.219
max15754.219-15754.346=-0.127
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1612.000=25.000
σ0.000
min1637.000-1612.000=25.000
max1637.000-1612.000=25.000
mean26.499-26.598=-0.099
σ0.108-0.128=-0.020
min26.395-26.474=-0.078
max26.598-26.712=-0.115