Compare commits

Home / Compare 3b19f219 .. 88100d21

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.049-54.049=-0.000
σ0.369-0.369=-0.000
min53.901-53.908=-0.007
max55.098-55.100=-0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.136-0.139=-0.003
σ0.005-0.004=0.002
min0.129-0.136=-0.007
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.343-43.343=0.000
σ0.005-0.007=-0.002
min43.338-43.331=0.007
max43.352-43.357=-0.005
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.119-0.123=-0.004
σ0.002-0.003=-0.001
min0.114-0.119=-0.005
max0.121-0.128=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.196-1017.196=0.000
σ1.174-1.165=0.009
min1016.651-1016.625=0.026
max1022.115-1022.080=0.035
mean1058.350-1056.750=1.600
σ312.441-316.477=-4.035
min586.000-590.000=-4.000
max1632.000-1612.000=20.000
mean1.543-1.532=0.011
σ0.094-0.095=-0.001
min1.463-1.424=0.038
max1.826-1.785=0.041

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.089-302.036=0.053
σ0.287-0.232=0.055
min301.843-301.907=-0.064
max302.866-302.685=0.181
mean2064.000-2068.000=-4.000
σ0.000
min2064.000-2068.000=-4.000
max2064.000-2068.000=-4.000
mean0.588-0.508=0.080
σ0.031-0.008=0.023
min0.502-0.497=0.006
max0.608-0.521=0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.787-303.796=-0.009
σ0.053-0.047=0.006
min303.710-303.727=-0.018
max303.844-303.852=-0.008
mean1632.000-1612.000=20.000
σ0.000
min1632.000-1612.000=20.000
max1632.000-1612.000=20.000
mean0.394-0.397=-0.003
σ0.007-0.008=-0.001
min0.389-0.391=-0.002
max0.407-0.411=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1326.324-1326.325=-0.001
σ0.101-0.114=-0.013
min1326.195-1326.188=0.007
max1326.456-1326.443=0.012
mean1632.000-1612.000=20.000
σ0.000
min1632.000-1612.000=20.000
max1632.000-1612.000=20.000
mean1.949-1.921=0.028
σ0.131-0.092=0.039
min1.831-1.821=0.009
max2.156-2.029=0.127
iters=5
new-facts=6402
prior-facts=1
mean1564.400-1564.384=0.016
σ6.938-6.907=0.031
min1561.110-1561.077=0.033
max1576.807-1576.734=0.073
mean1632.000-1612.000=20.000
σ0.000
min1632.000-1612.000=20.000
max1632.000-1612.000=20.000
mean2.413-2.264=0.148
σ0.420-0.223=0.197
min2.066-2.013=0.053
max3.013-2.563=0.451
iters=5
new-facts=6402
prior-facts=6402
mean1894.273-1894.275=-0.002
σ0.068-0.062=0.006
min1894.153-1894.167=-0.014
max1894.315-1894.313=0.003
mean1780.000-1764.400=15.600
σ180.993-194.774=-13.781
min1632.000-1612.000=20.000
max2064.000-2068.000=-4.000
mean2.966-2.978=-0.012
σ0.084-0.168=-0.083
min2.889-2.847=0.042
max3.068-3.267=-0.199

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.346-1.313=0.033
σ0.315-0.365=-0.049
min0.946-0.937=0.008
max1.827-1.832=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.338-448.342=-0.004
σ581.795-581.801=-0.006
min157.437-157.433=0.005
max1321.031-1321.044=-0.013
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1612.000=20.000
σ0.000
min1632.000-1612.000=20.000
max1632.000-1612.000=20.000
mean0.560-0.533=0.028
σ0.593-0.538=0.055
min0.263-0.257=0.006
max1.450-1.340=0.109
policies=20
mean1574.609-1574.612=-0.003
σ0.333-0.321=0.012
min1574.395-1574.419=-0.024
max1575.106-1575.092=0.014
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1612.000=20.000
σ0.000
min1632.000-1612.000=20.000
max1632.000-1612.000=20.000
mean2.618-2.606=0.012
σ0.017-0.021=-0.004
min2.597-2.578=0.019
max2.636-2.627=0.009
policies=200
mean15754.274-15754.265=0.008
σ0.085-0.068=0.017
min15754.148-15754.193=-0.044
max15754.328-15754.346=-0.018
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1612.000=20.000
σ0.000
min1632.000-1612.000=20.000
max1632.000-1612.000=20.000
mean26.603-26.598=0.005
σ0.166-0.128=0.038
min26.424-26.474=-0.049
max26.798-26.712=0.086