Compare commits

Home / Compare 12fdbe25 .. 6c1ab27d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.048-54.048=0.000
σ0.369-0.368=0.001
min53.903-53.912=-0.010
max55.098-55.094=0.004
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.135-0.139=-0.005
σ0.004-0.003=0.001
min0.130-0.137=-0.006
max0.141-0.145=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.342-43.341=0.000
σ0.006-0.006=0.000
min43.332-43.335=-0.003
max43.354-43.353=0.001
mean416.700-419.000=-2.300
σ0.483-0.000=0.483
min416.000-419.000=-3.000
max417.000-419.000=-2.000
mean0.119-0.121=-0.001
σ0.003-0.005=-0.002
min0.116-0.114=0.002
max0.126-0.130=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.195-1017.199=-0.003
σ1.171-1.172=-0.000
min1016.646-1016.628=0.018
max1022.106-1022.108=-0.003
mean1061.150-1063.000=-1.850
σ312.689-312.292=0.397
min588.000-591.000=-3.000
max1635.000-1636.000=-1.000
mean1.537-1.537=0.000
σ0.086-0.073=0.012
min1.463-1.470=-0.007
max1.794-1.721=0.073

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.099-301.845=0.254
σ0.217-0.205=0.012
min301.844-301.695=0.149
max302.616-302.406=0.210
mean2035.000
σ0.000
min2035.000
max2035.000
mean0.601-0.561=0.040
σ0.007-0.045=-0.037
min0.584-0.500=0.084
max0.609-0.612=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.789-303.776=0.012
σ0.055-0.077=-0.021
min303.709-303.651=0.058
max303.850-303.852=-0.002
mean1635.000-1636.000=-1.000
σ0.000
min1635.000-1636.000=-1.000
max1635.000-1636.000=-1.000
mean0.394-0.395=-0.001
σ0.007-0.007=0.000
min0.390-0.391=-0.001
max0.407-0.408=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1326.341-1326.341=0.000
σ0.119-0.116=0.003
min1326.196-1326.198=-0.002
max1326.475-1326.469=0.006
mean1635.000-1636.000=-1.000
σ0.000
min1635.000-1636.000=-1.000
max1635.000-1636.000=-1.000
mean1.920-1.914=0.006
σ0.101-0.097=0.004
min1.848-1.841=0.007
max2.085-2.077=0.008
iters=5
new-facts=6402
prior-facts=1
mean1564.381-1564.392=-0.011
σ6.923-6.927=-0.005
min1561.071-1561.108=-0.037
max1576.759-1576.779=-0.020
mean1635.000-1636.000=-1.000
σ0.000
min1635.000-1636.000=-1.000
max1635.000-1636.000=-1.000
mean2.328-2.331=-0.003
σ0.315-0.331=-0.017
min2.048-2.054=-0.006
max2.791-2.759=0.032
iters=5
new-facts=6402
prior-facts=6402
mean1894.278-1894.267=0.011
σ0.064-0.067=-0.003
min1894.166-1894.164=0.001
max1894.318-1894.322=-0.003
mean1772.200-1773.000=-0.800
σ169.537-168.962=0.575
min1635.000-1636.000=-1.000
max2035.000
mean2.927-2.889=0.039
σ0.123-0.172=-0.049
min2.849-2.655=0.194
max3.144-3.139=0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.362-1.292=0.070
σ0.256-0.334=-0.077
min0.947-0.950=-0.004
max1.603-1.807=-0.204

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.340-448.339=0.002
σ581.794-581.802=-0.008
min157.436-157.434=0.002
max1321.032-1321.042=-0.010
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1636.000=-1.000
σ0.000
min1635.000-1636.000=-1.000
max1635.000-1636.000=-1.000
mean0.545-0.548=-0.004
σ0.563-0.568=-0.004
min0.262-0.262=-0.000
max1.389-1.400=-0.010
policies=20
mean1574.594-1574.596=-0.002
σ0.335-0.347=-0.012
min1574.384-1574.373=0.010
max1575.094-1575.113=-0.019
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1636.000=-1.000
σ0.000
min1635.000-1636.000=-1.000
max1635.000-1636.000=-1.000
mean2.620-2.633=-0.013
σ0.013-0.008=0.006
min2.604-2.625=-0.021
max2.631-2.642=-0.011
policies=200
mean15754.233-15754.199=0.034
σ0.123-0.164=-0.041
min15754.071-15754.047=0.024
max15754.354-15754.356=-0.002
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1636.000=-1.000
σ0.000
min1635.000-1636.000=-1.000
max1635.000-1636.000=-1.000
mean26.571-26.649=-0.079
σ0.105-0.151=-0.046
min26.471-26.513=-0.043
max26.670-26.807=-0.136