Compare commits

Home / Compare 8bf5f2c9 .. b879cefb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.374=0.002
σ0.059-0.060=-0.001
min70.335-70.330=0.005
max70.541-70.541=0.000
mean416.800-414.000=2.800
σ0.422-0.000=0.422
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.158-0.158=-0.000
σ0.004-0.005=-0.001
min0.151-0.151=0.000
max0.163-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.001
σ0.002-0.001=0.000
min21.141-21.143=-0.002
max21.145-21.147=-0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.064-0.064=0.000
σ0.003-0.003=0.000
min0.062-0.062=0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.202-1752.201=0.002
σ0.361-0.361=0.000
min1751.629-1751.634=-0.006
max1752.792-1752.791=0.001
mean1640.850-1659.800=-18.950
σ613.939-623.905=-9.965
min630.000-671.000=-41.000
max2471.000-2511.000=-40.000
mean2.865-2.809=0.057
σ0.098-0.179=-0.080
min2.735-2.396=0.338
max3.060-3.073=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.936-269.929=0.007
σ0.006-0.006=0.000
min269.928-269.921=0.007
max269.944-269.937=0.007
mean2471.000-2511.000=-40.000
σ0.000
min2471.000-2511.000=-40.000
max2471.000-2511.000=-40.000
mean0.384-0.374=0.010
σ0.010-0.002=0.007
min0.374-0.372=0.002
max0.397-0.378=0.019
iters=5
new-facts=1
prior-facts=6402
mean1930.398-1790.181=140.217
σ0.009-313.539=-313.530
min1930.387-1229.306=701.081
max1930.410-1930.406=0.004
mean2471.000-2511.000=-40.000
σ0.000
min2471.000-2511.000=-40.000
max2471.000-2511.000=-40.000
mean2.501-2.442=0.059
σ0.057-0.419=-0.362
min2.436-1.755=0.681
max2.567-2.854=-0.287
iters=5
new-facts=6402
prior-facts=1
mean4750.931-4750.811=0.120
σ0.780-0.890=-0.109
min4750.500-4750.334=0.165
max4752.319-4752.398=-0.079
mean2471.000-2511.000=-40.000
σ0.000
min2471.000-2511.000=-40.000
max2471.000-2511.000=-40.000
mean8.080-8.895=-0.814
σ0.402-0.173=0.229
min7.683-8.613=-0.930
max8.623-9.084=-0.461
iters=5
new-facts=6402
prior-facts=6402
mean4941.319-4941.334=-0.015
σ0.082-0.086=-0.004
min4941.253-4941.261=-0.008
max4941.410-4941.439=-0.030
mean2971.800-2965.600=6.200
σ433.744-336.390=97.354
min2482.000-2522.000=-40.000
max3563.000-3279.000=284.000
mean8.374-8.740=-0.366
σ0.139-0.459=-0.319
min8.262-8.384=-0.123
max8.612-9.544=-0.932

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.810-1.750=0.060
σ0.128-0.240=-0.112
min1.611-1.413=0.198
max1.928-1.933=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.930-465.933=-0.003
σ575.815-575.816=-0.001
min178.021-178.021=0.001
max1329.653-1329.657=-0.004
mean81.750
σ7.500
min78.000
max93.000
mean2471.000-2511.000=-40.000
σ0.000
min2471.000-2511.000=-40.000
max2471.000-2511.000=-40.000
mean0.565-0.551=0.014
σ0.564-0.541=0.023
min0.279-0.276=0.003
max1.411-1.363=0.048
policies=20
mean1780.453-1780.448=0.005
σ0.355-0.308=0.047
min1780.214-1780.238=-0.023
max1780.978-1780.903=0.076
mean780.000
σ0.000
min780.000
max780.000
mean2471.000-2511.000=-40.000
σ0.000
min2471.000-2511.000=-40.000
max2471.000-2511.000=-40.000
mean2.776-2.645=0.132
σ0.009-0.204=-0.195
min2.767-2.344=0.423
max2.787-2.785=0.002
policies=200
mean17811.521-17811.579=-0.058
σ0.469-0.466=0.003
min17811.245-17811.314=-0.070
max17812.222-17812.276=-0.054
mean7800.000
σ0.000
min7800.000
max7800.000
mean2471.000-2511.000=-40.000
σ0.000
min2471.000-2511.000=-40.000
max2471.000-2511.000=-40.000
mean27.917-27.840=0.077
σ0.073-0.140=-0.066
min27.838-27.695=0.142
max28.007-28.022=-0.014