Compare commits

Home / Compare a1e5b9f2 .. cb7585d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.375=-0.002
σ0.057-0.058=-0.002
min70.336-70.335=0.001
max70.531-70.537=-0.007
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.158-0.157=0.001
σ0.005-0.004=0.001
min0.148-0.150=-0.002
max0.163-0.163=0.001
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=-0.000
σ0.003-0.003=0.000
min21.138-21.139=-0.001
max21.146-21.147=-0.001
mean415.800-416.000=-0.200
σ0.422-0.000=0.422
min415.000-416.000=-1.000
max416.000
mean0.063-0.062=0.001
σ0.003-0.003=-0.001
min0.057-0.057=-0.000
max0.064-0.065=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.203=-0.002
σ0.361-0.361=0.000
min1751.623-1751.625=-0.002
max1752.771-1752.784=-0.013
mean1652.200-1655.900=-3.700
σ645.441-646.775=-1.334
min644.000-647.000=-3.000
max2848.000-2858.000=-10.000
mean2.869-2.864=0.005
σ0.082-0.108=-0.026
min2.712-2.562=0.150
max3.047-3.091=-0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.937-269.932=0.005
σ0.011-0.007=0.003
min269.923-269.920=0.002
max269.947-269.938=0.009
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean0.385-0.372=0.013
σ0.014-0.006=0.008
min0.371-0.368=0.003
max0.401-0.382=0.019
iters=5
new-facts=1
prior-facts=6402
mean1930.403-1930.400=0.003
σ0.012-0.025=-0.012
min1930.390-1930.357=0.033
max1930.418-1930.420=-0.002
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean2.463-2.537=-0.074
σ0.072-0.132=-0.060
min2.387-2.444=-0.057
max2.580-2.755=-0.175
iters=5
new-facts=6402
prior-facts=1
mean4750.863-4750.845=0.018
σ0.802-0.803=-0.001
min4750.277-4750.343=-0.067
max4752.258-4752.259=-0.001
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean8.479-8.593=-0.113
σ0.394-0.275=0.120
min8.083-8.281=-0.199
max9.120-8.919=0.201
iters=5
new-facts=6402
prior-facts=6402
mean4941.261-4941.329=-0.069
σ0.129-0.083=0.046
min4941.072-4941.263=-0.191
max4941.437-4941.421=0.016
mean3048.000-3022.400=25.600
σ202.932-186.934=15.998
min2848.000-2858.000=-10.000
max3326.000-3314.000=12.000
mean8.454-8.453=0.001
σ0.111-0.120=-0.009
min8.340-8.294=0.046
max8.616-8.556=0.059

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.073-1.054=0.019
σ0.108-0.126=-0.018
min0.938-0.938=0.001
max1.241-1.251=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.913=-0.001
σ575.762-575.757=0.005
min178.022-178.031=-0.009
max1329.555-1329.548=0.007
mean81.750
σ7.500
min78.000
max93.000
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean0.432-0.442=-0.010
σ0.302-0.303=-0.001
min0.271-0.286=-0.014
max0.885-0.897=-0.011
policies=20
mean1780.479-1780.506=-0.027
σ0.346-0.357=-0.011
min1780.234-1780.252=-0.017
max1780.987-1781.030=-0.043
mean780.000
σ0.000
min780.000
max780.000
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean2.840-2.849=-0.009
σ0.006-0.009=-0.003
min2.833-2.841=-0.008
max2.847-2.861=-0.014
policies=200
mean17811.417-17811.595=-0.178
σ0.446-0.462=-0.016
min17811.123-17811.256=-0.133
max17812.078-17812.278=-0.200
mean7800.000
σ0.000
min7800.000
max7800.000
mean2848.000-2858.000=-10.000
σ0.000
min2848.000-2858.000=-10.000
max2848.000-2858.000=-10.000
mean28.276-28.364=-0.088
σ0.518-0.466=0.053
min27.792-27.819=-0.027
max28.797-28.792=0.005