Compare commits

Home / Compare 8d5fd39c .. c0ac8fe2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.378=0.002
σ0.048-0.045=0.003
min70.350-70.349=0.001
max70.514-70.502=0.012
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.159-0.159=-0.000
σ0.003-0.003=-0.000
min0.156-0.156=-0.000
max0.164-0.164=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.002-0.002=-0.000
min21.141-21.139=0.002
max21.148-21.146=0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.064-0.064=0.000
σ0.003-0.002=0.001
min0.063-0.062=0.001
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.389-1752.383=0.006
σ0.362-0.363=-0.000
min1751.817-1751.821=-0.004
max1752.969-1752.967=0.002
mean1677.650-1654.400=23.250
σ623.521-644.705=-21.184
min671.000-632.000=39.000
max2619.000-2849.000=-230.000
mean2.766-2.843=-0.077
σ0.175-0.133=0.042
min2.340-2.551=-0.211
max3.083-3.072=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.124-270.134=-0.011
σ0.010-0.006=0.004
min270.108-270.127=-0.019
max270.133-270.143=-0.010
mean2619.000-2849.000=-230.000
σ0.000
min2619.000-2849.000=-230.000
max2619.000-2849.000=-230.000
mean0.372-0.383=-0.011
σ0.003-0.002=0.000
min0.370-0.381=-0.011
max0.377-0.387=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.586-1930.592=-0.006
σ0.014-0.010=0.004
min1930.564-1930.576=-0.013
max1930.601-1930.602=-0.001
mean2619.000-2849.000=-230.000
σ0.000
min2619.000-2849.000=-230.000
max2619.000-2849.000=-230.000
mean2.531-2.583=-0.052
σ0.154-0.107=0.047
min2.410-2.458=-0.048
max2.797-2.688=0.109
iters=5
new-facts=6402
prior-facts=1
mean4750.813-4610.528=140.285
σ1.112-314.418=-313.306
min4749.586-4048.081=701.504
max4752.634-4752.622=0.012
mean2619.000-2849.000=-230.000
σ0.000
min2619.000-2849.000=-230.000
max2619.000-2849.000=-230.000
mean8.678-8.353=0.325
σ0.373-0.827=-0.454
min8.113-7.344=0.769
max9.078-9.264=-0.185
iters=5
new-facts=6402
prior-facts=6402
mean4941.532-4941.525=0.007
σ0.094-0.082=0.011
min4941.452-4941.463=-0.011
max4941.640-4941.620=0.020
mean2995.200-2999.800=-4.600
σ278.412-233.445=44.967
min2619.000-2849.000=-230.000
max3326.000-3380.000=-54.000
mean8.524-8.382=0.142
σ0.163-0.021=0.142
min8.390-8.361=0.029
max8.741-8.417=0.324

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.318-1.090=0.228
σ0.420-0.164=0.256
min0.907-0.933=-0.026
max1.779-1.274=0.505

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.286-466.284=0.001
σ575.780-575.771=0.009
min178.390-178.395=-0.004
max1329.955-1329.941=0.014
mean84.000
σ8.000
min80.000
max96.000
mean2619.000-2849.000=-230.000
σ0.000
min2619.000-2849.000=-230.000
max2619.000-2849.000=-230.000
mean0.563-0.443=0.120
σ0.561-0.307=0.254
min0.279-0.286=-0.007
max1.405-0.903=0.502
policies=20
mean1784.226-1784.258=-0.032
σ0.355-0.389=-0.034
min1784.008-1783.988=0.020
max1784.754-1784.830=-0.076
mean800.000
σ0.000
min800.000
max800.000
mean2619.000-2849.000=-230.000
σ0.000
min2619.000-2849.000=-230.000
max2619.000-2849.000=-230.000
mean2.768-2.920=-0.151
σ0.011-0.074=-0.063
min2.756-2.852=-0.096
max2.779-3.000=-0.221
policies=200
mean17848.815-17848.584=0.231
σ0.381-0.449=-0.068
min17848.594-17848.195=0.399
max17849.385-17849.219=0.167
mean8000.000
σ0.000
min8000.000
max8000.000
mean2619.000-2849.000=-230.000
σ0.000
min2619.000-2849.000=-230.000
max2619.000-2849.000=-230.000
mean27.944-28.328=-0.384
σ0.086-0.525=-0.439
min27.861-27.869=-0.008
max28.065-28.786=-0.721