Compare commits

Home / Compare d33cf5f5 .. 3252837b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.001
σ0.049-0.048=0.001
min30.996-31.001=-0.005
max31.176-31.173=0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.079-0.079=0.001
σ0.004-0.002=0.001
min0.076-0.077=-0.000
max0.086-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.003-0.003=-0.000
min21.139-21.139=-0.001
max21.148-21.147=0.000
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.063-0.064=-0.001
σ0.005-0.004=0.001
min0.058-0.058=0.000
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.411=0.000
σ0.362-0.363=-0.001
min1750.843-1750.838=0.005
max1751.994-1751.995=-0.001
mean1658.250-1647.950=10.300
σ631.644-628.474=3.171
min623.000-628.000=-5.000
max2757.000-2849.000=-92.000
mean2.809-2.831=-0.022
σ0.171-0.096=0.075
min2.381-2.627=-0.246
max3.092-3.066=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.628-271.643=-0.015
σ0.020-0.004=0.017
min271.610-271.639=-0.030
max271.661-271.648=0.013
mean2757.000-2849.000=-92.000
σ0.000
min2757.000-2849.000=-92.000
max2757.000-2849.000=-92.000
mean0.383-0.384=-0.001
σ0.005-0.009=-0.004
min0.378-0.377=0.001
max0.390-0.397=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1932.113-1932.112=0.002
σ0.006-0.007=-0.001
min1932.102-1932.100=0.002
max1932.118-1932.117=0.002
mean2757.000-2849.000=-92.000
σ0.000
min2757.000-2849.000=-92.000
max2757.000-2849.000=-92.000
mean2.569-2.573=-0.004
σ0.120-0.195=-0.075
min2.470-2.429=0.040
max2.750-2.913=-0.162
iters=5
new-facts=6402
prior-facts=1
mean4752.583-4752.642=-0.059
σ0.887-0.770=0.117
min4751.983-4752.244=-0.261
max4754.155-4754.017=0.139
mean2757.000-2849.000=-92.000
σ0.000
min2757.000-2849.000=-92.000
max2757.000-2849.000=-92.000
mean8.683-8.080=0.603
σ0.625-0.272=0.354
min7.697-7.719=-0.022
max9.292-8.397=0.895
iters=5
new-facts=6402
prior-facts=6402
mean4943.048-4943.041=0.008
σ0.082-0.080=0.002
min4942.986-4942.961=0.025
max4943.142-4943.128=0.015
mean3040.800-3055.000=-14.200
σ261.235-266.493=-5.258
min2757.000-2849.000=-92.000
max3407.000-3462.000=-55.000
mean8.548-8.414=0.134
σ0.237-0.104=0.133
min8.240-8.345=-0.105
max8.834-8.588=0.246

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.071-1.076=-0.004
σ0.109-0.107=0.002
min0.939-0.938=0.001
max1.242-1.239=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.126-465.124=0.002
σ575.768-575.762=0.006
min177.231-177.233=-0.002
max1328.778-1328.767=0.011
mean79.750
σ7.500
min76.000
max91.000
mean2757.000-2849.000=-92.000
σ0.000
min2757.000-2849.000=-92.000
max2757.000-2849.000=-92.000
mean0.550-0.443=0.107
σ0.543-0.312=0.231
min0.277-0.283=-0.006
max1.364-0.910=0.454
policies=20
mean1772.597-1772.618=-0.021
σ0.332-0.333=-0.001
min1772.377-1772.374=0.003
max1773.089-1773.106=-0.017
mean760.000
σ0.000
min760.000
max760.000
mean2757.000-2849.000=-92.000
σ0.000
min2757.000-2849.000=-92.000
max2757.000-2849.000=-92.000
mean2.753-2.831=-0.078
σ0.015-0.011=0.004
min2.731-2.818=-0.087
max2.765-2.845=-0.080
policies=200
mean17732.380-17732.450=-0.070
σ0.539-0.455=0.084
min17732.047-17731.993=0.054
max17733.185-17733.079=0.106
mean7600.000
σ0.000
min7600.000
max7600.000
mean2757.000-2849.000=-92.000
σ0.000
min2757.000-2849.000=-92.000
max2757.000-2849.000=-92.000
mean27.700-28.173=-0.473
σ0.135-0.425=-0.290
min27.594-27.639=-0.045
max27.895-28.559=-0.664