Compare commits

Home / Compare aab98c11 .. 21fc09f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.958=-0.001
σ0.049-0.049=0.000
min30.915-30.917=-0.002
max31.094-31.093=0.001
mean412.000
σ0.000
min412.000
max412.000
mean0.079-0.079=-0.000
σ0.003-0.003=0.000
min0.075-0.076=-0.000
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.002-0.003=-0.001
min21.056-21.057=-0.001
max21.062-21.066=-0.004
mean412.000
σ0.000
min412.000
max412.000
mean0.064-0.064=0.000
σ0.002-0.002=0.001
min0.062-0.062=0.000
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1713.515=37.897
σ0.361-169.484=-169.123
min1750.846-993.459=757.387
max1751.988-1751.976=0.012
mean1654.900-1628.900=26.000
σ617.272-598.368=18.905
min637.000-639.000=-2.000
max2494.000-2504.000=-10.000
mean2.843-2.758=0.085
σ0.124-0.344=-0.220
min2.604-1.450=1.153
max3.195-3.183=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.404-273.402=0.002
σ0.010-0.010=0.000
min273.395-273.391=0.004
max273.419-273.413=0.006
mean2494.000-2504.000=-10.000
σ0.000
min2494.000-2504.000=-10.000
max2494.000-2504.000=-10.000
mean0.383-0.386=-0.002
σ0.009-0.008=0.001
min0.378-0.376=0.002
max0.400-0.394=0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.842-1933.847=-0.005
σ0.008-0.014=-0.005
min1933.835-1933.829=0.006
max1933.855-1933.863=-0.009
mean2494.000-2504.000=-10.000
σ0.000
min2494.000-2504.000=-10.000
max2494.000-2504.000=-10.000
mean2.858-3.003=-0.145
σ0.158-0.293=-0.135
min2.680-2.532=0.148
max2.992-3.307=-0.316
iters=5
new-facts=6402
prior-facts=1
mean4754.267-4754.337=-0.070
σ0.899-0.875=0.025
min4753.534-4753.762=-0.229
max4755.835-4755.889=-0.054
mean2494.000-2504.000=-10.000
σ0.000
min2494.000-2504.000=-10.000
max2494.000-2504.000=-10.000
mean8.244-8.559=-0.315
σ0.638-0.573=0.065
min7.604-7.643=-0.039
max9.120-9.054=0.066
iters=5
new-facts=6402
prior-facts=6402
mean4944.667-4944.733=-0.066
σ0.195-0.120=0.075
min4944.404-4944.546=-0.142
max4944.894-4944.879=0.015
mean3012.400-3014.200=-1.800
σ418.524-365.340=53.184
min2494.000-2543.000=-49.000
max3585.000-3365.000=220.000
mean8.716-8.791=-0.075
σ0.395-0.412=-0.017
min8.470-8.497=-0.027
max9.416-9.508=-0.092

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.711-1.545=0.166
σ0.146-0.292=-0.146
min1.454-1.152=0.302
max1.817-1.838=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.334-463.332=0.002
σ572.197-572.199=-0.002
min177.233-177.227=0.007
max1321.630-1321.631=-0.001
mean79.750
σ7.500
min76.000
max91.000
mean2494.000-2504.000=-10.000
σ0.000
min2494.000-2504.000=-10.000
max2494.000-2504.000=-10.000
mean0.541-0.550=-0.010
σ0.514-0.541=-0.027
min0.281-0.275=0.006
max1.312-1.362=-0.050
policies=20
mean1772.586-1772.557=0.028
σ0.334-0.329=0.005
min1772.362-1772.328=0.034
max1773.081-1773.044=0.038
mean760.000
σ0.000
min760.000
max760.000
mean2494.000-2504.000=-10.000
σ0.000
min2494.000-2504.000=-10.000
max2494.000-2504.000=-10.000
mean2.735-2.732=0.003
σ0.007-0.010=-0.003
min2.729-2.723=0.006
max2.745-2.746=-0.001
policies=200
mean17732.382-17732.327=0.055
σ0.510-0.588=-0.077
min17731.999-17731.986=0.014
max17733.123-17733.206=-0.084
mean7600.000
σ0.000
min7600.000
max7600.000
mean2494.000-2504.000=-10.000
σ0.000
min2494.000-2504.000=-10.000
max2494.000-2504.000=-10.000
mean27.592-27.647=-0.055
σ0.073-0.096=-0.023
min27.534-27.534=0.000
max27.696-27.766=-0.071