Compare commits

Home / Compare dfcf7b34 .. cfd42f20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-30.774=-0.001
σ0.046-0.046=-0.001
min30.749-30.753=-0.004
max30.902-30.905=-0.003
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.076-0.080=-0.004
σ0.004-0.003=0.001
min0.071-0.077=-0.006
max0.082-0.086=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.059-21.059=-0.000
σ0.002-0.003=-0.001
min21.054-21.055=-0.001
max21.062-21.065=-0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.063-0.062=0.001
σ0.003-0.003=-0.000
min0.059-0.058=0.001
max0.070-0.066=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1713.349-1751.235=-37.886
σ169.540-0.363=169.177
min993.056-1750.666=-757.610
max1751.819-1751.828=-0.009
mean1609.200-1649.950=-40.750
σ607.167-620.036=-12.869
min631.000-681.000=-50.000
max2426.000-2643.000=-217.000
mean2.773-2.765=0.008
σ0.310-0.157=0.153
min1.552-2.265=-0.713
max2.981-2.985=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.200-273.196=0.003
σ0.005-0.011=-0.005
min273.194-273.178=0.016
max273.205-273.204=0.002
mean2426.000-2643.000=-217.000
σ0.000
min2426.000-2643.000=-217.000
max2426.000-2643.000=-217.000
mean0.386-0.388=-0.001
σ0.009-0.006=0.002
min0.378-0.377=0.001
max0.397-0.393=0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.628-1933.635=-0.007
σ0.005-0.012=-0.007
min1933.626-1933.621=0.005
max1933.637-1933.650=-0.013
mean2426.000-2643.000=-217.000
σ0.000
min2426.000-2643.000=-217.000
max2426.000-2643.000=-217.000
mean3.019-3.042=-0.023
σ0.076-0.172=-0.096
min2.970-2.812=0.158
max3.150-3.243=-0.093
iters=5
new-facts=6402
prior-facts=1
mean4754.069-4754.023=0.046
σ0.965-1.035=-0.069
min4753.240-4752.979=0.262
max4755.733-4755.762=-0.029
mean2426.000-2643.000=-217.000
σ0.000
min2426.000-2643.000=-217.000
max2426.000-2643.000=-217.000
mean8.376-8.646=-0.270
σ0.507-0.796=-0.289
min7.880-7.640=0.240
max9.175-9.746=-0.571
iters=5
new-facts=6402
prior-facts=6402
mean4944.522-4944.455=0.067
σ0.199-0.280=-0.081
min4944.189-4943.969=0.220
max4944.677-4944.693=-0.016
mean2943.800-2997.400=-53.600
σ445.852-309.438=136.414
min2426.000-2643.000=-217.000
max3531.000-3304.000=227.000
mean8.391-8.872=-0.481
σ0.104-0.603=-0.499
min8.334-8.388=-0.054
max8.576-9.879=-1.302

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.743-1.246=0.496
σ0.273-0.452=-0.179
min1.258-0.942=0.316
max1.918-2.022=-0.104

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.192-463.206=-0.014
σ572.656-572.660=-0.004
min176.863-176.871=-0.009
max1322.176-1322.196=-0.020
mean77.500
σ7.000
min74.000
max88.000
mean2426.000-2643.000=-217.000
σ0.000
min2426.000-2643.000=-217.000
max2426.000-2643.000=-217.000
mean0.549-0.547=0.002
σ0.537-0.536=0.001
min0.273-0.274=-0.001
max1.354-1.351=0.003
policies=20
mean1768.920-1768.955=-0.035
σ0.342-0.329=0.014
min1768.700-1768.742=-0.041
max1769.430-1769.445=-0.015
mean740.000
σ0.000
min740.000
max740.000
mean2426.000-2643.000=-217.000
σ0.000
min2426.000-2643.000=-217.000
max2426.000-2643.000=-217.000
mean2.745-2.738=0.007
σ0.038-0.021=0.017
min2.715-2.716=-0.002
max2.798-2.763=0.035
policies=200
mean17696.034-17696.272=-0.238
σ0.564-0.517=0.047
min17695.615-17695.989=-0.375
max17696.861-17697.046=-0.185
mean7400.000
σ0.000
min7400.000
max7400.000
mean2426.000-2643.000=-217.000
σ0.000
min2426.000-2643.000=-217.000
max2426.000-2643.000=-217.000
mean27.644-27.514=0.131
σ0.194-0.147=0.048
min27.407-27.357=0.050
max27.824-27.688=0.135