Compare commits

Home / Compare 05a34c08 .. f889cfa8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.769=0.000
σ0.048-0.047=0.000
min30.726-30.727=-0.002
max30.899-30.899=-0.000
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.077-0.078=-0.001
σ0.004-0.003=0.001
min0.072-0.075=-0.004
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.061-21.060=0.001
σ0.002-0.003=-0.001
min21.058-21.055=0.002
max21.064-21.065=-0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.064-0.063=0.000
σ0.002-0.003=-0.000
min0.062-0.061=0.001
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.420=0.000
σ0.363-0.360=0.003
min1750.853-1750.849=0.004
max1752.020-1751.983=0.036
mean1658.650-1637.050=21.600
σ645.946-613.623=32.324
min635.000-633.000=2.000
max2862.000-2469.000=393.000
mean2.827-2.817=0.010
σ0.178-0.145=0.033
min2.323-2.430=-0.106
max3.086-3.005=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.753-275.753=-0.000
σ0.005-0.013=-0.008
min275.745-275.738=0.007
max275.759-275.768=-0.010
mean2862.000-2469.000=393.000
σ0.000
min2862.000-2469.000=393.000
max2862.000-2469.000=393.000
mean0.395-0.391=0.004
σ0.012-0.008=0.004
min0.385-0.386=-0.000
max0.412-0.406=0.006
iters=5
new-facts=1
prior-facts=6402
mean2168.276-2168.281=-0.004
σ0.015-0.011=0.005
min2168.262-2168.263=-0.001
max2168.294-2168.292=0.002
mean2862.000-2469.000=393.000
σ0.000
min2862.000-2469.000=393.000
max2862.000-2469.000=393.000
mean2.877-2.897=-0.021
σ0.094-0.179=-0.085
min2.786-2.672=0.113
max2.981-3.052=-0.071
iters=5
new-facts=6402
prior-facts=1
mean5048.135-5047.754=0.381
σ0.880-1.235=-0.355
min5047.527-5046.565=0.962
max5049.690-5049.826=-0.136
mean2862.000-2469.000=393.000
σ0.000
min2862.000-2469.000=393.000
max2862.000-2469.000=393.000
mean8.661-8.915=-0.253
σ0.493-0.544=-0.051
min8.115-8.092=0.023
max9.386-9.543=-0.157
iters=5
new-facts=6402
prior-facts=6402
mean5179.148-5179.167=-0.019
σ0.209-0.207=0.002
min5178.807-5178.816=-0.009
max5179.319-5179.342=-0.023
mean3318.000-3244.200=73.800
σ454.622-368.907=85.714
min2862.000-2723.000=139.000
max3969.000-3693.000=276.000
mean9.738-9.822=-0.084
σ0.373-0.589=-0.216
min9.077-8.776=0.301
max9.943-10.194=-0.251

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.858=-0.771
σ0.231-0.123=0.108
min0.952-1.725=-0.773
max1.488-2.052=-0.564

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.578-463.564=0.014
σ572.661-572.651=0.010
min177.240-177.236=0.004
max1322.569-1322.540=0.029
mean79.750
σ7.500
min76.000
max91.000
mean2862.000-2469.000=393.000
σ0.000
min2862.000-2469.000=393.000
max2862.000-2469.000=393.000
mean0.441-0.561=-0.120
σ0.304-0.567=-0.264
min0.284-0.275=0.009
max0.896-1.412=-0.516
policies=20
mean1772.693-1772.641=0.052
σ0.342-0.329=0.013
min1772.435-1772.426=0.009
max1773.192-1773.130=0.062
mean760.000
σ0.000
min760.000
max760.000
mean2862.000-2469.000=393.000
σ0.000
min2862.000-2469.000=393.000
max2862.000-2469.000=393.000
mean2.871-2.740=0.130
σ0.025-0.020=0.005
min2.835-2.712=0.123
max2.887-2.756=0.131
policies=200
mean17733.108-17732.958=0.150
σ0.473-0.368=0.105
min17732.760-17732.761=-0.001
max17733.799-17733.510=0.288
mean7600.000
σ0.000
min7600.000
max7600.000
mean2862.000-2469.000=393.000
σ0.000
min2862.000-2469.000=393.000
max2862.000-2469.000=393.000
mean28.232-27.733=0.499
σ0.551-0.138=0.414
min27.675-27.594=0.081
max28.845-27.898=0.947