Compare commits

Home / Compare 6e00e46c .. 08832267

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.965=0.002
σ0.104-0.101=0.003
min35.922-35.921=0.001
max36.260-36.251=0.009
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.077-0.077=-0.000
σ0.004-0.003=0.000
min0.074-0.074=-0.000
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.209-26.208=0.001
σ0.004-0.005=-0.001
min26.202-26.202=0.001
max26.216-26.217=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.061-0.060=0.000
σ0.003-0.004=-0.001
min0.059-0.056=0.002
max0.069-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.314-1756.314=-0.000
σ0.368-0.369=-0.001
min1755.736-1755.737=-0.001
max1756.904-1756.910=-0.006
mean1661.000-1675.100=-14.100
σ635.437-636.235=-0.798
min612.000-678.000=-66.000
max2739.000-2688.000=51.000
mean2.381-2.337=0.044
σ0.129-0.078=0.051
min2.256-2.167=0.089
max2.804-2.519=0.285

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.847-278.844=0.003
σ0.004-0.008=-0.004
min278.840-278.832=0.008
max278.851-278.853=-0.002
mean2739.000-2688.000=51.000
σ0.000
min2739.000-2688.000=51.000
max2739.000-2688.000=51.000
mean0.410-0.412=-0.001
σ0.006-0.004=0.002
min0.406-0.408=-0.002
max0.417-0.417=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2268.899-2268.899=0.000
σ0.017-0.008=0.009
min2268.881-2268.889=-0.009
max2268.919-2268.908=0.011
mean2739.000-2688.000=51.000
σ0.000
min2739.000-2688.000=51.000
max2739.000-2688.000=51.000
mean2.964-2.985=-0.021
σ0.100-0.122=-0.022
min2.903-2.880=0.023
max3.141-3.163=-0.023
iters=5
new-facts=6402
prior-facts=1
mean4954.262-4954.257=0.005
σ0.795-0.841=-0.047
min4953.781-4953.818=-0.037
max4955.671-4955.759=-0.088
mean2739.000-2688.000=51.000
σ0.000
min2739.000-2688.000=51.000
max2739.000-2688.000=51.000
mean7.952-8.094=-0.142
σ0.090-0.196=-0.106
min7.835-7.884=-0.049
max8.086-8.356=-0.270
iters=5
new-facts=6402
prior-facts=6402
mean5168.817-5168.743=0.074
σ0.082-0.190=-0.108
min5168.746-5168.427=0.319
max5168.906-5168.895=0.012
mean3423.000-3436.400=-13.400
σ469.866-474.718=-4.852
min2827.000-2843.000=-16.000
max4060.000-4118.000=-58.000
mean9.202-9.228=-0.026
σ0.436-0.309=0.127
min8.496-8.986=-0.490
max9.697-9.743=-0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.971-1.098=-0.126
σ0.053-0.224=-0.171
min0.939-0.931=0.008
max1.067-1.389=-0.322

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.354-460.360=-0.007
σ572.654-572.657=-0.003
min174.023-174.025=-0.002
max1319.335-1319.346=-0.011
mean79.500
σ7.000
min76.000
max90.000
mean2739.000-2688.000=51.000
σ0.000
min2739.000-2688.000=51.000
max2739.000-2688.000=51.000
mean0.540-0.551=-0.011
σ0.547-0.561=-0.014
min0.266-0.262=0.004
max1.361-1.392=-0.032
policies=20
mean1740.500-1740.495=0.004
σ0.316-0.317=-0.001
min1740.293-1740.284=0.009
max1740.971-1740.967=0.004
mean760.000
σ0.000
min760.000
max760.000
mean2739.000-2688.000=51.000
σ0.000
min2739.000-2688.000=51.000
max2739.000-2688.000=51.000
mean2.676-2.668=0.008
σ0.023-0.010=0.013
min2.661-2.654=0.006
max2.710-2.676=0.034
policies=200
mean17411.949-17411.864=0.085
σ0.473-0.432=0.042
min17411.656-17411.531=0.125
max17412.657-17412.498=0.159
mean7600.000
σ0.000
min7600.000
max7600.000
mean2739.000-2688.000=51.000
σ0.000
min2739.000-2688.000=51.000
max2739.000-2688.000=51.000
mean27.002-26.991=0.011
σ0.064-0.091=-0.027
min26.934-26.867=0.067
max27.071-27.079=-0.007