Compare commits

Home / Compare 820ba4d3 .. 4d13d16c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.769=0.001
σ0.047-0.049=-0.002
min30.730-30.732=-0.002
max30.900-30.905=-0.005
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.078-0.076=0.002
σ0.004-0.004=-0.000
min0.075-0.070=0.005
max0.085-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.000
σ0.002-0.002=-0.000
min21.058-21.056=0.002
max21.064-21.063=0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.062-0.061=0.001
σ0.004-0.004=0.001
min0.058-0.057=0.001
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.418=0.002
σ0.360-0.360=0.000
min1750.854-1750.848=0.006
max1751.999-1751.979=0.020
mean1652.650-1645.450=7.200
σ623.667-619.165=4.502
min683.000-679.000=4.000
max2651.000-2638.000=13.000
mean2.851-2.784=0.067
σ0.192-0.204=-0.012
min2.338-2.292=0.047
max3.203-3.036=0.167

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.756-275.756=-0.000
σ0.009-0.009=-0.000
min275.744-275.745=-0.001
max275.763-275.766=-0.003
mean2651.000-2638.000=13.000
σ0.000
min2651.000-2638.000=13.000
max2651.000-2638.000=13.000
mean0.406-0.407=-0.001
σ0.007-0.012=-0.004
min0.398-0.397=0.001
max0.416-0.421=-0.006
iters=5
new-facts=1
prior-facts=6402
mean2168.282-2168.285=-0.003
σ0.015-0.011=0.003
min2168.261-2168.269=-0.008
max2168.302-2168.299=0.003
mean2651.000-2638.000=13.000
σ0.000
min2651.000-2638.000=13.000
max2651.000-2638.000=13.000
mean2.857-3.004=-0.147
σ0.200-0.144=0.056
min2.653-2.824=-0.170
max3.155-3.161=-0.006
iters=5
new-facts=6402
prior-facts=1
mean5048.151-5048.039=0.111
σ1.002-1.152=-0.151
min5047.548-5047.026=0.522
max5049.921-5050.025=-0.104
mean2651.000-2638.000=13.000
σ0.000
min2651.000-2638.000=13.000
max2651.000-2638.000=13.000
mean8.745-8.926=-0.181
σ0.515-0.610=-0.095
min7.898-8.104=-0.206
max9.164-9.695=-0.531
iters=5
new-facts=6402
prior-facts=6402
mean5179.256-5179.200=0.056
σ0.098-0.223=-0.125
min5179.147-5178.819=0.328
max5179.353-5179.359=-0.007
mean3259.800-3202.800=57.000
σ462.196-348.994=113.202
min2655.000-2710.000=-55.000
max3877.000-3630.000=247.000
mean9.858-9.917=-0.058
σ0.266-0.326=-0.060
min9.510-9.469=0.041
max10.235-10.269=-0.034

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.234-1.271=-0.038
σ0.372-0.408=-0.036
min0.950-0.948=0.001
max1.826-1.973=-0.147

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.573-463.575=-0.002
σ572.663-572.660=0.003
min177.238-177.243=-0.005
max1322.567-1322.564=0.003
mean79.750
σ7.500
min76.000
max91.000
mean2651.000-2638.000=13.000
σ0.000
min2651.000-2638.000=13.000
max2651.000-2638.000=13.000
mean0.574-0.560=0.015
σ0.594-0.573=0.021
min0.272-0.258=0.015
max1.465-1.419=0.046
policies=20
mean1772.615-1772.642=-0.027
σ0.331-0.336=-0.004
min1772.388-1772.414=-0.026
max1773.106-1773.141=-0.035
mean760.000
σ0.000
min760.000
max760.000
mean2651.000-2638.000=13.000
σ0.000
min2651.000-2638.000=13.000
max2651.000-2638.000=13.000
mean2.739-2.768=-0.029
σ0.011-0.027=-0.016
min2.728-2.752=-0.024
max2.750-2.808=-0.058
policies=200
mean17732.915-17733.038=-0.123
σ0.401-0.512=-0.112
min17732.577-17732.721=-0.143
max17733.492-17733.803=-0.312
mean7600.000
σ0.000
min7600.000
max7600.000
mean2651.000-2638.000=13.000
σ0.000
min2651.000-2638.000=13.000
max2651.000-2638.000=13.000
mean27.752-27.741=0.011
σ0.117-0.139=-0.022
min27.633-27.618=0.015
max27.898-27.916=-0.018