Compare commits

Home / Compare 5e102a6d .. 68153bd9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.770=-0.001
σ0.049-0.048=0.002
min30.727-30.732=-0.005
max30.905-30.901=0.004
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.076-0.076=0.000
σ0.005-0.005=0.000
min0.070-0.070=0.000
max0.087-0.082=0.004
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.000
σ0.002-0.003=-0.001
min21.057-21.054=0.003
max21.063-21.064=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.063-0.061=0.003
σ0.003-0.004=-0.002
min0.062-0.057=0.005
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.416=0.002
σ0.359-0.362=-0.003
min1750.852-1750.849=0.003
max1751.980-1751.998=-0.018
mean1668.650-1676.600=-7.950
σ640.483-622.308=18.175
min681.000-666.000=15.000
max2702.000-2645.000=57.000
mean2.820-2.786=0.034
σ0.137-0.152=-0.015
min2.459-2.377=0.083
max2.974-2.964=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.758-275.760=-0.001
σ0.012-0.012=-0.000
min275.742-275.747=-0.005
max275.769-275.775=-0.006
mean2702.000-2645.000=57.000
σ0.000
min2702.000-2645.000=57.000
max2702.000-2645.000=57.000
mean0.407-0.399=0.008
σ0.015-0.005=0.009
min0.396-0.394=0.003
max0.427-0.407=0.020
iters=5
new-facts=1
prior-facts=6402
mean2168.245-2168.293=-0.048
σ0.062-0.004=0.058
min2168.137-2168.288=-0.152
max2168.286-2168.299=-0.013
mean2702.000-2645.000=57.000
σ0.000
min2702.000-2645.000=57.000
max2702.000-2645.000=57.000
mean2.830-2.922=-0.092
σ0.090-0.094=-0.004
min2.757-2.761=-0.004
max2.951-2.993=-0.042
iters=5
new-facts=6402
prior-facts=1
mean5048.084-5047.978=0.106
σ0.934-1.009=-0.075
min5047.525-5047.209=0.316
max5049.741-5049.747=-0.007
mean2702.000-2645.000=57.000
σ0.000
min2702.000-2645.000=57.000
max2702.000-2645.000=57.000
mean8.947-8.877=0.070
σ0.494-0.511=-0.016
min8.074-8.028=0.046
max9.269-9.354=-0.085
iters=5
new-facts=6402
prior-facts=6402
mean5179.227-5179.152=0.075
σ0.078-0.212=-0.134
min5179.153-5178.791=0.363
max5179.314-5179.316=-0.002
mean3250.800-3230.200=20.600
σ460.565-396.287=64.277
min2702.000-2692.000=10.000
max3873.000-3739.000=134.000
mean9.802-9.517=0.285
σ0.196-0.723=-0.528
min9.496-8.718=0.778
max10.012-10.352=-0.340

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-1.185=-0.136
σ0.142-0.278=-0.136
min0.942-0.942=-0.000
max1.240-1.547=-0.307

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.579-463.575=0.004
σ572.667-572.674=-0.007
min177.236-177.235=0.001
max1322.579-1322.586=-0.006
mean79.750
σ7.500
min76.000
max91.000
mean2702.000-2645.000=57.000
σ0.000
min2702.000-2645.000=57.000
max2702.000-2645.000=57.000
mean0.563-0.548=0.015
σ0.557-0.545=0.012
min0.279-0.272=0.006
max1.399-1.366=0.033
policies=20
mean1772.646-1772.620=0.026
σ0.340-0.332=0.008
min1772.414-1772.403=0.011
max1773.151-1773.114=0.037
mean760.000
σ0.000
min760.000
max760.000
mean2702.000-2645.000=57.000
σ0.000
min2702.000-2645.000=57.000
max2702.000-2645.000=57.000
mean2.751-2.749=0.001
σ0.015-0.017=-0.002
min2.730-2.731=-0.002
max2.763-2.771=-0.008
policies=200
mean17733.034-17732.873=0.161
σ0.525-0.605=-0.080
min17732.739-17732.484=0.256
max17733.819-17733.773=0.046
mean7600.000
σ0.000
min7600.000
max7600.000
mean2702.000-2645.000=57.000
σ0.000
min2702.000-2645.000=57.000
max2702.000-2645.000=57.000
mean27.774-27.655=0.119
σ0.162-0.127=0.036
min27.601-27.545=0.056
max27.938-27.815=0.123