Compare commits

Home / Compare ebaf9b1a .. 60e1b3e8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-30.774=-0.002
σ0.047-0.046=0.001
min30.744-30.752=-0.008
max30.904-30.903=0.000
mean413.000-413.900=-0.900
σ0.000-0.316=-0.316
min413.000
max413.000-414.000=-1.000
mean0.073-0.080=-0.006
σ0.003-0.003=-0.000
min0.070-0.077=-0.007
max0.079-0.087=-0.007
cache=y
dps=1
iters=10
policies=100
mean21.059-21.060=-0.001
σ0.003-0.002=0.001
min21.055-21.055=0.000
max21.064-21.063=0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.002
min0.057-0.063=-0.006
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.235=0.000
σ0.364-0.362=0.002
min1750.668-1750.671=-0.003
max1751.822-1751.814=0.008
mean1668.350-1665.400=2.950
σ644.198-637.134=7.064
min620.000-680.000=-60.000
max2743.000-2689.000=54.000
mean2.838-2.807=0.031
σ0.184-0.192=-0.008
min2.364-2.280=0.084
max3.062-3.022=0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-275.566=0.000
σ0.002-0.005=-0.003
min275.564-275.562=0.003
max275.570-275.575=-0.005
mean2743.000-2689.000=54.000
σ0.000
min2743.000-2689.000=54.000
max2743.000-2689.000=54.000
mean0.390-0.392=-0.002
σ0.009-0.010=-0.001
min0.383-0.384=-0.001
max0.402-0.402=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2168.091-2168.100=-0.009
σ0.020-0.008=0.012
min2168.060-2168.087=-0.027
max2168.113-2168.107=0.005
mean2743.000-2689.000=54.000
σ0.000
min2743.000-2689.000=54.000
max2743.000-2689.000=54.000
mean2.949-2.872=0.077
σ0.144-0.188=-0.043
min2.742-2.667=0.075
max3.095-3.152=-0.058
iters=5
new-facts=6402
prior-facts=1
mean5047.910-5047.891=0.019
σ0.901-0.899=0.001
min5047.360-5047.352=0.008
max5049.512-5049.487=0.025
mean2743.000-2689.000=54.000
σ0.000
min2743.000-2689.000=54.000
max2743.000-2689.000=54.000
mean8.756-8.761=-0.005
σ0.549-0.422=0.127
min7.998-8.036=-0.038
max9.339-9.136=0.203
iters=5
new-facts=6402
prior-facts=6402
mean5178.975-5178.959=0.016
σ0.211-0.126=0.085
min5178.625-5178.770=-0.145
max5179.153-5179.124=0.029
mean3209.800-3261.200=-51.400
σ335.853-464.213=-128.360
min2743.000-2689.000=54.000
max3627.000-3864.000=-237.000
mean9.771-9.779=-0.008
σ0.271-0.145=0.126
min9.445-9.562=-0.117
max10.143-9.913=0.231

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.155=-0.096
σ0.129-0.182=-0.053
min0.939-0.946=-0.007
max1.258-1.416=-0.159

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.211-463.201=0.011
σ572.661-572.663=-0.001
min176.875-176.868=0.007
max1322.203-1322.195=0.008
mean77.500
σ7.000
min74.000
max88.000
mean2743.000-2689.000=54.000
σ0.000
min2743.000-2689.000=54.000
max2743.000-2689.000=54.000
mean0.548-0.551=-0.002
σ0.538-0.542=-0.003
min0.275-0.276=-0.000
max1.356-1.364=-0.008
policies=20
mean1768.942-1768.945=-0.002
σ0.322-0.333=-0.010
min1768.729-1768.740=-0.011
max1769.422-1769.442=-0.020
mean740.000
σ0.000
min740.000
max740.000
mean2743.000-2689.000=54.000
σ0.000
min2743.000-2689.000=54.000
max2743.000-2689.000=54.000
mean2.725-2.743=-0.018
σ0.007-0.013=-0.006
min2.719-2.728=-0.009
max2.734-2.759=-0.025
policies=200
mean17696.280-17696.011=0.269
σ0.484-0.228=0.256
min17696.026-17695.740=0.286
max17697.005-17696.294=0.712
mean7400.000
σ0.000
min7400.000
max7400.000
mean2743.000-2689.000=54.000
σ0.000
min2743.000-2689.000=54.000
max2743.000-2689.000=54.000
mean27.542-27.551=-0.009
σ0.165-0.115=0.050
min27.362-27.442=-0.080
max27.705-27.654=0.051