Compare commits

Home / Compare e7938cd0 .. dabd0937

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-35.798=-5.029
σ0.046-0.106=-0.061
min30.733-35.754=-5.022
max30.896-36.099=-5.202
mean414.000-410.000=4.000
σ0.000
min414.000-410.000=4.000
max414.000-410.000=4.000
mean0.076-0.073=0.003
σ0.004-0.003=0.001
min0.070-0.069=0.001
max0.084-0.077=0.006
cache=y
dps=1
iters=10
policies=100
mean21.061-26.066=-5.005
σ0.002-0.003=-0.001
min21.058-26.062=-5.004
max21.064-26.071=-5.007
mean414.000-410.600=3.400
σ0.000-0.516=-0.516
min414.000-410.000=4.000
max414.000-411.000=3.000
mean0.064-0.061=0.003
σ0.002-0.003=-0.000
min0.062-0.059=0.003
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.421-1751.236=0.185
σ0.363-0.361=0.002
min1750.848-1750.670=0.178
max1752.000-1751.803=0.197
mean1660.550-1651.550=9.000
σ631.808-643.493=-11.684
min681.000-624.000=57.000
max2689.000-2844.000=-155.000
mean2.860-2.810=0.050
σ0.109-0.147=-0.038
min2.646-2.462=0.184
max3.022-3.012=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.755-275.568=0.187
σ0.011-0.007=0.004
min275.741-275.557=0.183
max275.767-275.575=0.192
mean2689.000-2844.000=-155.000
σ0.000
min2689.000-2844.000=-155.000
max2689.000-2844.000=-155.000
mean0.405-0.404=0.001
σ0.009-0.007=0.002
min0.398-0.397=0.002
max0.418-0.411=0.007
iters=5
new-facts=1
prior-facts=6402
mean2168.286-2168.101=0.186
σ0.006-0.010=-0.004
min2168.277-2168.089=0.188
max2168.291-2168.113=0.179
mean2689.000-2844.000=-155.000
σ0.000
min2689.000-2844.000=-155.000
max2689.000-2844.000=-155.000
mean2.975-3.050=-0.076
σ0.217-0.172=0.045
min2.682-2.811=-0.129
max3.258-3.223=0.035
iters=5
new-facts=6402
prior-facts=1
mean5048.149-5047.888=0.261
σ0.916-0.878=0.038
min5047.544-5047.414=0.130
max5049.774-5049.450=0.324
mean2689.000-2844.000=-155.000
σ0.000
min2689.000-2844.000=-155.000
max2689.000-2844.000=-155.000
mean8.761-8.830=-0.069
σ0.539-0.374=0.164
min8.061-8.214=-0.154
max9.301-9.122=0.179
iters=5
new-facts=6402
prior-facts=6402
mean5179.229-5178.908=0.321
σ0.076-0.263=-0.187
min5179.143-5178.625=0.518
max5179.310-5179.149=0.162
mean3227.400-3250.600=-23.200
σ389.684-328.141=61.542
min2702.000-2844.000=-142.000
max3736.000-3695.000=41.000
mean9.771-9.855=-0.085
σ0.657-0.323=0.334
min8.728-9.463=-0.735
max10.438-10.222=0.216

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.126-1.076=0.050
σ0.196-0.109=0.086
min0.948-0.944=0.003
max1.398-1.249=0.148

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.578-463.205=0.373
σ572.675-572.653=0.023
min177.237-176.873=0.364
max1322.591-1322.184=0.407
mean79.750-77.500=2.250
σ7.500-7.000=0.500
min76.000-74.000=2.000
max91.000-88.000=3.000
mean2689.000-2844.000=-155.000
σ0.000
min2689.000-2844.000=-155.000
max2689.000-2844.000=-155.000
mean0.546-0.435=0.111
σ0.540-0.304=0.236
min0.274-0.282=-0.008
max1.357-0.891=0.466
policies=20
mean1772.631-1769.005=3.627
σ0.341-0.331=0.010
min1772.389-1768.773=3.616
max1773.136-1769.494=3.643
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2689.000-2844.000=-155.000
σ0.000
min2689.000-2844.000=-155.000
max2689.000-2844.000=-155.000
mean2.747-2.824=-0.077
σ0.012-0.009=0.003
min2.736-2.811=-0.075
max2.763-2.831=-0.068
policies=200
mean17733.064-17696.164=36.900
σ0.458-0.533=-0.075
min17732.751-17695.728=37.023
max17733.742-17696.910=36.832
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2689.000-2844.000=-155.000
σ0.000
min2689.000-2844.000=-155.000
max2689.000-2844.000=-155.000
mean27.774-28.069=-0.295
σ0.186-0.545=-0.359
min27.603-27.509=0.094
max28.038-28.609=-0.571