Compare commits

Home / Compare a289cfbd .. 5aed75b2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=-0.000
σ0.048-0.045=0.004
min30.727-30.731=-0.005
max30.901-30.892=0.009
mean416.200-414.000=2.200
σ0.422-0.000=0.422
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.078-0.077=0.001
σ0.004-0.004=-0.000
min0.076-0.071=0.005
max0.086-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.002-0.002=0.000
min21.058-21.058=-0.000
max21.064-21.064=-0.000
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.064-0.063=0.000
σ0.003-0.003=-0.000
min0.062-0.057=0.005
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.418-1751.420=-0.002
σ0.362-0.361=0.001
min1750.849-1750.853=-0.004
max1752.008-1752.000=0.009
mean1668.350-1649.900=18.450
σ639.480-621.183=18.296
min682.000-681.000=1.000
max2697.000-2647.000=50.000
mean2.833-2.843=-0.010
σ0.148-0.144=0.004
min2.308-2.511=-0.203
max3.022-3.125=-0.103

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.757-275.757=0.001
σ0.012-0.012=-0.000
min275.745-275.744=0.002
max275.770-275.769=0.001
mean2697.000-2647.000=50.000
σ0.000
min2697.000-2647.000=50.000
max2697.000-2647.000=50.000
mean0.403-0.403=-0.001
σ0.011-0.011=-0.000
min0.395-0.394=0.001
max0.418-0.417=0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.267-2168.265=0.002
σ0.012-0.026=-0.014
min2168.254-2168.227=0.026
max2168.285-2168.286=-0.001
mean2697.000-2647.000=50.000
σ0.000
min2697.000-2647.000=50.000
max2697.000-2647.000=50.000
mean2.961-3.077=-0.116
σ0.157-0.211=-0.054
min2.786-2.764=0.022
max3.128-3.305=-0.176
iters=5
new-facts=6402
prior-facts=1
mean5048.120-5047.751=0.369
σ0.940-0.956=-0.016
min5047.532-5046.555=0.977
max5049.791-5049.220=0.571
mean2697.000-2647.000=50.000
σ0.000
min2697.000-2647.000=50.000
max2697.000-2647.000=50.000
mean8.800-9.058=-0.258
σ0.522-0.520=0.002
min8.050-8.180=-0.130
max9.336-9.531=-0.195
iters=5
new-facts=6402
prior-facts=6402
mean5179.231-5179.231=0.000
σ0.070-0.084=-0.014
min5179.165-5179.153=0.011
max5179.310-5179.325=-0.015
mean3267.200-3260.400=6.800
σ374.673-355.166=19.507
min2736.000-2745.000=-9.000
max3717.000-3675.000=42.000
mean9.953-9.809=0.144
σ0.342-0.349=-0.007
min9.598-9.341=0.257
max10.487-10.192=0.295

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.208-1.180=0.028
σ0.181-0.397=-0.215
min1.078-0.921=0.157
max1.475-1.833=-0.358

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.572-463.572=0.000
σ572.665-572.662=0.003
min177.235
max1322.569-1322.564=0.005
mean79.750
σ7.500
min76.000
max91.000
mean2697.000-2647.000=50.000
σ0.000
min2697.000-2647.000=50.000
max2697.000-2647.000=50.000
mean0.547-0.546=0.001
σ0.542-0.548=-0.006
min0.274-0.267=0.007
max1.361-1.368=-0.008
policies=20
mean1772.625-1772.617=0.008
σ0.329-0.329=0.000
min1772.402-1772.395=0.008
max1773.113-1773.105=0.008
mean760.000
σ0.000
min760.000
max760.000
mean2697.000-2647.000=50.000
σ0.000
min2697.000-2647.000=50.000
max2697.000-2647.000=50.000
mean2.747-2.741=0.006
σ0.017-0.012=0.005
min2.724-2.725=-0.001
max2.760-2.751=0.009
policies=200
mean17733.037-17732.914=0.123
σ0.494-0.463=0.031
min17732.774-17732.539=0.235
max17733.779-17733.573=0.206
mean7600.000
σ0.000
min7600.000
max7600.000
mean2697.000-2647.000=50.000
σ0.000
min2697.000-2647.000=50.000
max2697.000-2647.000=50.000
mean27.628-27.636=-0.008
σ0.148-0.131=0.017
min27.491-27.510=-0.019
max27.834-27.819=0.014