Compare commits

Home / Compare 7dcb74b8 .. 09c5eb2b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.770=-0.001
σ0.046-0.048=-0.002
min30.734-30.727=0.008
max30.896-30.900=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.078-0.078=0.000
σ0.003-0.003=0.000
min0.075-0.076=-0.001
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.000
σ0.001-0.002=-0.001
min21.057-21.058=-0.000
max21.062-21.064=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.061-0.063=-0.002
σ0.003-0.002=0.001
min0.058-0.062=-0.004
max0.069-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.416-1751.420=-0.003
σ0.362-0.361=0.001
min1750.853-1750.850=0.002
max1751.997-1752.000=-0.003
mean1661.650-1664.450=-2.800
σ634.667-639.360=-4.692
min622.000-681.000=-59.000
max2791.000-2695.000=96.000
mean2.784-2.812=-0.028
σ0.116-0.178=-0.062
min2.550-2.293=0.257
max2.943-3.023=-0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.761-275.755=0.005
σ0.011-0.008=0.003
min275.746-275.745=0.001
max275.774-275.765=0.008
mean2791.000-2695.000=96.000
σ0.000
min2791.000-2695.000=96.000
max2791.000-2695.000=96.000
mean0.405-0.404=0.001
σ0.010-0.011=-0.001
min0.397-0.395=0.002
max0.418-0.418=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.266-2168.279=-0.012
σ0.015-0.015=0.000
min2168.253-2168.258=-0.005
max2168.290-2168.297=-0.007
mean2791.000-2695.000=96.000
σ0.000
min2791.000-2695.000=96.000
max2791.000-2695.000=96.000
mean2.868-2.997=-0.129
σ0.111-0.144=-0.033
min2.785-2.757=0.029
max3.015-3.114=-0.098
iters=5
new-facts=6402
prior-facts=1
mean5048.095-5048.106=-0.011
σ0.917-0.943=-0.026
min5047.552-5047.601=-0.049
max5049.715-5049.790=-0.074
mean2791.000-2695.000=96.000
σ0.000
min2791.000-2695.000=96.000
max2791.000-2695.000=96.000
mean8.905-8.940=-0.035
σ0.513-0.261=0.252
min8.061-8.589=-0.529
max9.451-9.319=0.132
iters=5
new-facts=6402
prior-facts=6402
mean5179.238-5179.239=-0.001
σ0.088-0.091=-0.004
min5179.160-5179.143=0.017
max5179.346-5179.344=0.002
mean3305.600-3232.600=73.000
σ468.722-392.878=75.844
min2791.000-2701.000=90.000
max3958.000-3741.000=217.000
mean10.037-9.632=0.404
σ0.334-0.775=-0.441
min9.642-8.589=1.053
max10.543-10.604=-0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.090-1.076=0.015
σ0.111-0.172=-0.061
min0.952-0.948=0.003
max1.262-1.286=-0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.568-463.574=-0.005
σ572.655-572.665=-0.010
min177.238-177.240=-0.002
max1322.551-1322.571=-0.020
mean79.750
σ7.500
min76.000
max91.000
mean2791.000-2695.000=96.000
σ0.000
min2791.000-2695.000=96.000
max2791.000-2695.000=96.000
mean0.441-0.545=-0.104
σ0.306-0.539=-0.233
min0.285-0.274=0.011
max0.900-1.353=-0.453
policies=20
mean1772.638-1772.641=-0.003
σ0.286-0.325=-0.039
min1772.428-1772.421=0.007
max1773.056-1773.124=-0.069
mean760.000
σ0.000
min760.000
max760.000
mean2791.000-2695.000=96.000
σ0.000
min2791.000-2695.000=96.000
max2791.000-2695.000=96.000
mean2.827-2.751=0.076
σ0.081-0.023=0.058
min2.759-2.729=0.031
max2.937-2.782=0.154
policies=200
mean17732.934-17732.898=0.036
σ0.539-0.598=-0.060
min17732.467-17732.502=-0.036
max17733.711-17733.776=-0.065
mean7600.000
σ0.000
min7600.000
max7600.000
mean2791.000-2695.000=96.000
σ0.000
min2791.000-2695.000=96.000
max2791.000-2695.000=96.000
mean27.774-27.681=0.093
σ0.083-0.102=-0.019
min27.667-27.610=0.057
max27.855-27.831=0.024