Compare commits

Home / Compare 829d4c97 .. ae7f1a3f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.793-35.798=-0.005
σ0.108-0.107=0.001
min35.745-35.749=-0.004
max36.098-36.101=-0.003
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.075-0.074=0.001
σ0.002-0.005=-0.003
min0.074-0.068=0.006
max0.081-0.083=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.002-0.002=0.001
min26.060-26.062=-0.002
max26.068-26.067=0.000
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.062-0.061=0.001
σ0.002-0.002=-0.000
min0.060-0.059=0.001
max0.068-0.068=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.890-1755.922=-3.032
σ0.363-0.367=-0.003
min1752.318-1755.352=-3.033
max1753.477-1756.516=-3.040
mean1674.700-1669.550=5.150
σ626.791-627.745=-0.954
min666.000-677.000=-11.000
max2641.000-2667.000=-26.000
mean2.845-2.804=0.040
σ0.133-0.128=0.005
min2.505-2.535=-0.030
max3.149-2.972=0.176

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.190-277.194=-0.003
σ0.005-0.005=0.000
min277.183-277.188=-0.005
max277.195-277.199=-0.004
mean2641.000-2667.000=-26.000
σ0.000
min2641.000-2667.000=-26.000
max2641.000-2667.000=-26.000
mean0.396-0.395=0.001
σ0.008-0.004=0.004
min0.388-0.392=-0.004
max0.405-0.402=0.004
iters=5
new-facts=1
prior-facts=6402
mean2169.691-2174.435=-4.744
σ0.012-0.021=-0.009
min2169.671-2174.406=-4.736
max2169.700-2174.464=-4.764
mean2641.000-2667.000=-26.000
σ0.000
min2641.000-2667.000=-26.000
max2641.000-2667.000=-26.000
mean2.866-2.825=0.041
σ0.083-0.137=-0.053
min2.774-2.746=0.029
max2.976-3.068=-0.092
iters=5
new-facts=6402
prior-facts=1
mean5049.436-5052.660=-3.225
σ0.970-1.025=-0.055
min5048.733-5051.998=-3.265
max5051.138-5054.478=-3.340
mean2641.000-2667.000=-26.000
σ0.000
min2641.000-2667.000=-26.000
max2641.000-2667.000=-26.000
mean8.659-8.823=-0.164
σ0.388-1.015=-0.626
min8.169-8.029=0.140
max9.250-10.468=-1.217
iters=5
new-facts=6402
prior-facts=6402
mean5180.568-5188.352=-7.784
σ0.241-0.211=0.030
min5180.157-5188.002=-7.845
max5180.753-5188.527=-7.774
mean3210.800-3276.200=-65.400
σ485.126-482.314=2.813
min2641.000-2667.000=-26.000
max3862.000-3858.000=4.000
mean8.911-8.937=-0.026
σ0.473-0.429=0.044
min8.625-8.652=-0.026
max9.742-9.675=0.068

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.117-1.243=-0.126
σ0.132-0.372=-0.240
min0.939-0.941=-0.002
max1.269-1.878=-0.610

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.862-464.855=0.007
σ572.671-572.657=0.014
min178.520-178.521=-0.001
max1323.869-1323.841=0.028
mean79.500
σ7.000
min76.000
max90.000
mean2641.000-2667.000=-26.000
σ0.000
min2641.000-2667.000=-26.000
max2641.000-2667.000=-26.000
mean0.574-0.546=0.029
σ0.577-0.514=0.064
min0.279-0.279=0.000
max1.440-1.316=0.124
policies=20
mean1785.471-1785.465=0.005
σ0.343-0.349=-0.006
min1785.258-1785.230=0.028
max1785.981-1785.983=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean2641.000-2667.000=-26.000
σ0.000
min2641.000-2667.000=-26.000
max2641.000-2667.000=-26.000
mean2.778-2.785=-0.007
σ0.012-0.022=-0.010
min2.765-2.763=0.002
max2.789-2.815=-0.025
policies=200
mean17861.529-17861.512=0.017
σ0.491-0.550=-0.058
min17861.244-17861.098=0.146
max17862.265-17862.322=-0.057
mean7600.000
σ0.000
min7600.000
max7600.000
mean2641.000-2667.000=-26.000
σ0.000
min2641.000-2667.000=-26.000
max2641.000-2667.000=-26.000
mean28.222-28.261=-0.039
σ0.061-0.102=-0.041
min28.130-28.127=0.003
max28.258-28.352=-0.094