Compare commits

Home / Compare bc950741 .. 7a81e9e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.867=-0.085
σ0.049-0.045=0.004
min70.750-70.837=-0.087
max70.918-70.990=-0.072
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.160-0.161=-0.001
σ0.005-0.004=0.001
min0.154-0.157=-0.002
max0.169-0.169=0.000
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.000
σ0.003-0.002=0.001
min21.488-21.489=-0.001
max21.496-21.496=0.000
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.065=-0.000
σ0.003-0.003=0.000
min0.059-0.061=-0.002
max0.068-0.073=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.094=-0.001
σ0.360-0.362=-0.002
min1753.526-1753.533=-0.007
max1754.673-1754.689=-0.016
mean1662.650-1629.500=33.150
σ629.756-594.142=35.614
min677.000-639.000=38.000
max2688.000-2421.000=267.000
mean2.822-2.764=0.058
σ0.167-0.250=-0.083
min2.451-2.148=0.303
max3.118-3.164=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-271.604=-0.004
σ0.008-0.005=0.003
min271.588-271.598=-0.010
max271.607-271.611=-0.004
mean2688.000-2421.000=267.000
σ0.000
min2688.000-2421.000=267.000
max2688.000-2421.000=267.000
mean0.386-0.386=0.001
σ0.006-0.010=-0.004
min0.382-0.379=0.003
max0.393-0.402=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1931.979-1931.999=-0.020
σ0.017-0.009=0.008
min1931.961-1931.984=-0.023
max1932.003-1932.007=-0.005
mean2688.000-2421.000=267.000
σ0.000
min2688.000-2421.000=267.000
max2688.000-2421.000=267.000
mean2.545-2.537=0.008
σ0.153-0.123=0.030
min2.409-2.412=-0.004
max2.806-2.700=0.105
iters=5
new-facts=6402
prior-facts=1
mean4752.696-4752.664=0.031
σ0.936-0.935=0.001
min4752.176-4751.844=0.332
max4754.363-4754.277=0.086
mean2688.000-2421.000=267.000
σ0.000
min2688.000-2421.000=267.000
max2688.000-2421.000=267.000
mean8.859-8.320=0.539
σ0.415-0.339=0.076
min8.230-7.737=0.492
max9.398-8.538=0.860
iters=5
new-facts=6402
prior-facts=6402
mean4943.207-4943.068=0.140
σ0.016-0.301=-0.285
min4943.181-4942.529=0.652
max4943.223-4943.220=0.003
mean2970.400-2978.400=-8.000
σ240.822-288.900=-48.078
min2688.000-2591.000=97.000
max3305.000-3321.000=-16.000
mean8.453-8.588=-0.135
σ0.103-0.221=-0.118
min8.361-8.379=-0.018
max8.624-8.911=-0.288

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.223-1.792=-0.569
σ0.247-0.123=0.124
min0.935-1.595=-0.660
max1.562-1.898=-0.336

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.641-479.657=-11.016
σ574.948-596.973=-22.024
min181.162-181.166=-0.004
max1331.064-1375.116=-44.052
mean88.250
σ8.500
min84.000
max101.000
mean2688.000-2421.000=267.000
σ0.000
min2688.000-2421.000=267.000
max2688.000-2421.000=267.000
mean0.572-0.561=0.011
σ0.566-0.549=0.017
min0.286-0.284=0.002
max1.421-1.384=0.037
policies=20
mean1811.972-1811.957=0.014
σ0.391-0.389=0.002
min1811.698-1811.704=-0.006
max1812.547-1812.532=0.015
mean840.000
σ0.000
min840.000
max840.000
mean2688.000-2421.000=267.000
σ0.000
min2688.000-2421.000=267.000
max2688.000-2421.000=267.000
mean2.850-2.842=0.008
σ0.018-0.011=0.007
min2.829-2.829=0.000
max2.871-2.856=0.015
policies=200
mean18126.658-18126.653=0.006
σ0.488-0.512=-0.024
min18126.276-18126.283=-0.007
max18127.355-18127.397=-0.042
mean8400.000
σ0.000
min8400.000
max8400.000
mean2688.000-2421.000=267.000
σ0.000
min2688.000-2421.000=267.000
max2688.000-2421.000=267.000
mean28.699-28.566=0.133
σ0.108-0.078=0.030
min28.599-28.498=0.101
max28.809-28.658=0.151