Compare commits

Home / Compare 29c5259f .. feeab3a2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.696=-0.000
σ0.046-0.048=-0.002
min70.667-70.663=0.004
max70.825-70.830=-0.005
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.158-0.160=-0.003
σ0.004-0.004=0.001
min0.153-0.157=-0.004
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.420-21.424=-0.004
σ0.002-0.010=-0.008
min21.417-21.417=-0.000
max21.423-21.452=-0.029
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.065=-0.000
σ0.002-0.002=0.000
min0.063-0.063=-0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.459=-0.001
σ0.361-0.359=0.001
min1753.885-1753.889=-0.004
max1755.049-1755.026=0.023
mean1675.300-1640.650=34.650
σ630.802-626.088=4.713
min680.000-646.000=34.000
max2670.000-2844.000=-174.000
mean2.779-2.819=-0.039
σ0.190-0.165=0.025
min2.433-2.388=0.045
max3.132-3.146=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.500-273.507=-0.007
σ0.011-0.005=0.007
min273.484-273.501=-0.017
max273.516-273.512=0.003
mean2670.000-2844.000=-174.000
σ0.000
min2670.000-2844.000=-174.000
max2670.000-2844.000=-174.000
mean0.379-0.386=-0.008
σ0.005-0.005=0.001
min0.376-0.383=-0.007
max0.389-0.394=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.887-1933.893=-0.006
σ0.014-0.009=0.005
min1933.864-1933.882=-0.018
max1933.901-1933.902=-0.002
mean2670.000-2844.000=-174.000
σ0.000
min2670.000-2844.000=-174.000
max2670.000-2844.000=-174.000
mean3.042-3.020=0.022
σ0.080-0.051=0.029
min2.932-2.977=-0.046
max3.123-3.089=0.034
iters=5
new-facts=6402
prior-facts=1
mean4754.529-4754.625=-0.095
σ0.938-0.926=0.012
min4753.777-4754.137=-0.360
max4756.161-4756.277=-0.115
mean2670.000-2844.000=-174.000
σ0.000
min2670.000-2844.000=-174.000
max2670.000-2844.000=-174.000
mean8.646-8.861=-0.214
σ0.634-0.270=0.364
min7.642-8.560=-0.917
max9.221-9.156=0.065
iters=5
new-facts=6402
prior-facts=6402
mean4945.118-4945.046=0.071
σ0.024-0.165=-0.140
min4945.089-4944.753=0.336
max4945.143-4945.136=0.007
mean2975.200-3046.200=-71.000
σ243.973-200.060=43.912
min2670.000-2844.000=-174.000
max3310.000-3307.000=3.000
mean8.473-8.687=-0.213
σ0.055-0.295=-0.239
min8.392-8.470=-0.077
max8.528-9.186=-0.658

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.060-1.038=0.021
σ0.208-0.175=0.033
min0.930-0.930=-0.000
max1.417-1.336=0.082

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.062-473.069=-0.007
σ575.919-575.912=0.007
min185.095-185.110=-0.015
max1336.941-1336.938=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2670.000-2844.000=-174.000
σ0.000
min2670.000-2844.000=-174.000
max2670.000-2844.000=-174.000
mean0.554-0.450=0.104
σ0.533-0.303=0.230
min0.285-0.293=-0.008
max1.354-0.905=0.449
policies=20
mean1851.253-1851.422=-0.169
σ0.376-0.375=0.001
min1851.005-1851.139=-0.133
max1851.808-1851.965=-0.157
mean840.000
σ0.000
min840.000
max840.000
mean2670.000-2844.000=-174.000
σ0.000
min2670.000-2844.000=-174.000
max2670.000-2844.000=-174.000
mean2.871-2.951=-0.081
σ0.013-0.004=0.009
min2.856-2.948=-0.092
max2.887-2.957=-0.070
policies=200
mean18519.489-18519.768=-0.280
σ0.467-0.735=-0.267
min18519.238-18519.010=0.228
max18520.189-18520.573=-0.384
mean8400.000
σ0.000
min8400.000
max8400.000
mean2670.000-2844.000=-174.000
σ0.000
min2670.000-2844.000=-174.000
max2670.000-2844.000=-174.000
mean29.008-29.267=-0.259
σ0.033-0.474=-0.440
min28.963-28.984=-0.021
max29.041-29.974=-0.934