Compare commits

Home / Compare 4f1e19fd .. f374e884

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.732=-0.000
σ0.046-0.046=-0.001
min70.703-70.703=-0.001
max70.858-70.861=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.160=-0.000
σ0.004-0.003=0.001
min0.156-0.156=-0.000
max0.167-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.003-0.002=0.000
min21.443-21.441=0.001
max21.451-21.448=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.066=-0.000
σ0.002-0.002=0.000
min0.063-0.063=0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.907-1757.909=-0.003
σ0.358-0.360=-0.003
min1757.335-1757.345=-0.010
max1758.463-1758.490=-0.027
mean1670.850-1652.700=18.150
σ654.247-634.323=19.924
min644.000-671.000=-27.000
max2869.000-2782.000=87.000
mean2.827-2.817=0.010
σ0.141-0.182=-0.041
min2.467-2.273=0.194
max3.133-3.181=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.390-275.389=0.000
σ0.005-0.004=0.000
min275.383-275.386=-0.003
max275.394-275.395=-0.001
mean2869.000-2782.000=87.000
σ0.000
min2869.000-2782.000=87.000
max2869.000-2782.000=87.000
mean0.387-0.388=-0.001
σ0.005-0.001=0.004
min0.383-0.387=-0.005
max0.395-0.389=0.006
iters=5
new-facts=1
prior-facts=6402
mean1935.768-1935.777=-0.009
σ0.015-0.007=0.009
min1935.752-1935.771=-0.020
max1935.786-1935.786=0.000
mean2869.000-2782.000=87.000
σ0.000
min2869.000-2782.000=87.000
max2869.000-2782.000=87.000
mean3.018-3.069=-0.051
σ0.057-0.071=-0.014
min2.952-3.032=-0.080
max3.108-3.195=-0.087
iters=5
new-facts=6402
prior-facts=1
mean4756.513-4756.590=-0.078
σ0.878-0.840=0.038
min4755.998-4756.162=-0.164
max4758.077-4758.091=-0.013
mean2869.000-2782.000=87.000
σ0.000
min2869.000-2782.000=87.000
max2869.000-2782.000=87.000
mean8.749-8.234=0.515
σ0.252-0.327=-0.075
min8.499-7.725=0.774
max9.163-8.565=0.598
iters=5
new-facts=6402
prior-facts=6402
mean4946.941-4946.932=0.009
σ0.148-0.161=-0.014
min4946.678-4946.644=0.034
max4947.033-4947.025=0.008
mean3034.600-3049.600=-15.000
σ191.512-327.855=-136.343
min2869.000-2782.000=87.000
max3337.000-3544.000=-207.000
mean8.567-8.460=0.107
σ0.097-0.125=-0.028
min8.435-8.321=0.114
max8.697-8.639=0.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-0.996=0.021
σ0.123-0.141=-0.018
min0.935-0.929=0.006
max1.211-1.247=-0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean478.086-478.096=-0.009
σ574.925-574.951=-0.026
min190.609-190.612=-0.003
max1340.473-1340.522=-0.048
mean90.250
σ8.500
min86.000
max103.000
mean2869.000-2782.000=87.000
σ0.000
min2869.000-2782.000=87.000
max2869.000-2782.000=87.000
mean0.436-0.577=-0.142
σ0.258-0.555=-0.297
min0.285-0.299=-0.014
max0.822-1.410=-0.588
policies=20
mean1906.467-1906.431=0.035
σ0.383-0.372=0.011
min1906.168-1906.175=-0.007
max1907.009-1906.972=0.037
mean860.000
σ0.000
min860.000
max860.000
mean2869.000-2782.000=87.000
σ0.000
min2869.000-2782.000=87.000
max2869.000-2782.000=87.000
mean3.056-2.954=0.102
σ0.014-0.008=0.006
min3.036-2.942=0.094
max3.068-2.962=0.106
policies=200
mean19071.103-19070.999=0.104
σ0.468-0.318=0.150
min19070.700-19070.759=-0.059
max19071.779-19071.465=0.313
mean8600.000
σ0.000
min8600.000
max8600.000
mean2869.000-2782.000=87.000
σ0.000
min2869.000-2782.000=87.000
max2869.000-2782.000=87.000
mean30.108-29.941=0.167
σ0.500-0.277=0.224
min29.809-29.742=0.067
max30.851-30.343=0.508