Compare commits

Home / Compare 6c8e6676 .. 63b4234a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.968-35.967=0.001
σ0.103-0.102=0.001
min35.926-35.926=-0.000
max36.262-36.258=0.004
mean412.000
σ0.000
min412.000
max412.000
mean0.077-0.075=0.002
σ0.003-0.004=-0.001
min0.074-0.069=0.005
max0.083-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.209-26.208=0.001
σ0.004-0.003=0.001
min26.201-26.204=-0.003
max26.214-26.212=0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.061-0.059=0.002
σ0.003-0.004=-0.001
min0.059-0.056=0.004
max0.068-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.759-1757.759=-0.000
σ0.368-0.369=-0.001
min1757.182-1757.182=0.000
max1758.351-1758.354=-0.004
mean1652.600-1653.250=-0.650
σ635.937-629.113=6.824
min629.000-621.000=8.000
max2817.000-2752.000=65.000
mean2.386-2.408=-0.022
σ0.112-0.168=-0.056
min2.273-2.285=-0.012
max2.693-2.921=-0.228

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.941-278.940=0.001
σ0.010-0.010=0.000
min278.931-278.929=0.002
max278.953-278.953=-0.000
mean2817.000-2752.000=65.000
σ0.000
min2817.000-2752.000=65.000
max2817.000-2752.000=65.000
mean0.408-0.411=-0.003
σ0.005-0.004=0.001
min0.403-0.406=-0.004
max0.413-0.414=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2177.854-2177.844=0.010
σ0.030-0.047=-0.018
min2177.822-2177.768=0.054
max2177.896-2177.885=0.011
mean2817.000-2752.000=65.000
σ0.000
min2817.000-2752.000=65.000
max2817.000-2752.000=65.000
mean3.390-3.265=0.125
σ0.209-0.267=-0.057
min3.156-3.001=0.154
max3.640-3.683=-0.044
iters=5
new-facts=6402
prior-facts=1
mean5055.791-5055.452=0.339
σ0.942-1.207=-0.266
min5055.235-5054.428=0.807
max5057.466-5057.506=-0.040
mean2817.000-2752.000=65.000
σ0.000
min2817.000-2752.000=65.000
max2817.000-2752.000=65.000
mean8.531-8.676=-0.145
σ0.503-0.577=-0.073
min8.092-8.124=-0.032
max9.193-9.338=-0.145
iters=5
new-facts=6402
prior-facts=6402
mean5193.167-5193.116=0.051
σ0.099-0.120=-0.021
min5193.048-5192.939=0.110
max5193.279-5193.275=0.003
mean3230.200-3240.200=-10.000
σ424.920-449.864=-24.944
min2817.000-2752.000=65.000
max3844.000-3860.000=-16.000
mean8.865-8.748=0.117
σ0.257-0.195=0.062
min8.629-8.549=0.080
max9.220-9.065=0.155

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-1.019=-0.038
σ0.053-0.142=-0.089
min0.950-0.953=-0.003
max1.074-1.274=-0.200

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.298-464.314=-0.016
σ572.655-572.662=-0.007
min177.962-177.975=-0.013
max1323.281-1323.307=-0.026
mean81.500
σ7.000
min78.000
max92.000
mean2817.000-2752.000=65.000
σ0.000
min2817.000-2752.000=65.000
max2817.000-2752.000=65.000
mean0.437-0.430=0.007
σ0.298-0.280=0.017
min0.286-0.283=0.003
max0.884-0.850=0.034
policies=20
mean1779.938-1779.965=-0.028
σ0.391-0.328=0.063
min1779.686-1779.722=-0.036
max1780.516-1780.447=0.069
mean780.000
σ0.000
min780.000
max780.000
mean2817.000-2752.000=65.000
σ0.000
min2817.000-2752.000=65.000
max2817.000-2752.000=65.000
mean2.898-2.826=0.072
σ0.086-0.102=-0.015
min2.845-2.757=0.088
max3.027-2.974=0.053
policies=200
mean17805.902-17805.930=-0.028
σ0.527-0.544=-0.018
min17805.547-17805.601=-0.055
max17806.685-17806.743=-0.059
mean7800.000
σ0.000
min7800.000
max7800.000
mean2817.000-2752.000=65.000
σ0.000
min2817.000-2752.000=65.000
max2817.000-2752.000=65.000
mean28.045-28.010=0.035
σ0.054-0.108=-0.054
min27.981-27.887=0.094
max28.109-28.122=-0.012