Compare commits

Home / Compare f625ad97 .. 4f1e19fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.731=0.001
σ0.046-0.052=-0.006
min70.703-70.699=0.004
max70.861-70.877=-0.016
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.160-0.157=0.002
σ0.003-0.004=-0.001
min0.156-0.149=0.007
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=0.000
σ0.002-0.002=-0.000
min21.441-21.442=-0.001
max21.448-21.448=-0.000
mean414.000-416.700=-2.700
σ0.000-0.483=-0.483
min414.000-416.000=-2.000
max414.000-417.000=-3.000
mean0.066-0.065=0.000
σ0.002-0.003=-0.001
min0.063-0.063=0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.909-1755.602=2.307
σ0.360-0.361=-0.000
min1757.345-1755.029=2.316
max1758.490-1756.193=2.297
mean1652.700-1651.100=1.600
σ634.323-608.338=25.985
min671.000-632.000=39.000
max2782.000-2472.000=310.000
mean2.817-2.783=0.034
σ0.182-0.140=0.041
min2.273-2.414=-0.141
max3.181-2.914=0.267

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.389-274.688=0.702
σ0.004-0.008=-0.004
min275.386-274.680=0.706
max275.395-274.701=0.694
mean2782.000-2472.000=310.000
σ0.000
min2782.000-2472.000=310.000
max2782.000-2472.000=310.000
mean0.388-0.387=0.001
σ0.001-0.004=-0.003
min0.387-0.384=0.003
max0.389-0.394=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1935.777-1935.081=0.696
σ0.007-0.008=-0.002
min1935.771-1935.069=0.702
max1935.786-1935.091=0.695
mean2782.000-2472.000=310.000
σ0.000
min2782.000-2472.000=310.000
max2782.000-2472.000=310.000
mean3.069-3.005=0.064
σ0.071-0.335=-0.264
min3.032-2.599=0.433
max3.195-3.481=-0.285
iters=5
new-facts=6402
prior-facts=1
mean4756.590-4755.889=0.701
σ0.840-0.882=-0.042
min4756.162-4755.372=0.790
max4758.091-4757.462=0.629
mean2782.000-2472.000=310.000
σ0.000
min2782.000-2472.000=310.000
max2782.000-2472.000=310.000
mean8.234-8.374=-0.140
σ0.327-0.409=-0.083
min7.725-7.990=-0.264
max8.565-8.970=-0.405
iters=5
new-facts=6402
prior-facts=6402
mean4946.932-4946.158=0.774
σ0.161-0.205=-0.044
min4946.644-4945.922=0.722
max4947.025-4946.319=0.706
mean3049.600-2929.800=119.800
σ327.855-397.341=-69.486
min2782.000-2473.000=309.000
max3544.000-3447.000=97.000
mean8.460-8.451=0.008
σ0.125-0.098=0.027
min8.321-8.356=-0.035
max8.639-8.615=0.024

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.996-1.725=-0.729
σ0.141-0.105=0.036
min0.929-1.589=-0.660
max1.247-1.824=-0.576

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean478.096-474.989=3.106
σ574.951-574.927=0.024
min190.612-187.519=3.093
max1340.522-1337.380=3.142
mean90.250
σ8.500
min86.000
max103.000
mean2782.000-2472.000=310.000
σ0.000
min2782.000-2472.000=310.000
max2782.000-2472.000=310.000
mean0.577-0.559=0.019
σ0.555-0.527=0.029
min0.299-0.291=0.008
max1.410-1.349=0.062
policies=20
mean1906.431-1875.540=30.892
σ0.372-0.386=-0.014
min1906.175-1875.255=30.920
max1906.972-1876.101=30.870
mean860.000
σ0.000
min860.000
max860.000
mean2782.000-2472.000=310.000
σ0.000
min2782.000-2472.000=310.000
max2782.000-2472.000=310.000
mean2.954-2.961=-0.007
σ0.008-0.054=-0.046
min2.942-2.906=0.036
max2.962-3.023=-0.061
policies=200
mean19070.999-18762.182=308.817
σ0.318-0.445=-0.127
min19070.759-18761.918=308.841
max19071.465-18762.847=308.618
mean8600.000
σ0.000
min8600.000
max8600.000
mean2782.000-2472.000=310.000
σ0.000
min2782.000-2472.000=310.000
max2782.000-2472.000=310.000
mean29.941-29.292=0.648
σ0.277-0.088=0.188
min29.742-29.208=0.534
max30.343-29.371=0.972