Compare commits

Home / Compare 945c56e2 .. b4cf4124

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=-0.000
σ0.051-0.051=-0.000
min30.999-31.000=-0.001
max31.180-31.180=-0.000
mean412.000
σ0.000
min412.000
max412.000
mean0.077-0.078=-0.000
σ0.005-0.003=0.002
min0.070-0.072=-0.002
max0.083-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.002-0.002=0.001
min21.139-21.140=-0.001
max21.146-21.146=0.000
mean412.000
σ0.000
min412.000
max412.000
mean0.063-0.066=-0.003
σ0.004-0.003=0.001
min0.058-0.064=-0.006
max0.072-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.409=0.003
σ0.360-0.364=-0.003
min1750.846-1750.844=0.002
max1751.989-1751.990=-0.001
mean1629.150-1636.150=-7.000
σ599.524-618.524=-19.000
min648.000-632.000=16.000
max2410.000-2473.000=-63.000
mean2.846-2.826=0.020
σ0.148-0.151=-0.003
min2.594-2.550=0.044
max3.199-3.159=0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.405-273.402=0.003
σ0.010-0.005=0.005
min273.392-273.398=-0.007
max273.416-273.407=0.009
mean2410.000-2473.000=-63.000
σ0.000
min2410.000-2473.000=-63.000
max2410.000-2473.000=-63.000
mean0.388-0.389=-0.000
σ0.009-0.010=-0.001
min0.378-0.376=0.002
max0.395-0.399=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.839-1933.842=-0.003
σ0.016-0.009=0.007
min1933.820-1933.831=-0.011
max1933.859-1933.851=0.007
mean2410.000-2473.000=-63.000
σ0.000
min2410.000-2473.000=-63.000
max2410.000-2473.000=-63.000
mean3.131-3.075=0.056
σ0.313-0.152=0.161
min2.924-2.915=0.008
max3.681-3.302=0.379
iters=5
new-facts=6402
prior-facts=1
mean4754.286-4754.222=0.064
σ0.607-0.624=-0.017
min4753.889-4753.806=0.083
max4755.355-4755.326=0.029
mean2410.000-2473.000=-63.000
σ0.000
min2410.000-2473.000=-63.000
max2410.000-2473.000=-63.000
mean8.136-8.713=-0.577
σ0.565-0.260=0.306
min7.760-8.363=-0.603
max9.131-9.042=0.089
iters=5
new-facts=6402
prior-facts=6402
mean4944.789-4944.798=-0.009
σ0.078-0.079=-0.001
min4944.729-4944.735=-0.006
max4944.878-4944.898=-0.020
mean2938.200-2960.800=-22.600
σ411.722-340.473=71.248
min2468.000-2523.000=-55.000
max3501.000-3287.000=214.000
mean8.416-8.644=-0.228
σ0.102-0.204=-0.101
min8.302-8.460=-0.159
max8.559-8.992=-0.433

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.846-1.762=0.084
σ0.044-0.093=-0.050
min1.792-1.614=0.177
max1.905-1.862=0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.334-463.334=-0.000
σ572.199-572.192=0.007
min177.231-177.234=-0.003
max1321.633-1321.622=0.011
mean79.750
σ7.500
min76.000
max91.000
mean2410.000-2473.000=-63.000
σ0.000
min2410.000-2473.000=-63.000
max2410.000-2473.000=-63.000
mean0.569-0.554=0.015
σ0.578-0.550=0.028
min0.275-0.275=-0.000
max1.436-1.379=0.057
policies=20
mean1772.591-1772.584=0.007
σ0.332-0.320=0.011
min1772.372-1772.369=0.003
max1773.083-1773.058=0.024
mean760.000
σ0.000
min760.000
max760.000
mean2410.000-2473.000=-63.000
σ0.000
min2410.000-2473.000=-63.000
max2410.000-2473.000=-63.000
mean2.743-2.739=0.004
σ0.012-0.013=-0.001
min2.735-2.722=0.013
max2.762-2.750=0.011
policies=200
mean17732.401-17732.518=-0.118
σ0.594-0.492=0.102
min17732.030-17732.268=-0.238
max17733.287-17733.257=0.030
mean7600.000
σ0.000
min7600.000
max7600.000
mean2410.000-2473.000=-63.000
σ0.000
min2410.000-2473.000=-63.000
max2410.000-2473.000=-63.000
mean27.782-27.653=0.129
σ0.193-0.132=0.061
min27.645-27.523=0.121
max28.056-27.793=0.263