Compare commits

Home / Compare bd1502de .. 799d5ee3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.973=0.001
σ0.106-0.107=-0.001
min35.930-35.925=0.004
max36.275-36.276=-0.002
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.077-0.078=-0.001
σ0.004-0.004=-0.000
min0.074-0.075=-0.000
max0.085-0.086=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.004-0.003=0.000
min26.202-26.204=-0.002
max26.214-26.213=0.001
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.061-0.061=0.000
σ0.003-0.003=0.000
min0.059-0.059=-0.000
max0.068-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.377-1758.377=0.000
σ0.371-0.371=-0.000
min1757.799-1757.801=-0.002
max1758.973-1758.968=0.005
mean1658.600-1653.250=5.350
σ620.160-620.541=-0.381
min688.000-684.000=4.000
max2741.000-2743.000=-2.000
mean2.392-2.393=-0.001
σ0.143-0.113=0.030
min2.262-2.272=-0.010
max2.864-2.644=0.220

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.542-279.542=0.000
σ0.010-0.005=0.005
min279.529-279.535=-0.005
max279.555-279.547=0.008
mean2741.000-2743.000=-2.000
σ0.000
min2741.000-2743.000=-2.000
max2741.000-2743.000=-2.000
mean0.412-0.410=0.002
σ0.006-0.005=0.001
min0.405-0.405=0.000
max0.420-0.417=0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.452-2178.471=-0.019
σ0.035-0.003=0.032
min2178.404-2178.466=-0.062
max2178.492-2178.474=0.018
mean2741.000-2743.000=-2.000
σ0.000
min2741.000-2743.000=-2.000
max2741.000-2743.000=-2.000
mean3.311-3.414=-0.103
σ0.174-0.156=0.018
min3.091-3.284=-0.193
max3.561-3.678=-0.118
iters=5
new-facts=6402
prior-facts=1
mean5056.368-5056.260=0.108
σ0.916-0.753=0.164
min5055.834-5055.790=0.044
max5057.994-5057.594=0.400
mean2741.000-2743.000=-2.000
σ0.000
min2741.000-2743.000=-2.000
max2741.000-2743.000=-2.000
mean8.701-9.054=-0.353
σ0.407-0.515=-0.108
min8.071-8.305=-0.234
max9.138-9.725=-0.587
iters=5
new-facts=6402
prior-facts=6402
mean5193.710-5193.708=0.002
σ0.210-0.201=0.009
min5193.366-5193.381=-0.016
max5193.884-5193.897=-0.013
mean3226.000-3228.200=-2.200
σ353.971-376.190=-22.219
min2841.000-2743.000=98.000
max3760.000-3584.000=176.000
mean8.723-8.888=-0.165
σ0.069-0.105=-0.036
min8.630-8.705=-0.075
max8.814-8.964=-0.150

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.145=-0.146
σ0.137-0.209=-0.072
min0.934-0.944=-0.010
max1.244-1.437=-0.193

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.533-465.551=-0.018
σ572.656-572.688=-0.032
min179.199-179.201=-0.001
max1324.516-1324.582=-0.066
mean79.500
σ7.000
min76.000
max90.000
mean2741.000-2743.000=-2.000
σ0.000
min2741.000-2743.000=-2.000
max2741.000-2743.000=-2.000
mean0.470-0.474=-0.004
σ0.378-0.384=-0.006
min0.279-0.280=-0.001
max1.037-1.049=-0.013
policies=20
mean1792.304-1792.287=0.017
σ0.326-0.346=-0.020
min1792.112-1792.049=0.063
max1792.791-1792.800=-0.008
mean760.000
σ0.000
min760.000
max760.000
mean2741.000-2743.000=-2.000
σ0.000
min2741.000-2743.000=-2.000
max2741.000-2743.000=-2.000
mean2.796-2.799=-0.003
σ0.016-0.005=0.011
min2.779-2.793=-0.014
max2.815-2.805=0.010
policies=200
mean17929.430-17929.549=-0.118
σ0.583-0.508=0.075
min17929.114-17929.241=-0.128
max17930.304-17930.309=-0.005
mean7600.000
σ0.000
min7600.000
max7600.000
mean2741.000-2743.000=-2.000
σ0.000
min2741.000-2743.000=-2.000
max2741.000-2743.000=-2.000
mean28.139-28.296=-0.157
σ0.124-0.115=0.009
min28.005-28.162=-0.157
max28.247-28.401=-0.154