Compare commits

Home / Compare 312982b7 .. ee216bb7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.974=-0.175
σ0.108-0.107=0.001
min35.751-35.926=-0.175
max36.104-36.277=-0.173
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.075-0.077=-0.003
σ0.004-0.004=0.000
min0.070-0.073=-0.003
max0.082-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.208=-0.143
σ0.004-0.004=-0.001
min26.059-26.202=-0.143
max26.070-26.215=-0.145
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.061-0.060=0.001
σ0.003-0.004=-0.001
min0.059-0.057=0.002
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.921-1758.362=-2.441
σ0.367-0.373=-0.006
min1755.352-1757.788=-2.436
max1756.516-1758.962=-2.445
mean1665.450-1657.200=8.250
σ625.181-630.221=-5.040
min674.000-683.000=-9.000
max2602.000-2804.000=-202.000
mean2.775-2.400=0.375
σ0.162-0.134=0.029
min2.285-2.274=0.011
max2.980-2.814=0.166

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.193-279.508=-2.315
σ0.008-0.005=0.003
min277.183-279.503=-2.319
max277.201-279.515=-2.314
mean2602.000-2804.000=-202.000
σ0.000
min2602.000-2804.000=-202.000
max2602.000-2804.000=-202.000
mean0.395-0.407=-0.012
σ0.009-0.006=0.004
min0.390-0.404=-0.014
max0.412-0.418=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2174.443-2178.446=-4.004
σ0.028-0.011=0.018
min2174.415-2178.434=-4.019
max2174.476-2178.462=-3.985
mean2602.000-2804.000=-202.000
σ0.000
min2602.000-2804.000=-202.000
max2602.000-2804.000=-202.000
mean3.002-3.388=-0.386
σ0.140-0.139=0.001
min2.772-3.208=-0.436
max3.102-3.552=-0.449
iters=5
new-facts=6402
prior-facts=1
mean5052.478-5056.280=-3.802
σ1.048-1.110=-0.062
min5051.854-5055.164=-3.310
max5054.342-5058.139=-3.797
mean2602.000-2804.000=-202.000
σ0.000
min2602.000-2804.000=-202.000
max2602.000-2804.000=-202.000
mean8.810-9.269=-0.459
σ0.574-0.651=-0.077
min8.132-8.234=-0.103
max9.427-10.000=-0.573
iters=5
new-facts=6402
prior-facts=6402
mean5188.358-5193.690=-5.332
σ0.121-0.204=-0.083
min5188.177-5193.353=-5.176
max5188.516-5193.864=-5.348
mean3221.600-3247.400=-25.800
σ381.666-319.959=61.707
min2685.000-2804.000=-119.000
max3698.000-3676.000=22.000
mean8.964-9.155=-0.192
σ0.404-0.432=-0.028
min8.725-8.726=-0.002
max9.679-9.694=-0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.321-1.090=0.232
σ0.301-0.197=0.103
min1.073-0.939=0.134
max1.800-1.423=0.377

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.851-465.476=-0.624
σ572.660-572.648=0.012
min178.518-179.140=-0.622
max1323.841-1324.448=-0.607
mean79.500
σ7.000
min76.000
max90.000
mean2602.000-2804.000=-202.000
σ0.000
min2602.000-2804.000=-202.000
max2602.000-2804.000=-202.000
mean0.558-0.443=0.115
σ0.537-0.304=0.234
min0.282-0.289=-0.006
max1.364-0.899=0.465
policies=20
mean1785.470-1791.718=-6.248
σ0.346-0.330=0.016
min1785.238-1791.485=-6.247
max1785.983-1792.194=-6.211
mean760.000
σ0.000
min760.000
max760.000
mean2602.000-2804.000=-202.000
σ0.000
min2602.000-2804.000=-202.000
max2602.000-2804.000=-202.000
mean2.797-2.858=-0.061
σ0.018-0.124=-0.106
min2.775-2.784=-0.009
max2.818-3.043=-0.225
policies=200
mean17861.417-17923.470=-62.053
σ0.452-0.485=-0.032
min17861.070-17923.202=-62.133
max17862.080-17924.196=-62.116
mean7600.000
σ0.000
min7600.000
max7600.000
mean2602.000-2804.000=-202.000
σ0.000
min2602.000-2804.000=-202.000
max2602.000-2804.000=-202.000
mean28.177-28.294=-0.117
σ0.150-0.132=0.018
min27.986-28.179=-0.193
max28.313-28.411=-0.098