Compare commits

Home / Compare a32e03cf .. 7108f6d9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.973=-0.175
σ0.108-0.106=0.002
min35.745-35.922=-0.176
max36.104-36.273=-0.169
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.072-0.077=-0.005
σ0.004-0.004=0.000
min0.068-0.074=-0.006
max0.079-0.084=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.064-26.208=-0.144
σ0.004-0.003=0.001
min26.058-26.202=-0.144
max26.069-26.213=-0.143
mean412.000-411.900=0.100
σ0.000-0.316=-0.316
min412.000-411.000=1.000
max412.000
mean0.059-0.061=-0.002
σ0.001-0.003=-0.002
min0.057-0.058=-0.001
max0.060-0.070=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1758.366=-2.444
σ0.368-0.371=-0.003
min1755.350-1757.790=-2.440
max1756.516-1758.967=-2.451
mean1670.600-1644.350=26.250
σ639.543-632.300=7.244
min669.000-675.000=-6.000
max2700.000-2844.000=-144.000
mean2.872-2.340=0.532
σ0.109-0.077=0.031
min2.574-2.211=0.363
max3.020-2.486=0.534

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-279.512=-2.316
σ0.005-0.009=-0.004
min277.190-279.501=-2.311
max277.203-279.520=-2.317
mean2700.000-2844.000=-144.000
σ0.000
min2700.000-2844.000=-144.000
max2700.000-2844.000=-144.000
mean0.399-0.409=-0.010
σ0.009-0.007=0.002
min0.394-0.404=-0.010
max0.415-0.420=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2174.435-2178.444=-4.009
σ0.018-0.015=0.003
min2174.414-2178.422=-4.008
max2174.464-2178.459=-3.995
mean2700.000-2844.000=-144.000
σ0.000
min2700.000-2844.000=-144.000
max2700.000-2844.000=-144.000
mean2.886-3.288=-0.401
σ0.104-0.189=-0.084
min2.786-3.035=-0.249
max3.047-3.491=-0.444
iters=5
new-facts=6402
prior-facts=1
mean5052.609-5056.277=-3.668
σ1.003-1.118=-0.115
min5052.046-5055.162=-3.116
max5054.391-5058.145=-3.754
mean2700.000-2844.000=-144.000
σ0.000
min2700.000-2844.000=-144.000
max2700.000-2844.000=-144.000
mean9.090-9.310=-0.221
σ0.697-0.749=-0.052
min8.034-8.283=-0.249
max9.782-10.308=-0.525
iters=5
new-facts=6402
prior-facts=6402
mean5188.397-5193.760=-5.363
σ0.125-0.089=0.036
min5188.229-5193.683=-5.454
max5188.528-5193.857=-5.329
mean3220.000-3251.600=-31.600
σ459.772-305.788=153.984
min2700.000-2844.000=-144.000
max3847.000-3673.000=174.000
mean8.791-8.965=-0.174
σ0.160-0.415=-0.255
min8.645-8.624=0.021
max9.056-9.665=-0.608

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-0.933=0.251
σ0.133-0.011=0.122
min1.012-0.926=0.086
max1.334-0.953=0.381

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.854-465.485=-0.632
σ572.657-572.654=0.002
min178.521-179.155=-0.634
max1323.839-1324.467=-0.628
mean79.500
σ7.000
min76.000
max90.000
mean2700.000-2844.000=-144.000
σ0.000
min2700.000-2844.000=-144.000
max2700.000-2844.000=-144.000
mean0.563-0.439=0.125
σ0.563-0.303=0.261
min0.280-0.286=-0.006
max1.408-0.892=0.515
policies=20
mean1785.490-1791.857=-6.367
σ0.343-0.356=-0.013
min1785.265-1791.611=-6.347
max1785.998-1792.379=-6.380
mean760.000
σ0.000
min760.000
max760.000
mean2700.000-2844.000=-144.000
σ0.000
min2700.000-2844.000=-144.000
max2700.000-2844.000=-144.000
mean2.811-2.876=-0.065
σ0.011-0.017=-0.007
min2.798-2.861=-0.063
max2.823-2.901=-0.077
policies=200
mean17861.397-17923.911=-62.514
σ0.567-0.697=-0.131
min17861.028-17923.290=-62.262
max17862.228-17924.806=-62.578
mean7600.000
σ0.000
min7600.000
max7600.000
mean2700.000-2844.000=-144.000
σ0.000
min2700.000-2844.000=-144.000
max2700.000-2844.000=-144.000
mean28.257-28.400=-0.143
σ0.143-0.438=-0.295
min28.118-27.981=0.137
max28.384-28.975=-0.590