Compare commits

Home / Compare 3339f498 .. ca70a3fa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.773=-0.005
σ0.049-0.047=0.002
min30.725-30.752=-0.027
max30.904-30.907=-0.003
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.074-0.078=-0.003
σ0.005-0.003=0.002
min0.069-0.076=-0.007
max0.082-0.085=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.061-21.058=0.002
σ0.003-0.003=-0.001
min21.056-21.055=0.001
max21.064-21.065=-0.001
mean412.000-415.900=-3.900
σ0.000-0.316=-0.316
min412.000-415.000=-3.000
max412.000-416.000=-4.000
mean0.063-0.061=0.002
σ0.003-0.004=-0.001
min0.059-0.057=0.001
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.418-1751.235=0.183
σ0.361-0.362=-0.001
min1750.845-1750.664=0.181
max1752.007-1751.821=0.186
mean1657.100-1669.050=-11.950
σ631.533-639.481=-7.948
min677.000-682.000=-5.000
max2686.000-2697.000=-11.000
mean2.838-2.828=0.010
σ0.135-0.148=-0.013
min2.524-2.336=0.188
max3.036-3.033=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.760-275.567=0.193
σ0.012-0.003=0.009
min275.746-275.561=0.185
max275.776-275.570=0.206
mean2686.000-2697.000=-11.000
σ0.000
min2686.000-2697.000=-11.000
max2686.000-2697.000=-11.000
mean0.408-0.393=0.014
σ0.013-0.009=0.004
min0.397-0.386=0.010
max0.428-0.405=0.024
iters=5
new-facts=1
prior-facts=6402
mean2168.276-2168.091=0.185
σ0.014-0.016=-0.002
min2168.260-2168.071=0.189
max2168.291-2168.114=0.177
mean2686.000-2697.000=-11.000
σ0.000
min2686.000-2697.000=-11.000
max2686.000-2697.000=-11.000
mean2.924-2.956=-0.033
σ0.100-0.139=-0.039
min2.768-2.781=-0.013
max3.025-3.109=-0.083
iters=5
new-facts=6402
prior-facts=1
mean5048.115-5047.930=0.185
σ0.912-0.916=-0.004
min5047.581-5047.332=0.249
max5049.738-5049.551=0.187
mean2686.000-2697.000=-11.000
σ0.000
min2686.000-2697.000=-11.000
max2686.000-2697.000=-11.000
mean8.868-8.816=0.052
σ0.550-0.596=-0.046
min8.069-8.215=-0.146
max9.495-9.534=-0.039
iters=5
new-facts=6402
prior-facts=6402
mean5179.091-5179.054=0.037
σ0.208-0.091=0.117
min5178.800-5178.958=-0.157
max5179.313-5179.148=0.164
mean3230.800-3283.600=-52.800
σ364.775-383.894=-19.119
min2718.000-2703.000=15.000
max3680.000-3707.000=-27.000
mean9.676-10.152=-0.476
σ0.488-0.253=0.235
min8.937-9.934=-0.997
max10.233-10.562=-0.330

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.128-1.178=-0.050
σ0.195-0.287=-0.092
min0.953-0.967=-0.014
max1.408-1.508=-0.100

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.577-463.205=0.373
σ572.671-572.664=0.007
min177.237-176.871=0.367
max1322.584-1322.201=0.383
mean79.750-77.500=2.250
σ7.500-7.000=0.500
min76.000-74.000=2.000
max91.000-88.000=3.000
mean2686.000-2697.000=-11.000
σ0.000
min2686.000-2697.000=-11.000
max2686.000-2697.000=-11.000
mean0.556-0.556=-0.000
σ0.580-0.552=0.028
min0.249-0.278=-0.029
max1.425-1.384=0.041
policies=20
mean1772.646-1768.965=3.681
σ0.337-0.334=0.002
min1772.419-1768.753=3.667
max1773.146-1769.464=3.683
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2686.000-2697.000=-11.000
σ0.000
min2686.000-2697.000=-11.000
max2686.000-2697.000=-11.000
mean2.757-2.751=0.006
σ0.005-0.031=-0.026
min2.751-2.711=0.039
max2.763-2.785=-0.022
policies=200
mean17733.020-17696.238=36.782
σ0.477-0.476=0.000
min17732.708-17695.981=36.727
max17733.730-17696.952=36.778
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2686.000-2697.000=-11.000
σ0.000
min2686.000-2697.000=-11.000
max2686.000-2697.000=-11.000
mean27.794-27.740=0.054
σ0.175-0.097=0.078
min27.636-27.627=0.010
max28.020-27.826=0.194