Compare commits

Home / Compare 3a38a4ae .. 0ad962c9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-35.798=-5.025
σ0.046-0.106=-0.060
min30.750-35.749=-5.000
max30.903-36.100=-5.197
mean411.900-416.200=-4.300
σ0.316-0.422=-0.105
min411.000-416.000=-5.000
max412.000-417.000=-5.000
mean0.076-0.076=0.000
σ0.005-0.003=0.002
min0.069-0.073=-0.003
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean21.059-26.065=-5.006
σ0.003-0.003=0.000
min21.054-26.059=-5.005
max21.064-26.068=-5.003
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.063-0.060=0.003
σ0.002-0.003=-0.001
min0.062-0.058=0.004
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1755.923=-4.689
σ0.362-0.367=-0.005
min1750.668-1755.349=-4.681
max1751.822-1756.513=-4.691
mean1659.300-1666.150=-6.850
σ638.400-631.274=7.126
min689.000-669.000=20.000
max2775.000-2616.000=159.000
mean2.790-2.790=-0.001
σ0.162-0.148=0.014
min2.365-2.479=-0.114
max2.994-2.992=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.570-277.194=-1.624
σ0.004-0.005=-0.001
min275.566-277.189=-1.623
max275.575-277.199=-1.624
mean2775.000-2616.000=159.000
σ0.000
min2775.000-2616.000=159.000
max2775.000-2616.000=159.000
mean0.392-0.397=-0.005
σ0.008-0.005=0.003
min0.382-0.393=-0.012
max0.399-0.405=-0.007
iters=5
new-facts=1
prior-facts=6402
mean2168.089-2174.441=-6.352
σ0.020-0.017=0.003
min2168.070-2174.426=-6.356
max2168.114-2174.467=-6.353
mean2775.000-2616.000=159.000
σ0.000
min2775.000-2616.000=159.000
max2775.000-2616.000=159.000
mean2.980-2.966=0.014
σ0.139-0.134=0.005
min2.752-2.796=-0.045
max3.093-3.101=-0.008
iters=5
new-facts=6402
prior-facts=1
mean5047.892-5052.385=-4.493
σ0.882-1.131=-0.249
min5047.340-5051.567=-4.227
max5049.449-5054.330=-4.881
mean2775.000-2616.000=159.000
σ0.000
min2775.000-2616.000=159.000
max2775.000-2616.000=159.000
mean8.843-8.839=0.004
σ0.479-0.707=-0.228
min8.083-8.051=0.032
max9.295-9.530=-0.235
iters=5
new-facts=6402
prior-facts=6402
mean5179.055-5188.355=-9.300
σ0.089-0.115=-0.026
min5178.968-5188.181=-9.213
max5179.150-5188.503=-9.353
mean3326.400-3237.600=88.800
σ393.420-394.756=-1.336
min2775.000-2698.000=77.000
max3684.000-3739.000=-55.000
mean10.120-9.066=1.054
σ0.331-0.257=0.074
min9.665-8.720=0.945
max10.566-9.318=1.248

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.308=-0.278
σ0.157-0.300=-0.143
min0.932-0.952=-0.020
max1.295-1.618=-0.323

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-464.857=-1.654
σ572.651-572.659=-0.008
min176.876-178.524=-1.649
max1322.179-1323.845=-1.666
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2775.000-2616.000=159.000
σ0.000
min2775.000-2616.000=159.000
max2775.000-2616.000=159.000
mean0.440-0.540=-0.100
σ0.301-0.508=-0.207
min0.287-0.281=0.006
max0.892-1.302=-0.410
policies=20
mean1768.983-1785.489=-16.506
σ0.348-0.348=-0.000
min1768.767-1785.250=-16.483
max1769.501-1786.004=-16.502
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2775.000-2616.000=159.000
σ0.000
min2775.000-2616.000=159.000
max2775.000-2616.000=159.000
mean2.790-2.799=-0.009
σ0.079-0.006=0.073
min2.727-2.791=-0.064
max2.901-2.807=0.094
policies=200
mean17696.243-17861.496=-165.253
σ0.498-0.377=0.122
min17695.970-17861.289=-165.319
max17696.990-17862.060=-165.071
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2775.000-2616.000=159.000
σ0.000
min2775.000-2616.000=159.000
max2775.000-2616.000=159.000
mean27.590-28.306=-0.716
σ0.188-0.189=-0.001
min27.402-28.098=-0.696
max27.827-28.498=-0.671