Compare commits

Home / Compare cacbb12f .. 37c8410b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-70.708=-36.729
σ0.049-0.048=0.001
min33.939-70.679=-36.739
max34.113-70.841=-36.728
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.082-0.160=-0.078
σ0.004-0.003=0.001
min0.077-0.157=-0.080
max0.089-0.166=-0.077
cache=y
dps=1
iters=10
policies=100
mean23.318-21.411=1.906
σ0.002-0.003=-0.000
min23.313-21.407=1.906
max23.321-21.416=1.905
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.063-0.062=0.001
σ0.003-0.004=-0.001
min0.059-0.059=0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1754.931=2.373
σ0.364-0.361=0.003
min1756.728-1754.358=2.370
max1757.888-1755.507=2.381
mean1662.950-1650.550=12.400
σ628.218-624.665=3.553
min667.000-622.000=45.000
max2612.000-2772.000=-160.000
mean2.348-2.788=-0.439
σ0.088-0.191=-0.103
min2.267-2.177=0.090
max2.583-2.963=-0.380

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.439-272.795=53.645
σ0.059-0.006=0.053
min326.334-272.786=53.548
max326.474-272.800=53.673
mean2612.000-2772.000=-160.000
σ0.000
min2612.000-2772.000=-160.000
max2612.000-2772.000=-160.000
mean0.425-0.381=0.044
σ0.000-0.008=-0.007
min0.424-0.376=0.048
max0.425-0.395=0.031
iters=5
new-facts=1
prior-facts=6402
mean1988.610-1933.227=55.383
σ0.010-0.007=0.003
min1988.592-1933.217=55.375
max1988.618-1933.234=55.384
mean2612.000-2772.000=-160.000
σ0.000
min2612.000-2772.000=-160.000
max2612.000-2772.000=-160.000
mean2.688-3.032=-0.344
σ0.065-0.137=-0.072
min2.624-2.811=-0.187
max2.775-3.155=-0.380
iters=5
new-facts=6402
prior-facts=1
mean4813.140-4757.005=56.135
σ7.575-7.536=0.039
min4809.395-4753.526=55.869
max4826.675-4770.486=56.190
mean2612.000-2772.000=-160.000
σ0.000
min2612.000-2772.000=-160.000
max2612.000-2772.000=-160.000
mean8.883-8.274=0.609
σ0.446-0.535=-0.089
min8.406-7.633=0.773
max9.578-8.864=0.714
iters=5
new-facts=6402
prior-facts=6402
mean5001.018-4944.381=56.637
σ0.040-0.147=-0.108
min5000.977-4944.120=56.857
max5001.075-4944.470=56.605
mean2998.000-2992.000=6.000
σ280.275-214.339=65.936
min2612.000-2772.000=-160.000
max3312.000-3303.000=9.000
mean9.831-8.615=1.216
σ0.268-0.367=-0.099
min9.475-8.385=1.089
max10.176-9.262=0.914

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.245-1.025=0.220
σ0.392-0.182=0.210
min0.921-0.915=0.005
max1.783-1.335=0.448

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.441-468.331=-3.890
σ574.792-574.225=0.567
min177.039-181.209=-4.169
max1326.629-1329.668=-3.039
mean88.250
σ8.500
min84.000
max101.000
mean2612.000-2772.000=-160.000
σ0.000
min2612.000-2772.000=-160.000
max2612.000-2772.000=-160.000
mean0.559-0.441=0.119
σ0.562-0.300=0.262
min0.274-0.285=-0.011
max1.402-0.891=0.511
policies=20
mean1770.758-1812.387=-41.629
σ0.358-0.397=-0.040
min1770.533-1812.114=-41.581
max1771.290-1812.970=-41.680
mean840.000
σ0.000
min840.000
max840.000
mean2612.000-2772.000=-160.000
σ0.000
min2612.000-2772.000=-160.000
max2612.000-2772.000=-160.000
mean2.735-2.901=-0.166
σ0.017-0.007=0.009
min2.721-2.892=-0.171
max2.759-2.908=-0.149
policies=200
mean17714.858-18129.222=-414.364
σ0.467-0.504=-0.037
min17714.598-18128.848=-414.250
max17715.558-18129.960=-414.402
mean8400.000
σ0.000
min8400.000
max8400.000
mean2612.000-2772.000=-160.000
σ0.000
min2612.000-2772.000=-160.000
max2612.000-2772.000=-160.000
mean27.490-28.558=-1.068
σ0.126-0.251=-0.125
min27.375-28.219=-0.843
max27.632-28.817=-1.186