Compare commits

Home / Compare 4fe4f7de .. e65fc4c7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.967-35.974=-0.007
σ0.106-0.107=-0.001
min35.916-35.925=-0.008
max36.267-36.276=-0.009
mean413.400-416.800=-3.400
σ0.843-0.422=0.422
min413.000-416.000=-3.000
max415.000-417.000=-2.000
mean0.076-0.077=-0.001
σ0.003-0.004=-0.000
min0.074-0.073=0.000
max0.084-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean26.204-26.209=-0.005
σ0.003-0.004=-0.001
min26.198-26.203=-0.005
max26.209-26.215=-0.007
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.059-0.061=-0.002
σ0.003-0.003=0.000
min0.056-0.060=-0.004
max0.064-0.068=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.374-1758.377=-0.004
σ0.373-0.371=0.001
min1757.794-1757.800=-0.007
max1758.971-1758.976=-0.005
mean1641.750-1661.600=-19.850
σ627.890-626.626=1.264
min675.000-691.000=-16.000
max2700.000-2800.000=-100.000
mean2.374-2.358=0.017
σ0.063-0.113=-0.050
min2.301-2.228=0.072
max2.488-2.584=-0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.534-279.542=-0.008
σ0.009-0.006=0.002
min279.524-279.532=-0.008
max279.544-279.550=-0.006
mean2700.000-2800.000=-100.000
σ0.000
min2700.000-2800.000=-100.000
max2700.000-2800.000=-100.000
mean0.414-0.410=0.004
σ0.009-0.005=0.003
min0.406-0.405=0.001
max0.427-0.416=0.011
iters=5
new-facts=1
prior-facts=6402
mean2178.457-2178.461=-0.003
σ0.007-0.010=-0.003
min2178.449-2178.450=-0.001
max2178.468-2178.477=-0.009
mean2700.000-2800.000=-100.000
σ0.000
min2700.000-2800.000=-100.000
max2700.000-2800.000=-100.000
mean3.277-3.382=-0.105
σ0.258-0.181=0.077
min2.933-3.128=-0.195
max3.566-3.600=-0.034
iters=5
new-facts=6402
prior-facts=1
mean5056.326-5056.379=-0.053
σ1.174-0.940=0.234
min5055.241-5055.902=-0.661
max5058.333-5058.059=0.274
mean2700.000-2800.000=-100.000
σ0.000
min2700.000-2800.000=-100.000
max2700.000-2800.000=-100.000
mean8.645-8.644=0.002
σ0.612-0.413=0.199
min8.123-8.057=0.066
max9.506-9.023=0.484
iters=5
new-facts=6402
prior-facts=6402
mean5193.597-5193.785=-0.187
σ0.267-0.092=0.174
min5193.176-5193.712=-0.536
max5193.857-5193.886=-0.029
mean3236.400-3287.200=-50.800
σ368.579-370.725=-2.146
min2716.000-2800.000=-84.000
max3682.000-3645.000=37.000
mean9.035-8.804=0.231
σ0.402-0.144=0.258
min8.735-8.607=0.128
max9.712-8.976=0.736

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.028=0.003
σ0.132-0.136=-0.004
min0.943-0.937=0.006
max1.247-1.244=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.518-465.537=-0.019
σ572.658-572.655=0.003
min179.185-179.202=-0.017
max1324.504-1324.519=-0.015
mean79.500
σ7.000
min76.000
max90.000
mean2700.000-2800.000=-100.000
σ0.000
min2700.000-2800.000=-100.000
max2700.000-2800.000=-100.000
mean0.566-0.441=0.125
σ0.558-0.303=0.256
min0.284-0.287=-0.003
max1.404-0.895=0.509
policies=20
mean1792.108-1792.287=-0.179
σ0.346-0.320=0.026
min1791.871-1792.045=-0.174
max1792.621-1792.756=-0.136
mean760.000
σ0.000
min760.000
max760.000
mean2700.000-2800.000=-100.000
σ0.000
min2700.000-2800.000=-100.000
max2700.000-2800.000=-100.000
mean2.802-2.854=-0.052
σ0.014-0.091=-0.078
min2.794-2.782=0.012
max2.823-2.988=-0.165
policies=200
mean17927.774-17929.317=-1.543
σ0.531-0.511=0.020
min17927.487-17929.023=-1.536
max17928.569-17930.082=-1.513
mean7600.000
σ0.000
min7600.000
max7600.000
mean2700.000-2800.000=-100.000
σ0.000
min2700.000-2800.000=-100.000
max2700.000-2800.000=-100.000
mean28.225-28.172=0.053
σ0.204-0.095=0.109
min27.980-28.057=-0.077
max28.424-28.260=0.163