Compare commits

Home / Compare ea7b9661 .. c6d95afa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.978=0.002
σ0.051-0.050=0.002
min33.944-33.940=0.004
max34.123-34.116=0.006
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.085-0.084=0.001
σ0.003-0.004=-0.000
min0.082-0.081=0.000
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=-0.001
σ0.004-0.004=0.000
min23.313-23.313=0.000
max23.324-23.326=-0.002
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.066-0.063=0.003
σ0.003-0.003=-0.000
min0.064-0.059=0.005
max0.073-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.301=0.001
σ0.363-0.363=0.001
min1756.729-1756.728=0.001
max1757.890-1757.889=0.001
mean1645.600-1663.500=-17.900
σ625.138-623.293=1.845
min633.000-671.000=-38.000
max2823.000-2599.000=224.000
mean2.377-2.396=-0.019
σ0.086-0.185=-0.099
min2.253-2.251=0.002
max2.633-2.968=-0.335

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.454-326.445=0.009
σ0.045-0.049=-0.004
min326.374-326.358=0.016
max326.481-326.475=0.006
mean2823.000-2599.000=224.000
σ0.000
min2823.000-2599.000=224.000
max2823.000-2599.000=224.000
mean0.422-0.422=0.000
σ0.001-0.001=-0.001
min0.421-0.420=0.001
max0.423-0.424=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.614-1988.617=-0.004
σ0.010-0.008=0.002
min1988.604-1988.610=-0.006
max1988.626-1988.629=-0.003
mean2823.000-2599.000=224.000
σ0.000
min2823.000-2599.000=224.000
max2823.000-2599.000=224.000
mean2.688-2.692=-0.004
σ0.116-0.119=-0.004
min2.580-2.596=-0.015
max2.883-2.890=-0.007
iters=5
new-facts=6402
prior-facts=1
mean4813.327-4813.340=-0.013
σ7.789-7.812=-0.023
min4809.376-4809.420=-0.044
max4827.251-4827.307=-0.055
mean2823.000-2599.000=224.000
σ0.000
min2823.000-2599.000=224.000
max2823.000-2599.000=224.000
mean8.749-8.923=-0.174
σ0.520-0.310=0.209
min7.892-8.580=-0.688
max9.165-9.312=-0.146
iters=5
new-facts=6402
prior-facts=6402
mean5001.009-5001.010=-0.001
σ0.015-0.024=-0.008
min5000.995-5000.984=0.011
max5001.030-5001.038=-0.008
mean3004.600
σ203.003-259.101=-56.098
min2823.000-2619.000=204.000
max3317.000-3312.000=5.000
mean9.573-9.721=-0.148
σ0.543-0.182=0.362
min8.612-9.437=-0.825
max9.934-9.944=-0.011

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.034-1.232=-0.198
σ0.190-0.379=-0.188
min0.919-0.916=0.003
max1.362-1.784=-0.422

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.441-464.441=0.000
σ574.774-574.794=-0.020
min177.044-177.039=0.004
max1326.603-1326.632=-0.029
mean88.250
σ8.500
min84.000
max101.000
mean2823.000-2599.000=224.000
σ0.000
min2823.000-2599.000=224.000
max2823.000-2599.000=224.000
mean0.437-0.546=-0.109
σ0.308-0.547=-0.238
min0.279-0.271=0.008
max0.899-1.366=-0.467
policies=20
mean1770.799-1770.755=0.044
σ0.369-0.342=0.026
min1770.544-1770.525=0.019
max1771.345-1771.263=0.083
mean840.000
σ0.000
min840.000
max840.000
mean2823.000-2599.000=224.000
σ0.000
min2823.000-2599.000=224.000
max2823.000-2599.000=224.000
mean2.801-2.708=0.093
σ0.040-0.020=0.020
min2.768-2.692=0.077
max2.860-2.737=0.123
policies=200
mean17715.022-17714.924=0.099
σ0.439-0.537=-0.098
min17714.754-17714.632=0.123
max17715.678-17715.728=-0.050
mean8400.000
σ0.000
min8400.000
max8400.000
mean2823.000-2599.000=224.000
σ0.000
min2823.000-2599.000=224.000
max2823.000-2599.000=224.000
mean27.823-27.379=0.445
σ0.350-0.197=0.153
min27.516-27.129=0.386
max28.205-27.563=0.643