Compare commits

Home / Compare 495f4360 .. e42ed8b5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.984-33.986=-0.001
σ0.049-0.049=0.000
min33.952-33.955=-0.004
max34.121-34.123=-0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.081-0.084=-0.004
σ0.004-0.003=0.001
min0.076-0.081=-0.005
max0.088-0.090=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.323-23.324=-0.001
σ0.003-0.003=-0.000
min23.320-23.321=-0.001
max23.328-23.331=-0.003
mean412.000
σ0.000
min412.000
max412.000
mean0.064-0.063=0.001
σ0.004-0.004=-0.000
min0.059-0.060=-0.001
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.297-1757.299=-0.002
σ0.364-0.365=-0.001
min1756.725-1756.725=0.000
max1757.887-1757.884=0.003
mean1635.750-1650.500=-14.750
σ621.912-638.739=-16.826
min619.000-618.000=1.000
max2682.000-2757.000=-75.000
mean2.408-2.377=0.031
σ0.173-0.102=0.070
min2.255-2.271=-0.016
max2.952-2.625=0.327

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.419-326.442=-0.023
σ0.056-0.049=0.007
min326.321-326.355=-0.034
max326.460-326.476=-0.016
mean2682.000-2757.000=-75.000
σ0.000
min2682.000-2757.000=-75.000
max2682.000-2757.000=-75.000
mean0.433-0.427=0.006
σ0.006-0.002=0.004
min0.425-0.424=0.001
max0.439-0.429=0.011
iters=5
new-facts=1
prior-facts=6402
mean1988.604-1988.606=-0.003
σ0.008-0.011=-0.003
min1988.594-1988.595=-0.001
max1988.612-1988.619=-0.007
mean2682.000-2757.000=-75.000
σ0.000
min2682.000-2757.000=-75.000
max2682.000-2757.000=-75.000
mean2.750-2.749=0.001
σ0.110-0.109=0.002
min2.667-2.631=0.036
max2.936-2.894=0.041
iters=5
new-facts=6402
prior-facts=1
mean4812.246-4812.375=-0.129
σ7.474-7.734=-0.259
min4808.860-4808.833=0.028
max4825.617-4826.209=-0.592
mean2682.000-2757.000=-75.000
σ0.000
min2682.000-2757.000=-75.000
max2682.000-2757.000=-75.000
mean8.637-8.541=0.096
σ0.461-0.489=-0.029
min7.920-7.843=0.077
max9.164-9.211=-0.047
iters=5
new-facts=6402
prior-facts=6402
mean4999.930-4999.795=0.134
σ0.019-0.315=-0.296
min4999.910-4999.237=0.672
max4999.952-4999.996=-0.044
mean2947.000-2996.400=-49.400
σ312.201-296.086=16.115
min2682.000-2757.000=-75.000
max3407.000-3440.000=-33.000
mean9.599-9.341=0.257
σ0.622-0.756=-0.134
min8.499-8.521=-0.022
max10.034-10.168=-0.134

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.075-1.007=0.068
σ0.157-0.066=0.091
min0.916-0.921=-0.005
max1.237-1.058=0.179

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.428-464.432=-0.004
σ574.779-574.772=0.007
min177.033-177.034=-0.000
max1326.597-1326.591=0.007
mean88.250
σ8.500
min84.000
max101.000
mean2682.000-2757.000=-75.000
σ0.000
min2682.000-2757.000=-75.000
max2682.000-2757.000=-75.000
mean0.543-0.436=0.107
σ0.534-0.308=0.226
min0.273-0.280=-0.007
max1.344-0.898=0.446
policies=20
mean1770.656-1770.690=-0.033
σ0.354-0.377=-0.022
min1770.423-1770.443=-0.020
max1771.184-1771.250=-0.066
mean840.000
σ0.000
min840.000
max840.000
mean2682.000-2757.000=-75.000
σ0.000
min2682.000-2757.000=-75.000
max2682.000-2757.000=-75.000
mean2.731-2.822=-0.092
σ0.016-0.058=-0.042
min2.720-2.788=-0.069
max2.754-2.908=-0.154
policies=200
mean17713.815-17713.692=0.124
σ0.470-0.495=-0.025
min17713.551-17713.349=0.202
max17714.519-17714.423=0.095
mean8400.000
σ0.000
min8400.000
max8400.000
mean2682.000-2757.000=-75.000
σ0.000
min2682.000-2757.000=-75.000
max2682.000-2757.000=-75.000
mean27.562-27.554=0.007
σ0.092-0.120=-0.028
min27.481-27.398=0.083
max27.691-27.680=0.011