Compare commits

Home / Compare a156f45a .. 6dc96158

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.978=0.002
σ0.047-0.050=-0.003
min33.954-33.944=0.009
max34.109-34.117=-0.008
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.084-0.080=0.004
σ0.003-0.005=-0.002
min0.082-0.076=0.006
max0.090-0.089=0.000
cache=y
dps=1
iters=10
policies=100
mean23.316-23.317=-0.001
σ0.003-0.003=-0.001
min23.313-23.313=0.000
max23.320-23.323=-0.003
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.064-0.064=0.001
σ0.005-0.003=0.002
min0.059-0.060=-0.001
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.303=-0.000
σ0.365-0.364=0.000
min1756.729-1756.728=0.001
max1757.890-1757.889=0.001
mean1646.200-1650.050=-3.850
σ630.783-623.812=6.971
min624.000-640.000=-16.000
max2710.000-2827.000=-117.000
mean2.359-2.364=-0.005
σ0.101-0.103=-0.001
min2.243-2.265=-0.022
max2.626-2.639=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.443-326.453=-0.010
σ0.062-0.037=0.024
min326.335-326.389=-0.054
max326.483-326.483=0.000
mean2710.000-2827.000=-117.000
σ0.000
min2710.000-2827.000=-117.000
max2710.000-2827.000=-117.000
mean0.435-0.424=0.011
σ0.016-0.001=0.015
min0.421-0.423=-0.002
max0.456-0.425=0.031
iters=5
new-facts=1
prior-facts=6402
mean1988.611-1988.604=0.007
σ0.010-0.012=-0.003
min1988.595-1988.588=0.007
max1988.618-1988.619=-0.000
mean2710.000-2827.000=-117.000
σ0.000
min2710.000-2827.000=-117.000
max2710.000-2827.000=-117.000
mean2.732-2.688=0.044
σ0.187-0.117=0.070
min2.610-2.512=0.098
max3.063-2.822=0.241
iters=5
new-facts=6402
prior-facts=1
mean4813.502-4813.490=0.012
σ7.691-7.760=-0.070
min4809.907-4809.944=-0.038
max4827.257-4827.372=-0.115
mean2710.000-2827.000=-117.000
σ0.000
min2710.000-2827.000=-117.000
max2710.000-2827.000=-117.000
mean8.407-8.735=-0.329
σ0.695-0.598=0.098
min7.743-7.999=-0.256
max9.307-9.522=-0.215
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-5001.014=-0.004
σ0.034-0.019=0.015
min5000.970-5000.998=-0.028
max5001.059-5001.046=0.013
mean2988.000-3000.000=-12.000
σ315.048-192.124=122.925
min2710.000-2827.000=-117.000
max3439.000-3294.000=145.000
mean9.666-9.666=-0.000
σ0.364-0.532=-0.168
min9.062-8.733=0.330
max10.051-10.038=0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-1.027=-0.055
σ0.072-0.049=0.022
min0.909-0.938=-0.030
max1.056-1.053=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.436-464.434=0.002
σ574.771-574.775=-0.004
min177.049-177.044=0.004
max1326.592-1326.596=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2710.000-2827.000=-117.000
σ0.000
min2710.000-2827.000=-117.000
max2710.000-2827.000=-117.000
mean0.548-0.429=0.119
σ0.548-0.305=0.243
min0.272-0.276=-0.003
max1.370-0.887=0.483
policies=20
mean1770.772-1770.794=-0.022
σ0.358-0.364=-0.007
min1770.538-1770.555=-0.017
max1771.304-1771.336=-0.032
mean840.000
σ0.000
min840.000
max840.000
mean2710.000-2827.000=-117.000
σ0.000
min2710.000-2827.000=-117.000
max2710.000-2827.000=-117.000
mean2.755-2.782=-0.027
σ0.069-0.011=0.058
min2.702-2.770=-0.069
max2.857-2.791=0.066
policies=200
mean17714.922-17714.844=0.078
σ0.495-0.551=-0.057
min17714.593-17714.363=0.229
max17715.658-17715.639=0.020
mean8400.000
σ0.000
min8400.000
max8400.000
mean2710.000-2827.000=-117.000
σ0.000
min2710.000-2827.000=-117.000
max2710.000-2827.000=-117.000
mean27.466-27.962=-0.497
σ0.111-0.398=-0.287
min27.339-27.583=-0.244
max27.584-28.419=-0.835