Compare commits

Home / Compare 18691fc5 .. 8d7d05f0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.046-0.048=-0.002
min33.950-33.950=-0.000
max34.105-34.112=-0.007
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.082-0.085=-0.003
σ0.004-0.003=0.002
min0.076-0.082=-0.006
max0.091-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.002=0.001
min23.313-23.314=-0.001
max23.322-23.321=0.001
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.064-0.067=-0.003
σ0.003-0.003=0.001
min0.060-0.065=-0.005
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.487-1757.494=-0.006
σ0.362-0.363=-0.001
min1756.918-1756.918=0.001
max1758.074-1758.083=-0.009
mean1667.500-1660.900=6.600
σ643.839-622.096=21.743
min674.000-667.000=7.000
max2646.000-2588.000=58.000
mean2.398-2.387=0.011
σ0.118-0.145=-0.027
min2.236-2.160=0.076
max2.725-2.715=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.636-326.640=-0.003
σ0.047-0.042=0.005
min326.554-326.568=-0.014
max326.674-326.679=-0.006
mean2646.000-2588.000=58.000
σ0.000
min2646.000-2588.000=58.000
max2646.000-2588.000=58.000
mean0.427-0.423=0.003
σ0.005-0.002=0.003
min0.423-0.422=0.001
max0.434-0.425=0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.803-1988.799=0.004
σ0.010-0.015=-0.005
min1988.788-1988.777=0.011
max1988.813-1988.816=-0.003
mean2646.000-2588.000=58.000
σ0.000
min2646.000-2588.000=58.000
max2646.000-2588.000=58.000
mean2.717-2.676=0.040
σ0.118-0.063=0.054
min2.573-2.594=-0.020
max2.862-2.746=0.117
iters=5
new-facts=6402
prior-facts=1
mean4813.634-4813.704=-0.070
σ7.739-7.662=0.078
min4810.150-4810.094=0.056
max4827.478-4827.407=0.071
mean2646.000-2588.000=58.000
σ0.000
min2646.000-2588.000=58.000
max2646.000-2588.000=58.000
mean8.766-8.860=-0.094
σ0.314-0.899=-0.585
min8.315-7.704=0.611
max9.171-10.203=-1.032
iters=5
new-facts=6402
prior-facts=6402
mean5001.208-5001.196=0.012
σ0.030-0.022=0.008
min5001.175-5001.174=0.001
max5001.247-5001.221=0.026
mean3024.800-2903.800=121.000
σ294.772-332.002=-37.230
min2646.000-2588.000=58.000
max3409.000-3388.000=21.000
mean9.807-9.610=0.197
σ0.334-0.259=0.074
min9.249-9.310=-0.061
max10.075-9.844=0.231

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.168-1.261=-0.093
σ0.365-0.407=-0.042
min0.906-0.913=-0.007
max1.803-1.819=-0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.622-464.635=-0.012
σ574.777-574.788=-0.011
min177.227-177.233=-0.006
max1326.788-1326.817=-0.029
mean88.250
σ8.500
min84.000
max101.000
mean2646.000-2588.000=58.000
σ0.000
min2646.000-2588.000=58.000
max2646.000-2588.000=58.000
mean0.575-0.554=0.021
σ0.595-0.557=0.039
min0.274-0.272=0.002
max1.468-1.389=0.079
policies=20
mean1772.570-1772.671=-0.101
σ0.349-0.350=-0.002
min1772.336-1772.430=-0.093
max1773.088-1773.189=-0.101
mean840.000
σ0.000
min840.000
max840.000
mean2646.000-2588.000=58.000
σ0.000
min2646.000-2588.000=58.000
max2646.000-2588.000=58.000
mean2.727-2.711=0.017
σ0.019-0.018=0.000
min2.704-2.697=0.007
max2.749-2.737=0.012
policies=200
mean17733.679-17733.943=-0.264
σ0.716-0.491=0.225
min17733.138-17733.539=-0.401
max17734.729-17734.654=0.075
mean8400.000
σ0.000
min8400.000
max8400.000
mean2646.000-2588.000=58.000
σ0.000
min2646.000-2588.000=58.000
max2646.000-2588.000=58.000
mean27.531-27.460=0.072
σ0.213-0.086=0.127
min27.372-27.384=-0.012
max27.830-27.563=0.267