Compare commits

Home / Compare 3b4a0c5a .. 8e27d94a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.983-33.977=0.005
σ0.049-0.048=0.001
min33.955-33.953=0.002
max34.119-34.112=0.007
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.080=0.006
σ0.004-0.004=-0.001
min0.082-0.076=0.006
max0.092-0.087=0.005
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.002-0.004=-0.002
min23.314-23.311=0.002
max23.319-23.323=-0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.064=0.002
σ0.002-0.004=-0.002
min0.064-0.059=0.005
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.425-1757.426=-0.000
σ0.364-0.364=0.000
min1756.857-1756.855=0.002
max1758.016-1758.013=0.003
mean1660.100-1655.650=4.450
σ650.600-643.387=7.213
min626.000-620.000=6.000
max2812.000-2739.000=73.000
mean2.430-2.401=0.029
σ0.257-0.235=0.022
min2.257-2.191=0.066
max3.421-3.335=0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.577-326.540=0.037
σ0.046-0.051=-0.006
min326.498-326.448=0.049
max326.614-326.570=0.044
mean2812.000-2739.000=73.000
σ0.000
min2812.000-2739.000=73.000
max2812.000-2739.000=73.000
mean0.423-0.430=-0.006
σ0.005-0.007=-0.002
min0.421-0.421=-0.001
max0.432-0.437=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.724-1988.734=-0.010
σ0.024-0.007=0.017
min1988.695-1988.726=-0.032
max1988.745-1988.745=0.000
mean2812.000-2739.000=73.000
σ0.000
min2812.000-2739.000=73.000
max2812.000-2739.000=73.000
mean2.671-2.768=-0.097
σ0.046-0.146=-0.100
min2.595-2.564=0.031
max2.720-2.932=-0.212
iters=5
new-facts=6402
prior-facts=1
mean4813.557-4813.358=0.199
σ7.674-7.847=-0.174
min4810.085-4809.515=0.570
max4827.284-4827.386=-0.102
mean2812.000-2739.000=73.000
σ0.000
min2812.000-2739.000=73.000
max2812.000-2739.000=73.000
mean8.897-8.475=0.422
σ0.406-0.606=-0.200
min8.552-7.727=0.825
max9.438-9.206=0.232
iters=5
new-facts=6402
prior-facts=6402
mean5001.131-5001.063=0.068
σ0.025-0.165=-0.140
min5001.097-5000.771=0.326
max5001.155-5001.160=-0.005
mean3026.000-2983.000=43.000
σ220.032-295.019=-74.988
min2812.000-2739.000=73.000
max3334.000-3423.000=-89.000
mean9.532-9.592=-0.060
σ0.512-0.562=-0.050
min8.653-8.598=0.056
max9.908-9.938=-0.030

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.033-1.005=0.028
σ0.264-0.142=0.122
min0.912-0.912=0.000
max1.505-1.239=0.267

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.332-464.566=-0.234
σ574.292-574.768=-0.477
min177.171-177.173=-0.002
max1325.769-1326.718=-0.949
mean88.250
σ8.500
min84.000
max101.000
mean2812.000-2739.000=73.000
σ0.000
min2812.000-2739.000=73.000
max2812.000-2739.000=73.000
mean0.434-0.552=-0.117
σ0.307-0.556=-0.249
min0.278-0.272=0.006
max0.894-1.386=-0.492
policies=20
mean1772.048-1772.015=0.033
σ0.367-0.339=0.029
min1771.796-1771.794=0.002
max1772.593-1772.519=0.074
mean840.000
σ0.000
min840.000
max840.000
mean2812.000-2739.000=73.000
σ0.000
min2812.000-2739.000=73.000
max2812.000-2739.000=73.000
mean2.790-2.712=0.079
σ0.008-0.014=-0.006
min2.784-2.696=0.088
max2.802-2.731=0.071
policies=200
mean17727.539-17727.531=0.008
σ0.488-0.520=-0.031
min17727.204-17727.220=-0.017
max17728.264-17728.303=-0.039
mean8400.000
σ0.000
min8400.000
max8400.000
mean2812.000-2739.000=73.000
σ0.000
min2812.000-2739.000=73.000
max2812.000-2739.000=73.000
mean27.520-27.606=-0.085
σ0.229-0.062=0.166
min27.344-27.515=-0.171
max27.831-27.648=0.182