Compare commits

Home / Compare 7fcc9a89 .. c6f40f7d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.973=0.001
σ0.106-0.107=-0.000
min35.924-35.926=-0.001
max36.276-36.275=0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.078-0.077=0.000
σ0.004-0.004=-0.000
min0.075-0.075=-0.000
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.209-26.208=0.000
σ0.003-0.003=0.001
min26.203-26.203=-0.000
max26.216-26.212=0.004
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.062-0.061=0.000
σ0.002-0.002=-0.000
min0.059-0.059=-0.000
max0.067-0.067=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.377=-0.012
σ0.370-0.372=-0.003
min1757.790-1757.805=-0.015
max1758.960-1758.976=-0.015
mean1655.800-1636.100=19.700
σ649.412-623.076=26.336
min672.000-641.000=31.000
max2755.000-2825.000=-70.000
mean2.390-2.380=0.009
σ0.099-0.117=-0.019
min2.289-2.265=0.025
max2.659-2.789=-0.129

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.511-279.543=-0.032
σ0.007-0.008=-0.001
min279.505-279.534=-0.029
max279.521-279.549=-0.028
mean2755.000-2825.000=-70.000
σ0.000
min2755.000-2825.000=-70.000
max2755.000-2825.000=-70.000
mean0.412-0.409=0.003
σ0.007-0.007=-0.001
min0.408-0.404=0.004
max0.424-0.422=0.002
iters=5
new-facts=1
prior-facts=6402
mean2178.440-2178.468=-0.028
σ0.016-0.007=0.009
min2178.422-2178.459=-0.036
max2178.460-2178.476=-0.016
mean2755.000-2825.000=-70.000
σ0.000
min2755.000-2825.000=-70.000
max2755.000-2825.000=-70.000
mean3.415-3.176=0.239
σ0.123-0.249=-0.127
min3.249-2.802=0.446
max3.542-3.488=0.055
iters=5
new-facts=6402
prior-facts=1
mean5056.365-5056.418=-0.054
σ0.995-1.026=-0.031
min5055.779-5055.803=-0.024
max5058.133-5058.238=-0.104
mean2755.000-2825.000=-70.000
σ0.000
min2755.000-2825.000=-70.000
max2755.000-2825.000=-70.000
mean9.129-9.054=0.076
σ0.425-0.866=-0.441
min8.404-7.880=0.524
max9.530-10.186=-0.656
iters=5
new-facts=6402
prior-facts=6402
mean5193.745-5193.786=-0.041
σ0.081-0.087=-0.007
min5193.681-5193.710=-0.029
max5193.859-5193.892=-0.033
mean3294.800-3222.000=72.800
σ480.357-358.976=121.381
min2755.000-2834.000=-79.000
max3947.000-3764.000=183.000
mean8.861-8.914=-0.053
σ0.116-0.390=-0.274
min8.687-8.639=0.048
max8.972-9.583=-0.611

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.006-1.027=-0.021
σ0.159-0.189=-0.030
min0.927-0.939=-0.012
max1.290-1.366=-0.076

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.487-465.541=-0.054
σ572.682-572.659=0.023
min179.139-179.203=-0.064
max1324.509-1324.529=-0.020
mean79.500
σ7.000
min76.000
max90.000
mean2755.000-2825.000=-70.000
σ0.000
min2755.000-2825.000=-70.000
max2755.000-2825.000=-70.000
mean0.557-0.443=0.114
σ0.547-0.306=0.241
min0.282-0.286=-0.005
max1.378-0.902=0.476
policies=20
mean1791.667-1792.324=-0.657
σ0.345-0.349=-0.005
min1791.449-1792.075=-0.626
max1792.181-1792.835=-0.654
mean760.000
σ0.000
min760.000
max760.000
mean2755.000-2825.000=-70.000
σ0.000
min2755.000-2825.000=-70.000
max2755.000-2825.000=-70.000
mean2.813-2.878=-0.065
σ0.020-0.011=0.008
min2.796-2.868=-0.073
max2.840-2.894=-0.054
policies=200
mean17923.238-17929.594=-6.356
σ0.503-0.444=0.059
min17922.939-17929.287=-6.348
max17923.990-17930.251=-6.261
mean7600.000
σ0.000
min7600.000
max7600.000
mean2755.000-2825.000=-70.000
σ0.000
min2755.000-2825.000=-70.000
max2755.000-2825.000=-70.000
mean28.261-28.633=-0.372
σ0.099-0.349=-0.250
min28.144-28.180=-0.036
max28.381-28.937=-0.556