Compare commits

Home / Compare de7b65f2 .. f0425eec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.728=-0.001
σ0.858-0.612=0.245
min35.921-35.925=-0.004
max38.473-37.205=1.268
mean3949.000-4172.000=-223.000
σ0.000
min3949.000-4172.000=-223.000
max3949.000-4172.000=-223.000
mean0.076-0.075=0.001
σ0.001-0.001=-0.000
min0.074-0.074=0.001
max0.076-0.076=0.000
cache=y
dps=1
iters=10
policies=100
mean26.711-26.711=-0.001
σ0.649-0.646=0.003
min26.204-26.206=-0.002
max27.470-27.464=0.005
mean3949.000-4172.000=-223.000
σ0.000
min3949.000-4172.000=-223.000
max3949.000-4172.000=-223.000
mean0.059-0.060=-0.001
σ0.001-0.000=0.001
min0.057-0.059=-0.002
max0.061-0.061=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.358-1756.357=0.001
σ0.375-0.373=0.002
min1755.788-1755.787=0.001
max1756.961-1756.954=0.007
mean1656.400-1654.100=2.300
σ627.525-629.362=-1.837
min682.000-678.000=4.000
max2606.000
mean2.283-2.262=0.021
σ0.144-0.113=0.031
min2.161-2.134=0.027
max2.771-2.542=0.229

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.670-278.669=0.001
σ0.014-0.009=0.006
min278.656-278.660=-0.003
max278.695-278.682=0.013
mean2606.000
σ0.000
min2606.000
max2606.000
mean0.417-0.418=-0.002
σ0.001-0.001=0.000
min0.415-0.417=-0.002
max0.418-0.419=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.842-2268.843=-0.001
σ0.007-0.013=-0.006
min2268.836-2268.822=0.015
max2268.854-2268.858=-0.004
mean2606.000
σ0.000
min2606.000
max2606.000
mean2.955-3.025=-0.069
σ0.085-0.150=-0.065
min2.901-2.891=0.010
max3.105-3.232=-0.127
iters=5
new-facts=6402
prior-facts=1
mean4952.303-4952.202=0.101
σ0.831-0.968=-0.138
min4951.890-4951.361=0.529
max4953.787-4953.875=-0.087
mean2606.000
σ0.000
min2606.000
max2606.000
mean8.063-8.142=-0.078
σ0.179-0.225=-0.046
min7.797-7.942=-0.144
max8.301-8.519=-0.218
iters=5
new-facts=6402
prior-facts=6402
mean5167.052-5167.051=0.001
σ0.014-0.011=0.002
min5167.041-5167.038=0.003
max5167.073-5167.067=0.007
mean3401.400-3500.200=-98.800
σ448.358-490.571=-42.213
min2771.000-2853.000=-82.000
max3949.000-4172.000=-223.000
mean9.507-9.232=0.275
σ0.311-0.193=0.118
min9.142-9.020=0.122
max9.843-9.464=0.379

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.062-1.062=-0.000
σ0.238-0.160=0.078
min0.919-0.943=-0.024
max1.472-1.262=0.211

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.253-460.253=0.000
σ572.606-572.607=-0.001
min173.949-173.946=0.003
max1319.163-1319.164=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean437.000-435.000=2.000
σ0.000
min437.000-435.000=2.000
max437.000-435.000=2.000
mean0.548-0.580=-0.032
σ0.550-0.600=-0.050
min0.267-0.271=-0.004
max1.373-1.481=-0.108
policies=20
mean1739.993-1739.999=-0.007
σ0.339-0.321=0.018
min1739.754-1739.769=-0.015
max1740.490-1740.470=0.020
mean760.000
σ0.000
min760.000
max760.000
mean447.250-445.000=2.250
σ10.178-9.381=0.797
min437.000-435.000=2.000
max456.000-453.000=3.000
mean2.663-2.643=0.020
σ0.016-0.017=-0.001
min2.647-2.619=0.028
max2.685-2.655=0.030
policies=200
mean17409.214-17409.305=-0.091
σ0.062-0.063=-0.001
min17409.127-17409.213=-0.085
max17409.274-17409.352=-0.078
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.500-488.500=3.000
σ2.517-1.732=0.785
min489.000-486.000=3.000
max495.000-490.000=5.000
mean26.787-26.899=-0.112
σ0.161-0.072=0.089
min26.569-26.816=-0.247
max26.959-26.991=-0.032