Compare commits

Home / Compare 28a7bc97 .. 1e650948

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=0.001
σ0.107-0.108=-0.001
min35.756-35.751=0.005
max36.102-36.105=-0.003
mean414.000-416.900=-2.900
σ0.000-0.316=-0.316
min414.000-416.000=-2.000
max414.000-417.000=-3.000
mean0.076-0.075=0.002
σ0.003-0.005=-0.001
min0.074-0.070=0.004
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.002-0.004=-0.001
min26.061-26.060=0.002
max26.068-26.070=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.060-0.061=-0.002
σ0.003-0.003=-0.000
min0.057-0.060=-0.003
max0.067-0.069=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.922=0.001
σ0.366-0.366=-0.000
min1755.347-1755.353=-0.006
max1756.514-1756.515=-0.001
mean1664.250-1669.000=-4.750
σ627.379-635.569=-8.190
min672.000-669.000=3.000
max2653.000-2633.000=20.000
mean2.730-2.824=-0.094
σ0.287-0.091=0.196
min2.148-2.622=-0.474
max3.072-3.011=0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.827-274.827=-0.000
σ0.006-0.007=-0.001
min274.819-274.818=0.001
max274.834-274.834=-0.000
mean2653.000-2633.000=20.000
σ0.000
min2653.000-2633.000=20.000
max2653.000-2633.000=20.000
mean0.390-0.391=-0.001
σ0.010-0.010=-0.000
min0.382-0.383=-0.001
max0.403-0.404=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1940.002-1940.003=-0.001
σ0.008-0.011=-0.003
min1939.991-1939.994=-0.004
max1940.012-1940.018=-0.006
mean2653.000-2633.000=20.000
σ0.000
min2653.000-2633.000=20.000
max2653.000-2633.000=20.000
mean3.198-3.077=0.121
σ0.248-0.098=0.150
min2.986-2.956=0.029
max3.613-3.190=0.423
iters=5
new-facts=6402
prior-facts=1
mean4758.675-4758.870=-0.195
σ0.678-0.909=-0.231
min4758.188-4758.329=-0.141
max4759.871-4760.484=-0.613
mean2653.000-2633.000=20.000
σ0.000
min2653.000-2633.000=20.000
max2653.000-2633.000=20.000
mean8.635-8.156=0.479
σ0.631-0.698=-0.067
min7.704-7.670=0.033
max9.218-9.368=-0.150
iters=5
new-facts=6402
prior-facts=6402
mean4953.987-4953.913=0.074
σ0.084-0.202=-0.118
min4953.919-4953.577=0.342
max4954.091-4954.071=0.020
mean2991.000-2982.400=8.600
σ278.542-377.836=-99.294
min2653.000-2633.000=20.000
max3263.000-3520.000=-257.000
mean8.811-8.471=0.340
σ0.503-0.162=0.341
min8.424-8.371=0.053
max9.685-8.754=0.931

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.140-1.344=-0.203
σ0.202-0.344=-0.142
min0.962-0.961=0.001
max1.429-1.762=-0.333

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-464.855=0.002
σ572.669-572.658=0.011
min178.521-178.523=-0.002
max1323.861-1323.842=0.019
mean79.500
σ7.000
min76.000
max90.000
mean2653.000-2633.000=20.000
σ0.000
min2653.000-2633.000=20.000
max2653.000-2633.000=20.000
mean0.547-0.565=-0.018
σ0.525-0.556=-0.031
min0.280-0.282=-0.001
max1.335-1.399=-0.064
policies=20
mean1785.454-1785.483=-0.029
σ0.358-0.350=0.008
min1785.223-1785.261=-0.038
max1785.986-1786.003=-0.018
mean760.000
σ0.000
min760.000
max760.000
mean2653.000-2633.000=20.000
σ0.000
min2653.000-2633.000=20.000
max2653.000-2633.000=20.000
mean2.790-2.783=0.007
σ0.012-0.015=-0.004
min2.773-2.774=-0.001
max2.797-2.806=-0.008
policies=200
mean17861.465-17861.531=-0.066
σ0.562-0.515=0.046
min17861.068-17861.242=-0.174
max17862.284-17862.302=-0.017
mean7600.000
σ0.000
min7600.000
max7600.000
mean2653.000-2633.000=20.000
σ0.000
min2653.000-2633.000=20.000
max2653.000-2633.000=20.000
mean28.209-28.158=0.050
σ0.168-0.158=0.011
min28.063-27.999=0.064
max28.420-28.324=0.096