Compare commits

Home / Compare 1e650948 .. ffbf4d6b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=-0.000
σ0.107-0.107=0.000
min35.752-35.756=-0.004
max36.102-36.102=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.077-0.076=0.001
σ0.005-0.003=0.001
min0.074-0.074=-0.000
max0.084-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.004-0.002=0.002
min26.060-26.061=-0.001
max26.071-26.068=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.061-0.060=0.001
σ0.002-0.003=-0.000
min0.060-0.057=0.002
max0.068-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.921-1755.923=-0.002
σ0.366-0.366=0.000
min1755.343-1755.347=-0.003
max1756.516-1756.514=0.002
mean1660.550-1664.250=-3.700
σ626.166-627.379=-1.213
min673.000-672.000=1.000
max2663.000-2653.000=10.000
mean2.685-2.730=-0.045
σ0.211-0.287=-0.077
min2.263-2.148=0.115
max2.955-3.072=-0.117

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.828-274.827=0.001
σ0.004-0.006=-0.001
min274.823-274.819=0.004
max274.834-274.834=0.000
mean2663.000-2653.000=10.000
σ0.000
min2663.000-2653.000=10.000
max2663.000-2653.000=10.000
mean0.391-0.390=0.001
σ0.009-0.010=-0.001
min0.383-0.382=0.001
max0.402-0.403=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1940.003-1940.002=0.001
σ0.008-0.008=-0.000
min1939.994-1939.991=0.004
max1940.011-1940.012=-0.000
mean2663.000-2653.000=10.000
σ0.000
min2663.000-2653.000=10.000
max2663.000-2653.000=10.000
mean3.053-3.198=-0.145
σ0.099-0.248=-0.149
min2.956-2.986=-0.029
max3.196-3.613=-0.417
iters=5
new-facts=6402
prior-facts=1
mean4758.853-4758.675=0.178
σ0.897-0.678=0.219
min4758.334-4758.188=0.146
max4760.451-4759.871=0.580
mean2663.000-2653.000=10.000
σ0.000
min2663.000-2653.000=10.000
max2663.000-2653.000=10.000
mean8.170-8.635=-0.466
σ0.643-0.631=0.012
min7.731-7.704=0.027
max9.294-9.218=0.076
iters=5
new-facts=6402
prior-facts=6402
mean4953.979-4953.987=-0.008
σ0.088-0.084=0.004
min4953.909-4953.919=-0.010
max4954.080-4954.091=-0.012
mean2976.800-2991.000=-14.200
σ354.721-278.542=76.180
min2663.000-2653.000=10.000
max3490.000-3263.000=227.000
mean8.478-8.811=-0.333
σ0.133-0.503=-0.370
min8.382-8.424=-0.042
max8.707-9.685=-0.978

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.140=0.064
σ0.325-0.202=0.123
min0.943-0.962=-0.019
max1.735-1.429=0.306

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.858-464.857=0.000
σ572.658-572.669=-0.011
min178.525-178.521=0.004
max1323.845-1323.861=-0.016
mean79.500
σ7.000
min76.000
max90.000
mean2663.000-2653.000=10.000
σ0.000
min2663.000-2653.000=10.000
max2663.000-2653.000=10.000
mean0.568-0.547=0.021
σ0.568-0.525=0.043
min0.277-0.280=-0.003
max1.420-1.335=0.085
policies=20
mean1785.492-1785.454=0.038
σ0.345-0.358=-0.013
min1785.261-1785.223=0.039
max1786.002-1785.986=0.016
mean760.000
σ0.000
min760.000
max760.000
mean2663.000-2653.000=10.000
σ0.000
min2663.000-2653.000=10.000
max2663.000-2653.000=10.000
mean2.807-2.790=0.017
σ0.035-0.012=0.024
min2.768-2.773=-0.005
max2.851-2.797=0.054
policies=200
mean17861.388-17861.465=-0.077
σ0.572-0.562=0.011
min17860.962-17861.068=-0.106
max17862.217-17862.284=-0.067
mean7600.000
σ0.000
min7600.000
max7600.000
mean2663.000-2653.000=10.000
σ0.000
min2663.000-2653.000=10.000
max2663.000-2653.000=10.000
mean28.247-28.209=0.038
σ0.196-0.168=0.028
min28.064-28.063=0.001
max28.483-28.420=0.063