Compare commits

Home / Compare 6bdf7282 .. 1ad44fe0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.000
σ0.054-0.055=-0.001
min35.593-35.587=0.006
max35.771-35.775=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.086=-0.000
σ0.003-0.004=-0.001
min0.082-0.081=0.001
max0.091-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean24.048-24.047=0.001
σ0.002-0.003=-0.000
min24.045-24.045=0.000
max24.052-24.053=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.068-0.064=0.005
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.074-0.072=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.490=0.001
σ0.365-0.365=-0.001
min1755.917-1755.914=0.003
max1757.080-1757.076=0.003
mean1654.000-1642.300=11.700
σ641.406-643.911=-2.505
min630.000-616.000=14.000
max2847.000-2718.000=129.000
mean2.365-2.385=-0.020
σ0.113-0.113=-0.000
min2.233-2.221=0.012
max2.624-2.633=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.765=-0.003
σ0.056-0.042=0.015
min324.662-324.691=-0.029
max324.800-324.792=0.009
mean2847.000-2718.000=129.000
σ0.000
min2847.000-2718.000=129.000
max2847.000-2718.000=129.000
mean0.432-0.428=0.004
σ0.008-0.009=-0.001
min0.422-0.421=0.001
max0.440-0.442=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.316=0.001
σ0.016-0.021=-0.004
min1985.291-1985.292=-0.001
max1985.330-1985.334=-0.004
mean2847.000-2718.000=129.000
σ0.000
min2847.000-2718.000=129.000
max2847.000-2718.000=129.000
mean2.621-2.631=-0.010
σ0.068-0.102=-0.034
min2.551-2.551=0.000
max2.715-2.761=-0.045
iters=5
new-facts=6402
prior-facts=1
mean4809.106-4809.096=0.010
σ7.628-7.647=-0.020
min4805.595-4805.611=-0.017
max4822.749-4822.775=-0.025
mean2847.000-2718.000=129.000
σ0.000
min2847.000-2718.000=129.000
max2847.000-2718.000=129.000
mean8.935-8.962=-0.027
σ0.456-0.362=0.094
min8.367-8.581=-0.214
max9.633-9.521=0.112
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.621=0.008
σ0.023-0.028=-0.005
min4996.598-4996.589=0.009
max4996.653-4996.652=0.001
mean3056.600-2982.200=74.400
σ226.085-310.297=-84.212
min2847.000-2718.000=129.000
max3393.000-3430.000=-37.000
mean8.751-8.458=0.293
σ0.170-0.049=0.121
min8.496-8.398=0.097
max8.958-8.511=0.448

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-0.974=-0.051
σ0.014-0.145=-0.131
min0.912-0.902=0.010
max0.947-1.232=-0.286

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-463.224=-0.017
σ574.766-574.795=-0.029
min175.818-175.814=0.003
max1325.356-1325.417=-0.061
mean86.250
σ8.500
min82.000
max99.000
mean2847.000-2718.000=129.000
σ0.000
min2847.000-2718.000=129.000
max2847.000-2718.000=129.000
mean0.423-0.531=-0.108
σ0.292-0.514=-0.222
min0.271-0.273=-0.002
max0.861-1.302=-0.441
policies=20
mean1758.519-1758.498=0.021
σ0.350-0.321=0.029
min1758.301-1758.281=0.020
max1759.040-1758.973=0.068
mean820.000
σ0.000
min820.000
max820.000
mean2847.000-2718.000=129.000
σ0.000
min2847.000-2718.000=129.000
max2847.000-2718.000=129.000
mean2.780-2.694=0.087
σ0.007-0.016=-0.009
min2.771-2.677=0.094
max2.788-2.711=0.078
policies=200
mean17592.188-17592.157=0.031
σ0.486-0.533=-0.047
min17591.867-17591.851=0.016
max17592.911-17592.955=-0.045
mean8200.000
σ0.000
min8200.000
max8200.000
mean2847.000-2718.000=129.000
σ0.000
min2847.000-2718.000=129.000
max2847.000-2718.000=129.000
mean27.898-27.396=0.503
σ0.342-0.121=0.221
min27.428-27.239=0.189
max28.189-27.519=0.670