Compare commits

Home / Compare d53c0589 .. cab2bcac

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.736-70.734=0.002
σ0.052-0.051=0.001
min70.704-70.700=0.004
max70.882-70.875=0.006
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.163-0.158=0.005
σ0.009-0.004=0.005
min0.155-0.150=0.005
max0.187-0.164=0.023
cache=y
dps=1
iters=10
policies=100
mean21.449-21.450=-0.001
σ0.003-0.002=0.001
min21.443-21.446=-0.003
max21.453-21.454=-0.001
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.066-0.064=0.002
σ0.002-0.003=-0.000
min0.063-0.059=0.004
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.881-1751.883=-0.002
σ0.361-0.361=0.000
min1751.304-1751.306=-0.002
max1752.459-1752.464=-0.005
mean1651.750-1659.100=-7.350
σ646.842-626.797=20.045
min636.000-682.000=-46.000
max2844.000-2659.000=185.000
mean2.800-2.870=-0.071
σ0.195-0.100=0.095
min2.243-2.677=-0.434
max3.025-3.050=-0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.971-270.973=-0.002
σ0.002-0.005=-0.002
min270.967-270.966=0.001
max270.974-270.978=-0.004
mean2844.000-2659.000=185.000
σ0.000
min2844.000-2659.000=185.000
max2844.000-2659.000=185.000
mean0.379-0.379=-0.000
σ0.005-0.008=-0.003
min0.376-0.371=0.005
max0.387-0.392=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1931.349-1931.344=0.005
σ0.006-0.018=-0.012
min1931.341-1931.322=0.019
max1931.357-1931.366=-0.009
mean2844.000-2659.000=185.000
σ0.000
min2844.000-2659.000=185.000
max2844.000-2659.000=185.000
mean3.034-3.011=0.023
σ0.044-0.136=-0.092
min2.978-2.783=0.195
max3.092-3.115=-0.024
iters=5
new-facts=6402
prior-facts=1
mean4752.158-4752.009=0.149
σ0.866-0.940=-0.074
min4751.656-4751.209=0.447
max4753.697-4753.632=0.064
mean2844.000-2659.000=185.000
σ0.000
min2844.000-2659.000=185.000
max2844.000-2659.000=185.000
mean8.346-8.424=-0.079
σ0.380-0.486=-0.106
min7.913-7.829=0.084
max8.788-9.173=-0.384
iters=5
new-facts=6402
prior-facts=6402
mean4942.521-4942.527=-0.006
σ0.148-0.136=0.012
min4942.257-4942.284=-0.028
max4942.605-4942.603=0.002
mean3011.800-2981.800=30.000
σ190.643-335.782=-145.139
min2844.000-2659.000=185.000
max3309.000-3450.000=-141.000
mean8.710-8.403=0.307
σ0.365-0.042=0.324
min8.358-8.353=0.005
max9.298-8.469=0.830

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.065-1.074=-0.010
σ0.107-0.153=-0.046
min0.928-0.923=0.005
max1.229-1.235=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.068-466.067=0.002
σ574.937-574.937=-0.001
min178.591-178.593=-0.001
max1328.474-1328.473=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2844.000-2659.000=185.000
σ0.000
min2844.000-2659.000=185.000
max2844.000-2659.000=185.000
mean0.479-0.569=-0.090
σ0.378-0.583=-0.205
min0.287-0.275=0.012
max1.046-1.444=-0.398
policies=20
mean1786.182-1786.138=0.044
σ0.365-0.371=-0.007
min1785.922-1785.912=0.010
max1786.720-1786.694=0.027
mean820.000
σ0.000
min820.000
max820.000
mean2844.000-2659.000=185.000
σ0.000
min2844.000-2659.000=185.000
max2844.000-2659.000=185.000
mean2.862-2.765=0.097
σ0.010-0.022=-0.012
min2.850-2.739=0.110
max2.874-2.793=0.081
policies=200
mean17868.447-17868.370=0.077
σ0.510-0.450=0.059
min17868.006-17868.020=-0.014
max17869.138-17869.029=0.109
mean8200.000
σ0.000
min8200.000
max8200.000
mean2844.000-2659.000=185.000
σ0.000
min2844.000-2659.000=185.000
max2844.000-2659.000=185.000
mean28.497-27.923=0.574
σ0.550-0.077=0.473
min27.894-27.856=0.038
max29.169-28.003=1.166