Compare commits

Home / Compare 3b802070 .. 4f5a85e0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.921-53.914=0.007
σ0.366-0.366=-0.000
min53.795-53.780=0.015
max54.961-54.954=0.007
mean415.600-413.800=1.800
σ0.843-0.422=0.422
min414.000-413.000=1.000
max416.000-414.000=2.000
mean0.156-0.138=0.018
σ0.008-0.003=0.005
min0.140-0.135=0.005
max0.168-0.144=0.024
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=-0.000
σ0.006-0.005=0.001
min43.131-43.130=0.001
max43.151-43.149=0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.120-0.121=-0.001
σ0.003-0.003=-0.000
min0.117-0.118=-0.001
max0.125-0.127=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.082-992.080=0.002
σ1.231-1.231=0.000
min991.498-991.498=0.001
max997.250-997.249=0.002
mean1071.750-1061.650=10.100
σ324.728-313.559=11.169
min601.000-603.000=-2.000
max1643.000-1599.000=44.000
mean1.522-1.546=-0.023
σ0.071-0.095=-0.025
min1.395-1.465=-0.070
max1.739-1.864=-0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.676-285.675=0.002
σ0.012-0.007=0.005
min285.657-285.666=-0.009
max285.684-285.684=0.000
mean1643.000-1599.000=44.000
σ0.000
min1643.000-1599.000=44.000
max1643.000-1599.000=44.000
mean0.376-0.373=0.003
σ0.002-0.007=-0.005
min0.375-0.368=0.006
max0.378-0.385=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1285.640-1285.638=0.001
σ0.136-0.137=-0.000
min1285.574-1285.571=0.003
max1285.883-1285.882=0.001
mean1643.000-1599.000=44.000
σ0.000
min1643.000-1599.000=44.000
max1643.000-1599.000=44.000
mean1.909-1.867=0.041
σ0.086-0.045=0.041
min1.836-1.824=0.012
max2.046-1.931=0.115
iters=5
new-facts=6402
prior-facts=1
mean1807.974-1807.953=0.020
σ7.008-7.014=-0.006
min1804.631-1804.589=0.042
max1820.496-1820.485=0.011
mean1643.000-1599.000=44.000
σ0.000
min1643.000-1599.000=44.000
max1643.000-1599.000=44.000
mean4.183-4.110=0.073
σ0.162-0.213=-0.051
min4.012-3.918=0.094
max4.423-4.433=-0.009
iters=5
new-facts=6402
prior-facts=6402
mean2070.462-2070.462=-0.001
σ0.013-0.009=0.004
min2070.450-2070.450=0.000
max2070.482-2070.473=0.009
mean1859.400-1831.400=28.000
σ196.569-184.705=11.864
min1643.000-1605.000=38.000
max2084.000-2074.000=10.000
mean4.483-4.500=-0.018
σ0.106-0.046=0.060
min4.378-4.442=-0.064
max4.601-4.541=0.060

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-1.411=-0.218
σ0.375-0.377=-0.003
min0.901-0.991=-0.090
max1.785-1.834=-0.049

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.383-437.380=0.003
σ572.365-572.363=0.002
min151.195-151.195=-0.000
max1295.930-1295.924=0.006
mean90.250
σ8.500
min86.000
max103.000
mean1643.000-1599.000=44.000
σ0.000
min1643.000-1599.000=44.000
max1643.000-1599.000=44.000
mean0.524-0.536=-0.012
σ0.554-0.563=-0.009
min0.240-0.250=-0.009
max1.355-1.380=-0.025
policies=20
mean1512.217-1512.208=0.008
σ0.250-0.250=0.000
min1512.057-1512.044=0.014
max1512.590-1512.581=0.009
mean860.000
σ0.000
min860.000
max860.000
mean1643.000-1599.000=44.000
σ0.000
min1643.000-1599.000=44.000
max1643.000-1599.000=44.000
mean2.538-2.530=0.008
σ0.020-0.011=0.009
min2.518-2.520=-0.002
max2.565-2.544=0.021
policies=200
mean15129.604-15129.593=0.011
σ0.064-0.115=-0.051
min15129.554-15129.479=0.075
max15129.695-15129.729=-0.034
mean8600.000
σ0.000
min8600.000
max8600.000
mean1643.000-1599.000=44.000
σ0.000
min1643.000-1599.000=44.000
max1643.000-1599.000=44.000
mean25.606-25.547=0.059
σ0.170-0.130=0.040
min25.400-25.385=0.016
max25.773-25.678=0.095