Compare commits

Home / Compare 9951f2d1 .. 71996f0e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.701=-0.001
σ0.046-0.047=-0.001
min70.668-70.672=-0.004
max70.829-70.832=-0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.161-0.161=-0.000
σ0.004-0.004=0.000
min0.156-0.157=-0.001
max0.167-0.167=0.000
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.000
σ0.003-0.002=0.001
min21.404-21.405=-0.000
max21.412-21.411=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.065=-0.001
σ0.004-0.002=0.002
min0.060-0.063=-0.004
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.931=-0.001
σ0.359-0.363=-0.004
min1754.357-1754.363=-0.006
max1755.498-1755.519=-0.021
mean1636.850-1666.200=-29.350
σ608.613-636.621=-28.009
min643.000-669.000=-26.000
max2439.000-2699.000=-260.000
mean2.795-2.821=-0.027
σ0.174-0.222=-0.048
min2.477-2.260=0.217
max3.078-3.123=-0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.754-272.757=-0.002
σ0.005-0.007=-0.002
min272.748-272.747=0.000
max272.759-272.764=-0.005
mean2439.000-2699.000=-260.000
σ0.000
min2439.000-2699.000=-260.000
max2439.000-2699.000=-260.000
mean0.379-0.383=-0.004
σ0.001-0.005=-0.004
min0.379-0.380=-0.001
max0.380-0.392=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.167-1933.159=0.008
σ0.022-0.014=0.007
min1933.131-1933.140=-0.010
max1933.186-1933.174=0.013
mean2439.000-2699.000=-260.000
σ0.000
min2439.000-2699.000=-260.000
max2439.000-2699.000=-260.000
mean2.988-3.114=-0.126
σ0.162-0.080=0.081
min2.804-3.029=-0.224
max3.147-3.207=-0.060
iters=5
new-facts=6402
prior-facts=1
mean4756.919-4756.922=-0.003
σ7.581-7.634=-0.053
min4753.470-4753.441=0.030
max4770.480-4770.577=-0.098
mean2439.000-2699.000=-260.000
σ0.000
min2439.000-2699.000=-260.000
max2439.000-2699.000=-260.000
mean8.577-8.573=0.004
σ0.258-0.406=-0.148
min8.317-7.941=0.376
max8.958-8.937=0.022
iters=5
new-facts=6402
prior-facts=6402
mean4944.322-4944.387=-0.065
σ0.165-0.018=0.147
min4944.028-4944.368=-0.340
max4944.410-4944.413=-0.003
mean2906.800-3019.600=-112.800
σ389.707-349.647=40.059
min2439.000-2699.000=-260.000
max3432.000-3530.000=-98.000
mean8.394-8.477=-0.083
σ0.040-0.132=-0.092
min8.354-8.369=-0.015
max8.452-8.706=-0.254

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.671-1.015=0.656
σ0.110-0.143=-0.033
min1.564-0.911=0.654
max1.823-1.226=0.597

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.322-468.331=-0.009
σ574.256-574.270=-0.014
min181.188-181.188=0.000
max1329.706-1329.736=-0.031
mean88.250
σ8.500
min84.000
max101.000
mean2439.000-2699.000=-260.000
σ0.000
min2439.000-2699.000=-260.000
max2439.000-2699.000=-260.000
mean0.558-0.557=0.002
σ0.549-0.542=0.008
min0.281-0.285=-0.004
max1.383-1.370=0.013
policies=20
mean1812.180-1812.189=-0.009
σ0.387-0.380=0.007
min1811.933-1811.934=-0.001
max1812.755-1812.752=0.003
mean840.000
σ0.000
min840.000
max840.000
mean2439.000-2699.000=-260.000
σ0.000
min2439.000-2699.000=-260.000
max2439.000-2699.000=-260.000
mean2.804-2.825=-0.020
σ0.017-0.013=0.004
min2.786-2.808=-0.021
max2.825-2.836=-0.010
policies=200
mean18129.072-18129.052=0.020
σ0.471-0.450=0.020
min18128.788-18128.786=0.003
max18129.773-18129.725=0.048
mean8400.000
σ0.000
min8400.000
max8400.000
mean2439.000-2699.000=-260.000
σ0.000
min2439.000-2699.000=-260.000
max2439.000-2699.000=-260.000
mean28.352-28.358=-0.007
σ0.036-0.098=-0.062
min28.318-28.248=0.070
max28.389-28.452=-0.063