Compare commits

Home / Compare 25a0d91e .. 75defd8e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.562=0.002
σ0.044-0.047=-0.003
min70.539-70.542=-0.002
max70.685-70.695=-0.010
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.153-0.156=-0.003
σ0.004-0.006=-0.002
min0.149-0.149=-0.000
max0.161-0.168=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.287-21.292=-0.005
σ0.002-0.011=-0.009
min21.283-21.285=-0.002
max21.290-21.324=-0.034
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.060-0.064=-0.004
σ0.002-0.003=-0.001
min0.058-0.062=-0.004
max0.066-0.071=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.375=0.000
σ0.361-0.360=0.001
min1752.806-1752.811=-0.005
max1753.976-1753.962=0.014
mean1668.000-1653.450=14.550
σ632.382-641.212=-8.830
min685.000-652.000=33.000
max2807.000-2849.000=-42.000
mean2.772-2.824=-0.051
σ0.156-0.150=0.007
min2.247-2.400=-0.153
max2.907-3.104=-0.198

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-271.753=0.001
σ0.003-0.005=-0.002
min271.750-271.747=0.003
max271.759-271.759=0.000
mean2807.000-2849.000=-42.000
σ0.000
min2807.000-2849.000=-42.000
max2807.000-2849.000=-42.000
mean0.380-0.379=0.000
σ0.004-0.005=-0.000
min0.377-0.377=0.000
max0.388-0.388=0.000
iters=5
new-facts=1
prior-facts=6402
mean1932.187-1932.176=0.011
σ0.015-0.008=0.007
min1932.172-1932.168=0.004
max1932.212-1932.189=0.023
mean2807.000-2849.000=-42.000
σ0.000
min2807.000-2849.000=-42.000
max2807.000-2849.000=-42.000
mean2.800-3.045=-0.244
σ0.281-0.137=0.143
min2.429-2.905=-0.476
max3.064-3.255=-0.191
iters=5
new-facts=6402
prior-facts=1
mean4752.945-4752.970=-0.025
σ0.900-0.816=0.084
min4752.386-4752.509=-0.123
max4754.539-4754.423=0.116
mean2807.000-2849.000=-42.000
σ0.000
min2807.000-2849.000=-42.000
max2807.000-2849.000=-42.000
mean8.190-8.040=0.150
σ0.651-0.398=0.254
min7.557-7.668=-0.111
max9.036-8.519=0.516
iters=5
new-facts=6402
prior-facts=6402
mean4943.231-4943.236=-0.005
σ0.172-0.310=-0.138
min4943.035-4942.683=0.353
max4943.375-4943.396=-0.021
mean3066.800-3077.400=-10.600
σ324.181-261.284=62.897
min2807.000-2849.000=-42.000
max3556.000-3472.000=84.000
mean8.436-8.378=0.058
σ0.089-0.150=-0.061
min8.339-8.163=0.176
max8.565-8.562=0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.040-1.045=-0.005
σ0.180-0.129=0.051
min0.930-0.927=0.003
max1.347-1.242=0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.855-467.863=-0.008
σ575.928-575.924=0.004
min179.887-179.895=-0.008
max1331.747-1331.748=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2807.000-2849.000=-42.000
σ0.000
min2807.000-2849.000=-42.000
max2807.000-2849.000=-42.000
mean0.480-0.446=0.034
σ0.396-0.300=0.096
min0.277-0.295=-0.018
max1.074-0.895=0.179
policies=20
mean1799.177-1799.183=-0.006
σ0.363-0.380=-0.016
min1798.920-1798.905=0.015
max1799.716-1799.740=-0.024
mean820.000
σ0.000
min820.000
max820.000
mean2807.000-2849.000=-42.000
σ0.000
min2807.000-2849.000=-42.000
max2807.000-2849.000=-42.000
mean2.794-2.888=-0.094
σ0.017-0.012=0.004
min2.780-2.872=-0.091
max2.818-2.900=-0.082
policies=200
mean17998.388-17998.532=-0.145
σ0.536-0.420=0.115
min17998.025-17998.241=-0.217
max17999.175-17999.156=0.020
mean8200.000
σ0.000
min8200.000
max8200.000
mean2807.000-2849.000=-42.000
σ0.000
min2807.000-2849.000=-42.000
max2807.000-2849.000=-42.000
mean28.180-28.562=-0.382
σ0.091-0.498=-0.407
min28.103-28.038=0.065
max28.304-29.105=-0.801