Compare commits

Home / Compare 29cb8a37 .. 2185ec46

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.563=0.003
σ0.045-0.046=-0.001
min70.542-70.537=0.005
max70.692-70.691=0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.161-0.159=0.002
σ0.003-0.003=-0.000
min0.159-0.156=0.003
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.003=-0.000
min21.283-21.284=-0.001
max21.291-21.292=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.062=0.002
σ0.003-0.004=-0.001
min0.063-0.058=0.005
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.374=0.000
σ0.360-0.362=-0.002
min1752.800-1752.809=-0.009
max1753.938-1753.957=-0.019
mean1648.100-1650.000=-1.900
σ641.253-640.124=1.129
min631.000-651.000=-20.000
max2877.000-2846.000=31.000
mean2.811-2.860=-0.049
σ0.152-0.180=-0.029
min2.437-2.581=-0.144
max3.118-3.493=-0.376

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.733-271.757=-0.024
σ0.005-0.005=-0.000
min271.725-271.751=-0.026
max271.738-271.764=-0.025
mean2877.000-2846.000=31.000
σ0.000
min2877.000-2846.000=31.000
max2877.000-2846.000=31.000
mean0.383-0.380=0.003
σ0.010-0.006=0.003
min0.372-0.375=-0.003
max0.399-0.391=0.008
iters=5
new-facts=1
prior-facts=6402
mean1932.180-1932.176=0.004
σ0.013-0.006=0.006
min1932.166-1932.167=-0.001
max1932.201-1932.182=0.018
mean2877.000-2846.000=31.000
σ0.000
min2877.000-2846.000=31.000
max2877.000-2846.000=31.000
mean3.024-3.065=-0.040
σ0.230-0.104=0.127
min2.705-2.968=-0.263
max3.322-3.197=0.125
iters=5
new-facts=6402
prior-facts=1
mean4752.786-4752.944=-0.158
σ0.646-0.896=-0.250
min4752.411-4752.375=0.036
max4753.925-4754.536=-0.611
mean2877.000-2846.000=31.000
σ0.000
min2877.000-2846.000=31.000
max2877.000-2846.000=31.000
mean8.576-8.383=0.194
σ0.580-0.379=0.201
min7.581-8.048=-0.467
max8.956-9.034=-0.078
iters=5
new-facts=6402
prior-facts=6402
mean4943.373-4943.376=-0.003
σ0.011-0.021=-0.010
min4943.359-4943.346=0.013
max4943.390-4943.396=-0.005
mean3076.200-3061.600=14.600
σ212.011-231.380=-19.369
min2877.000-2846.000=31.000
max3387.000-3404.000=-17.000
mean8.568-8.699=-0.131
σ0.224-0.176=0.048
min8.371-8.486=-0.116
max8.939-8.968=-0.030

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.191=-0.167
σ0.137-0.223=-0.086
min0.933-0.946=-0.013
max1.244-1.478=-0.234

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.857-467.863=4.994
σ575.927-575.939=-0.012
min184.889-179.889=5.000
max1336.747-1331.771=4.976
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2877.000-2846.000=31.000
σ0.000
min2877.000-2846.000=31.000
max2877.000-2846.000=31.000
mean0.484-0.445=0.039
σ0.373-0.313=0.060
min0.296-0.286=0.010
max1.044-0.914=0.130
policies=20
mean1849.225-1799.185=50.040
σ0.367-0.373=-0.006
min1848.948-1798.932=50.017
max1849.759-1799.735=50.024
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2877.000-2846.000=31.000
σ0.000
min2877.000-2846.000=31.000
max2877.000-2846.000=31.000
mean2.952-2.861=0.090
σ0.007-0.008=-0.001
min2.942-2.855=0.087
max2.957-2.873=0.084
policies=200
mean18498.759-17998.560=500.200
σ0.471-0.486=-0.016
min18498.454-17998.221=500.233
max18499.458-17999.281=500.176
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2877.000-2846.000=31.000
σ0.000
min2877.000-2846.000=31.000
max2877.000-2846.000=31.000
mean29.215-28.493=0.722
σ0.484-0.409=0.075
min28.778-28.156=0.622
max29.772-28.994=0.778