Compare commits

Home / Compare cc1c41a3 .. 49d91a7a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.389=0.174
σ0.046-0.045=0.000
min70.537-70.361=0.176
max70.691-70.516=0.176
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.158=0.001
σ0.003-0.003=0.000
min0.156-0.155=0.001
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.144=0.144
σ0.003-0.002=0.001
min21.284-21.141=0.143
max21.292-21.147=0.146
mean414.000
σ0.000
min414.000
max414.000
mean0.062-0.062=0.001
σ0.004-0.004=0.000
min0.058-0.058=-0.000
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1752.394=0.980
σ0.362-0.361=0.001
min1752.809-1751.827=0.982
max1753.957-1752.980=0.977
mean1650.000-1659.550=-9.550
σ640.124-636.812=3.312
min651.000-621.000=30.000
max2846.000-2790.000=56.000
mean2.860-2.833=0.027
σ0.180-0.206=-0.026
min2.581-2.192=0.389
max3.493-3.087=0.406

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.757-270.144=1.613
σ0.005-0.008=-0.002
min271.751-270.136=1.614
max271.764-270.152=1.611
mean2846.000-2790.000=56.000
σ0.000
min2846.000-2790.000=56.000
max2846.000-2790.000=56.000
mean0.380-0.382=-0.001
σ0.006-0.013=-0.007
min0.375-0.371=0.004
max0.391-0.404=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1932.176-1930.597=1.579
σ0.006-0.026=-0.020
min1932.167-1930.555=1.612
max1932.182-1930.620=1.563
mean2846.000-2790.000=56.000
σ0.000
min2846.000-2790.000=56.000
max2846.000-2790.000=56.000
mean3.065-2.523=0.542
σ0.104-0.129=-0.026
min2.968-2.371=0.597
max3.197-2.712=0.485
iters=5
new-facts=6402
prior-facts=1
mean4752.944-4751.190=1.754
σ0.896-1.031=-0.135
min4752.375-4750.235=2.140
max4754.536-4752.944=1.592
mean2846.000-2790.000=56.000
σ0.000
min2846.000-2790.000=56.000
max2846.000-2790.000=56.000
mean8.383-8.935=-0.553
σ0.379-0.404=-0.026
min8.048-8.400=-0.353
max9.034-9.449=-0.414
iters=5
new-facts=6402
prior-facts=6402
mean4943.376-4941.772=1.604
σ0.021-0.012=0.010
min4943.346-4941.761=1.585
max4943.396-4941.791=1.605
mean3061.600-3045.200=16.400
σ231.380-205.020=26.360
min2846.000-2790.000=56.000
max3404.000-3324.000=80.000
mean8.699-8.506=0.193
σ0.176-0.136=0.039
min8.486-8.367=0.120
max8.968-8.680=0.288

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-0.998=0.193
σ0.223-0.139=0.084
min0.946-0.928=0.018
max1.478-1.247=0.232

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-466.377=1.486
σ575.939-575.927=0.012
min179.889-178.407=1.482
max1331.771-1330.267=1.504
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2846.000-2790.000=56.000
σ0.000
min2846.000-2790.000=56.000
max2846.000-2790.000=56.000
mean0.445-0.443=0.002
σ0.313-0.308=0.005
min0.286-0.288=-0.002
max0.914-0.905=0.009
policies=20
mean1799.185-1784.372=14.813
σ0.373-0.369=0.004
min1798.932-1784.119=14.813
max1799.735-1784.916=14.818
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2846.000-2790.000=56.000
σ0.000
min2846.000-2790.000=56.000
max2846.000-2790.000=56.000
mean2.861-2.838=0.023
σ0.008-0.094=-0.086
min2.855-2.760=0.096
max2.873-2.963=-0.091
policies=200
mean17998.560-17849.868=148.691
σ0.486-0.455=0.031
min17998.221-17849.573=148.648
max17999.281-17850.543=148.738
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2846.000-2790.000=56.000
σ0.000
min2846.000-2790.000=56.000
max2846.000-2790.000=56.000
mean28.493-27.929=0.564
σ0.409-0.173=0.236
min28.156-27.756=0.400
max28.994-28.163=0.831