Compare commits

Home / Compare 98fc9726 .. 2bced4e1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.701=0.000
σ0.047-0.046=0.001
min70.664-70.671=-0.007
max70.831-70.829=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.155-0.155=-0.000
σ0.004-0.005=-0.001
min0.151-0.149=0.002
max0.162-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.001
σ0.003-0.003=-0.000
min21.404-21.406=-0.002
max21.412-21.415=-0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.063-0.063=0.000
σ0.003-0.004=-0.001
min0.060-0.058=0.001
max0.071-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.929=0.002
σ0.363-0.358=0.005
min1754.363-1754.357=0.006
max1755.516-1755.497=0.019
mean1633.000-1649.650=-16.650
σ594.295-632.251=-37.956
min625.000-633.000=-8.000
max2432.000-2790.000=-358.000
mean2.804-2.819=-0.015
σ0.156-0.172=-0.016
min2.342-2.377=-0.034
max3.036-3.148=-0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.756=0.000
σ0.003-0.007=-0.004
min272.751-272.748=0.003
max272.760-272.765=-0.005
mean2432.000-2790.000=-358.000
σ0.000
min2432.000-2790.000=-358.000
max2432.000-2790.000=-358.000
mean0.381-0.382=-0.001
σ0.007-0.007=-0.001
min0.376-0.378=-0.002
max0.393-0.395=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.166-1933.157=0.009
σ0.010-0.014=-0.004
min1933.153-1933.137=0.015
max1933.180-1933.176=0.004
mean2432.000-2790.000=-358.000
σ0.000
min2432.000-2790.000=-358.000
max2432.000-2790.000=-358.000
mean3.005-3.029=-0.025
σ0.076-0.087=-0.011
min2.906-2.899=0.008
max3.110-3.143=-0.033
iters=5
new-facts=6402
prior-facts=1
mean4756.922-4756.919=0.003
σ7.600-7.625=-0.026
min4753.440-4753.466=-0.026
max4770.516-4770.559=-0.043
mean2432.000-2790.000=-358.000
σ0.000
min2432.000-2790.000=-358.000
max2432.000-2790.000=-358.000
mean8.615-8.595=0.020
σ0.391-0.319=0.072
min8.021-8.071=-0.051
max9.114-8.854=0.260
iters=5
new-facts=6402
prior-facts=6402
mean4944.254-4944.326=-0.072
σ0.202-0.150=0.052
min4944.033-4944.058=-0.026
max4944.410-4944.404=0.006
mean2933.000-3018.800=-85.800
σ358.034-213.187=144.847
min2432.000-2790.000=-358.000
max3406.000-3292.000=114.000
mean8.628-8.597=0.031
σ0.285-0.098=0.187
min8.395-8.483=-0.088
max9.125-8.711=0.414

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.772-1.135=0.637
σ0.100-0.197=-0.097
min1.597-0.917=0.680
max1.835-1.407=0.428

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.317-468.339=-0.022
σ574.249-574.252=-0.002
min181.188-181.204=-0.016
max1329.692-1329.717=-0.025
mean88.250
σ8.500
min84.000
max101.000
mean2432.000-2790.000=-358.000
σ0.000
min2432.000-2790.000=-358.000
max2432.000-2790.000=-358.000
mean0.567-0.442=0.124
σ0.566-0.303=0.263
min0.282-0.290=-0.008
max1.416-0.897=0.519
policies=20
mean1812.172-1812.329=-0.157
σ0.393-0.391=0.002
min1811.924-1812.073=-0.149
max1812.756-1812.907=-0.151
mean840.000
σ0.000
min840.000
max840.000
mean2432.000-2790.000=-358.000
σ0.000
min2432.000-2790.000=-358.000
max2432.000-2790.000=-358.000
mean2.806-2.882=-0.076
σ0.020-0.009=0.011
min2.778-2.872=-0.094
max2.825-2.893=-0.069
policies=200
mean18129.039-18128.920=0.119
σ0.431-0.455=-0.024
min18128.714-18128.541=0.173
max18129.674-18129.581=0.093
mean8400.000
σ0.000
min8400.000
max8400.000
mean2432.000-2790.000=-358.000
σ0.000
min2432.000-2790.000=-358.000
max2432.000-2790.000=-358.000
mean28.357-28.461=-0.105
σ0.135-0.224=-0.089
min28.188-28.314=-0.126
max28.470-28.795=-0.325