Compare commits

Home / Compare 004da829 .. 4f9b9725

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.391=0.000
σ0.048-0.047=0.001
min70.363-70.361=0.002
max70.524-70.521=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.160=-0.000
σ0.003-0.003=-0.000
min0.158-0.158=-0.000
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.002-0.003=-0.000
min21.141-21.140=0.002
max21.149-21.148=0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.063-0.058=0.005
max0.072-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.392-1752.393=-0.001
σ0.362-0.359=0.003
min1751.830-1751.825=0.004
max1752.975-1752.957=0.018
mean1654.550-1628.950=25.600
σ616.337-589.231=27.106
min636.000-626.000=10.000
max2491.000-2413.000=78.000
mean2.836-2.829=0.007
σ0.140-0.127=0.013
min2.428-2.477=-0.049
max3.141-3.035=0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.145-270.143=0.002
σ0.007-0.006=0.002
min270.134-270.134=0.001
max270.153-270.149=0.004
mean2491.000-2413.000=78.000
σ0.000
min2491.000-2413.000=78.000
max2491.000-2413.000=78.000
mean0.382-0.381=0.001
σ0.007-0.007=-0.001
min0.376-0.371=0.005
max0.393-0.392=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.596-1930.607=-0.011
σ0.019-0.008=0.011
min1930.569-1930.600=-0.031
max1930.614-1930.620=-0.006
mean2491.000-2413.000=78.000
σ0.000
min2491.000-2413.000=78.000
max2491.000-2413.000=78.000
mean2.674-2.496=0.178
σ0.238-0.135=0.104
min2.480-2.331=0.149
max3.080-2.695=0.384
iters=5
new-facts=6402
prior-facts=1
mean4751.351-4751.315=0.036
σ0.859-0.943=-0.085
min4750.844-4750.757=0.087
max4752.876-4752.991=-0.115
mean2491.000-2413.000=78.000
σ0.000
min2491.000-2413.000=78.000
max2491.000-2413.000=78.000
mean8.183-8.633=-0.450
σ0.518-0.498=0.020
min7.754-7.934=-0.180
max8.844-9.222=-0.378
iters=5
new-facts=6402
prior-facts=6402
mean4941.770-4941.701=0.069
σ0.024-0.160=-0.137
min4941.740-4941.415=0.325
max4941.792-4941.789=0.003
mean2949.200-2985.200=-36.000
σ422.145-283.078=139.067
min2491.000-2599.000=-108.000
max3519.000-3320.000=199.000
mean8.480-8.541=-0.060
σ0.126-0.125=0.001
min8.324-8.427=-0.103
max8.665-8.720=-0.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.716-1.834=-0.117
σ0.170-0.066=0.104
min1.443-1.751=-0.308
max1.900-1.936=-0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.361-466.360=0.000
σ575.921-575.921=-0.000
min178.398-178.398=0.001
max1330.242-1330.241=0.000
mean84.000
σ8.000
min80.000
max96.000
mean2491.000-2413.000=78.000
σ0.000
min2491.000-2413.000=78.000
max2491.000-2413.000=78.000
mean0.564-0.568=-0.004
σ0.566-0.574=-0.008
min0.277-0.281=-0.004
max1.413-1.429=-0.016
policies=20
mean1784.294-1784.286=0.007
σ0.354-0.359=-0.005
min1784.071-1784.056=0.015
max1784.821-1784.820=0.000
mean800.000
σ0.000
min800.000
max800.000
mean2491.000-2413.000=78.000
σ0.000
min2491.000-2413.000=78.000
max2491.000-2413.000=78.000
mean2.782-2.785=-0.003
σ0.018-0.007=0.011
min2.756-2.776=-0.020
max2.798-2.791=0.007
policies=200
mean17849.882-17849.756=0.126
σ0.469-0.469=-0.000
min17849.611-17849.484=0.126
max17850.583-17850.456=0.127
mean8000.000
σ0.000
min8000.000
max8000.000
mean2491.000-2413.000=78.000
σ0.000
min2491.000-2413.000=78.000
max2491.000-2413.000=78.000
mean28.217-27.992=0.225
σ0.192-0.150=0.042
min28.043-27.828=0.215
max28.482-28.177=0.305