Compare commits

Home / Compare 9668b367 .. 8b395ed3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.390=0.001
σ0.047-0.048=-0.001
min70.361-70.363=-0.002
max70.521-70.523=-0.002
mean414.000-412.400=1.600
σ0.000-0.516=-0.516
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.160-0.159=0.001
σ0.003-0.005=-0.003
min0.158-0.150=0.008
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.003-0.003=0.000
min21.140-21.141=-0.002
max21.148-21.149=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.000
min0.058-0.063=-0.005
max0.069-0.074=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.395=-0.002
σ0.359-0.361=-0.002
min1751.825-1751.824=0.001
max1752.957-1752.967=-0.010
mean1628.950-1625.000=3.950
σ589.231-590.380=-1.148
min626.000-623.000=3.000
max2413.000-2411.000=2.000
mean2.829-2.800=0.030
σ0.127-0.173=-0.046
min2.477-2.301=0.176
max3.035-3.060=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.143-270.122=0.021
σ0.006-0.006=-0.001
min270.134-270.117=0.017
max270.149-270.132=0.017
mean2413.000-2411.000=2.000
σ0.000
min2413.000-2411.000=2.000
max2413.000-2411.000=2.000
mean0.381-0.385=-0.005
σ0.007-0.008=-0.001
min0.371-0.379=-0.008
max0.392-0.399=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.607=-0.001
σ0.008-0.006=0.002
min1930.600-1930.598=0.002
max1930.620-1930.614=0.006
mean2413.000-2411.000=2.000
σ0.000
min2413.000-2411.000=2.000
max2413.000-2411.000=2.000
mean2.496-2.554=-0.058
σ0.135-0.117=0.017
min2.331-2.432=-0.101
max2.695-2.686=0.009
iters=5
new-facts=6402
prior-facts=1
mean4751.315-4751.308=0.008
σ0.943-0.852=0.092
min4750.757-4750.892=-0.135
max4752.991-4752.830=0.161
mean2413.000-2411.000=2.000
σ0.000
min2413.000-2411.000=2.000
max2413.000-2411.000=2.000
mean8.633-8.397=0.236
σ0.498-0.325=0.173
min7.934-7.845=0.090
max9.222-8.620=0.602
iters=5
new-facts=6402
prior-facts=6402
mean4941.701-4941.702=-0.001
σ0.160-0.150=0.011
min4941.415-4941.437=-0.023
max4941.789-4941.794=-0.006
mean2985.200-3009.200=-24.000
σ283.078-293.266=-10.188
min2599.000-2601.000=-2.000
max3320.000-3387.000=-67.000
mean8.541-8.739=-0.199
σ0.125-0.334=-0.209
min8.427-8.458=-0.031
max8.720-9.319=-0.599

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.834-1.837=-0.003
σ0.066-0.175=-0.109
min1.751-1.597=0.154
max1.936-2.045=-0.109

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.360-466.364=-0.003
σ575.921-575.914=0.007
min178.398-178.403=-0.005
max1330.241-1330.235=0.007
mean84.000
σ8.000
min80.000
max96.000
mean2413.000-2411.000=2.000
σ0.000
min2413.000-2411.000=2.000
max2413.000-2411.000=2.000
mean0.568-0.566=0.002
σ0.574-0.570=0.003
min0.281-0.277=0.004
max1.429-1.422=0.008
policies=20
mean1784.286-1784.322=-0.036
σ0.359-0.358=0.001
min1784.056-1784.092=-0.037
max1784.820-1784.853=-0.033
mean800.000
σ0.000
min800.000
max800.000
mean2413.000-2411.000=2.000
σ0.000
min2413.000-2411.000=2.000
max2413.000-2411.000=2.000
mean2.785-2.797=-0.012
σ0.007-0.017=-0.010
min2.776-2.777=-0.001
max2.791-2.812=-0.022
policies=200
mean17849.756-17849.792=-0.036
σ0.469-0.398=0.070
min17849.484-17849.447=0.038
max17850.456-17850.366=0.090
mean8000.000
σ0.000
min8000.000
max8000.000
mean2413.000-2411.000=2.000
σ0.000
min2413.000-2411.000=2.000
max2413.000-2411.000=2.000
mean27.992-28.020=-0.029
σ0.150-0.069=0.081
min27.828-27.942=-0.114
max28.177-28.110=0.067