Compare commits

Home / Compare c86e00fe .. 8d19fef9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.379=0.011
σ0.047-0.048=-0.001
min70.361-70.354=0.007
max70.521-70.514=0.007
mean414.000-410.000=4.000
σ0.000
min414.000-410.000=4.000
max414.000-410.000=4.000
mean0.160-0.157=0.003
σ0.003-0.004=-0.001
min0.158-0.151=0.006
max0.165-0.162=0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.003=0.000
min21.140-21.141=-0.001
max21.148-21.148=0.000
mean414.000-410.000=4.000
σ0.000
min414.000-410.000=4.000
max414.000-410.000=4.000
mean0.063-0.064=-0.002
σ0.004-0.002=0.001
min0.058-0.063=-0.005
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.386=0.007
σ0.359-0.361=-0.002
min1751.825-1751.818=0.007
max1752.957-1752.980=-0.023
mean1628.950-1624.000=4.950
σ589.231-592.413=-3.182
min626.000-621.000=5.000
max2413.000-2417.000=-4.000
mean2.829-2.758=0.072
σ0.127-0.252=-0.125
min2.477-2.176=0.301
max3.035-3.216=-0.181

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.143-270.129=0.015
σ0.006-0.006=0.000
min270.134-270.121=0.012
max270.149-270.136=0.013
mean2413.000-2417.000=-4.000
σ0.000
min2413.000-2417.000=-4.000
max2413.000-2417.000=-4.000
mean0.381-0.380=0.000
σ0.007-0.006=0.001
min0.371-0.377=-0.006
max0.392-0.391=0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.588=0.018
σ0.008-0.011=-0.003
min1930.600-1930.574=0.026
max1930.620-1930.602=0.018
mean2413.000-2417.000=-4.000
σ0.000
min2413.000-2417.000=-4.000
max2413.000-2417.000=-4.000
mean2.496-2.549=-0.053
σ0.135-0.123=0.012
min2.331-2.400=-0.069
max2.695-2.657=0.038
iters=5
new-facts=6402
prior-facts=1
mean4751.315-4750.972=0.343
σ0.943-0.988=-0.045
min4750.757-4749.899=0.859
max4752.991-4752.598=0.392
mean2413.000-2417.000=-4.000
σ0.000
min2413.000-2417.000=-4.000
max2413.000-2417.000=-4.000
mean8.633-8.723=-0.091
σ0.498-0.516=-0.018
min7.934-8.082=-0.147
max9.222-9.489=-0.267
iters=5
new-facts=6402
prior-facts=6402
mean4941.701-4941.532=0.169
σ0.160-0.083=0.077
min4941.415-4941.463=-0.048
max4941.789-4941.637=0.151
mean2985.200-3008.800=-23.600
σ283.078-375.900=-92.822
min2599.000-2530.000=69.000
max3320.000-3372.000=-52.000
mean8.541-8.569=-0.028
σ0.125-0.205=-0.080
min8.427-8.373=0.054
max8.720-8.880=-0.160

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.834-1.779=0.055
σ0.066-0.083=-0.017
min1.751-1.656=0.095
max1.936-1.879=0.058

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.360-466.352=0.008
σ575.921-575.917=0.003
min178.398-178.391=0.006
max1330.241-1330.228=0.013
mean84.000
σ8.000
min80.000
max96.000
mean2413.000-2417.000=-4.000
σ0.000
min2413.000-2417.000=-4.000
max2413.000-2417.000=-4.000
mean0.568-0.552=0.016
σ0.574-0.548=0.025
min0.281-0.274=0.006
max1.429-1.375=0.054
policies=20
mean1784.286-1784.205=0.082
σ0.359-0.347=0.012
min1784.056-1783.999=0.057
max1784.820-1784.724=0.097
mean800.000
σ0.000
min800.000
max800.000
mean2413.000-2417.000=-4.000
σ0.000
min2413.000-2417.000=-4.000
max2413.000-2417.000=-4.000
mean2.785-2.785=0.000
σ0.007-0.017=-0.010
min2.776-2.767=0.009
max2.791-2.801=-0.010
policies=200
mean17849.756-17848.663=1.093
σ0.469-0.451=0.018
min17849.484-17848.401=1.083
max17850.456-17849.338=1.118
mean8000.000
σ0.000
min8000.000
max8000.000
mean2413.000-2417.000=-4.000
σ0.000
min2413.000-2417.000=-4.000
max2413.000-2417.000=-4.000
mean27.992-27.932=0.060
σ0.150-0.225=-0.075
min27.828-27.746=0.082
max28.177-28.255=-0.078