Compare commits

Home / Compare 5122e702 .. 58be60e9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.243=0.000
σ0.053-0.053=-0.000
min35.211-35.212=-0.001
max35.392-35.393=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.085=0.000
σ0.003-0.004=-0.000
min0.083-0.082=0.001
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.000
σ0.003-0.003=-0.000
min23.766-23.765=0.001
max23.773-23.776=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.067-0.068=-0.001
σ0.001-0.003=-0.002
min0.066-0.066=0.000
max0.068-0.074=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.364=-0.001
σ0.365-0.366=-0.000
min1755.790-1755.787=0.003
max1756.952-1756.949=0.003
mean1657.150-1627.950=29.200
σ639.286-593.085=46.201
min676.000-642.000=34.000
max2844.000-2428.000=416.000
mean2.326-2.338=-0.012
σ0.078-0.098=-0.020
min2.234-2.169=0.065
max2.506-2.616=-0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.592-324.588=0.004
σ0.030-0.040=-0.010
min324.541-324.517=0.024
max324.619-324.613=0.006
mean2844.000-2428.000=416.000
σ0.000
min2844.000-2428.000=416.000
max2844.000-2428.000=416.000
mean0.421-0.420=0.001
σ0.002-0.008=-0.006
min0.418-0.406=0.012
max0.423-0.424=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.142-1985.137=0.006
σ0.005-0.013=-0.008
min1985.136-1985.124=0.013
max1985.149-1985.152=-0.003
mean2844.000-2428.000=416.000
σ0.000
min2844.000-2428.000=416.000
max2844.000-2428.000=416.000
mean2.627-2.608=0.019
σ0.077-0.103=-0.027
min2.561-2.498=0.062
max2.721-2.771=-0.050
iters=5
new-facts=6402
prior-facts=1
mean4808.818-4808.627=0.191
σ7.627-7.731=-0.104
min4805.212-4804.686=0.526
max4822.458-4822.446=0.011
mean2844.000-2428.000=416.000
σ0.000
min2844.000-2428.000=416.000
max2844.000-2428.000=416.000
mean8.782-8.532=0.250
σ0.795-0.480=0.314
min7.662-7.791=-0.129
max9.814-8.954=0.860
iters=5
new-facts=6402
prior-facts=6402
mean4996.341-4996.277=0.064
σ0.019-0.153=-0.134
min4996.315-4996.004=0.311
max4996.367-4996.361=0.006
mean3071.800-2930.400=141.400
σ230.325-420.749=-190.424
min2844.000-2461.000=383.000
max3415.000-3497.000=-82.000
mean8.817-8.509=0.309
σ0.155-0.101=0.055
min8.639-8.379=0.260
max9.058-8.654=0.405

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.986-1.611=-0.625
σ0.138-0.114=0.023
min0.920-1.468=-0.548
max1.232-1.732=-0.500

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-462.946=0.029
σ574.254-574.245=0.008
min175.835-175.818=0.017
max1324.356-1324.314=0.042
mean86.250
σ8.500
min82.000
max99.000
mean2844.000-2428.000=416.000
σ0.000
min2844.000-2428.000=416.000
max2844.000-2428.000=416.000
mean0.433-0.567=-0.134
σ0.299-0.582=-0.283
min0.282-0.271=0.010
max0.882-1.440=-0.558
policies=20
mean1758.699-1758.512=0.187
σ0.354-0.351=0.004
min1758.460-1758.276=0.183
max1759.224-1759.031=0.193
mean820.000
σ0.000
min820.000
max820.000
mean2844.000-2428.000=416.000
σ0.000
min2844.000-2428.000=416.000
max2844.000-2428.000=416.000
mean2.775-2.723=0.052
σ0.004-0.009=-0.005
min2.771-2.712=0.059
max2.780-2.734=0.046
policies=200
mean17593.216-17592.321=0.894
σ0.576-0.466=0.110
min17592.604-17592.066=0.538
max17593.724-17593.020=0.704
mean8200.000
σ0.000
min8200.000
max8200.000
mean2844.000-2428.000=416.000
σ0.000
min2844.000-2428.000=416.000
max2844.000-2428.000=416.000
mean27.776-27.570=0.206
σ0.325-0.322=0.003
min27.458-27.276=0.181
max28.140-27.985=0.155