Compare commits

Home / Compare 34eb6360 .. fb3e8d79

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.044-73.043=0.001
σ0.047-0.045=0.002
min73.019-73.023=-0.005
max73.176-73.170=0.006
mean411.700-413.000=-1.300
σ0.483-0.000=0.483
min411.000-413.000=-2.000
max412.000-413.000=-1.000
mean0.159-0.159=0.000
σ0.008-0.005=0.003
min0.145-0.152=-0.007
max0.174-0.166=0.008
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=0.000
σ0.003-0.003=0.001
min23.736-23.735=0.001
max23.746-23.744=0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.066-0.061=0.005
σ0.003-0.002=0.001
min0.065-0.059=0.005
max0.074-0.067=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1720.849-1758.788=-37.939
σ169.534-0.360=169.173
min1000.581-1758.210=-757.629
max1759.304-1759.368=-0.065
mean1646.750-1667.850=-21.100
σ630.234-639.149=-8.915
min622.000-678.000=-56.000
max2770.000-2758.000=12.000
mean2.669-2.796=-0.127
σ0.381-0.195=0.186
min1.565-2.248=-0.683
max3.102-3.015=0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.019-324.011=0.008
σ0.044-0.060=-0.016
min323.941-323.905=0.036
max324.043-324.043=-0.000
mean2770.000-2758.000=12.000
σ0.000
min2770.000-2758.000=12.000
max2770.000-2758.000=12.000
mean0.430-0.428=0.002
σ0.002-0.004=-0.002
min0.428-0.426=0.002
max0.432-0.435=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1984.588-1984.588=0.000
σ0.021-0.021=0.001
min1984.551-1984.555=-0.004
max1984.605-1984.607=-0.002
mean2770.000-2758.000=12.000
σ0.000
min2770.000-2758.000=12.000
max2770.000-2758.000=12.000
mean2.701-2.643=0.058
σ0.178-0.148=0.030
min2.572-2.500=0.072
max3.000-2.865=0.134
iters=5
new-facts=6402
prior-facts=1
mean4808.162-4808.054=0.108
σ7.807-7.563=0.244
min4804.111-4804.099=0.012
max4822.115-4821.570=0.545
mean2770.000-2758.000=12.000
σ0.000
min2770.000-2758.000=12.000
max2770.000-2758.000=12.000
mean8.489-8.640=-0.152
σ0.427-0.519=-0.091
min7.816-7.871=-0.055
max9.009-9.236=-0.227
iters=5
new-facts=6402
prior-facts=6402
mean4995.807-4995.731=0.076
σ0.028-0.155=-0.127
min4995.775-4995.458=0.317
max4995.846-4995.836=0.010
mean3006.400-3035.000=-28.600
σ276.959-219.256=57.703
min2770.000-2758.000=12.000
max3409.000-3326.000=83.000
mean8.550-8.649=-0.099
σ0.175-0.154=0.021
min8.370-8.509=-0.139
max8.819-8.851=-0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.044-1.007=0.038
σ0.095-0.142=-0.047
min0.919-0.912=0.006
max1.184-1.237=-0.053

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.353-468.350=0.003
σ574.243-574.270=-0.027
min181.228-181.210=0.018
max1329.717-1329.755=-0.038
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2758.000=12.000
σ0.000
min2770.000-2758.000=12.000
max2770.000-2758.000=12.000
mean0.444-0.560=-0.116
σ0.302-0.549=-0.248
min0.292-0.285=0.007
max0.897-1.384=-0.488
policies=20
mean1812.634-1812.446=0.189
σ0.387-0.399=-0.012
min1812.378-1812.165=0.213
max1813.205-1813.032=0.173
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2758.000=12.000
σ0.000
min2770.000-2758.000=12.000
max2770.000-2758.000=12.000
mean2.894-2.841=0.052
σ0.005-0.071=-0.066
min2.890-2.785=0.105
max2.901-2.945=-0.044
policies=200
mean18132.058-18131.249=0.809
σ0.771-0.800=-0.029
min18131.141-18130.303=0.839
max18132.921-18132.237=0.685
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2758.000=12.000
σ0.000
min2770.000-2758.000=12.000
max2770.000-2758.000=12.000
mean28.795-28.361=0.434
σ0.352-0.076=0.276
min28.444-28.275=0.169
max29.135-28.460=0.675