Compare commits

Home / Compare c44e267c .. 53e672b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.044-73.049=-0.005
σ0.048-0.048=0.000
min73.019-73.023=-0.004
max73.178-73.183=-0.004
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.158-0.162=-0.003
σ0.005-0.003=0.002
min0.151-0.159=-0.008
max0.164-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.741-23.740=0.001
σ0.002-0.002=0.000
min23.739-23.737=0.001
max23.745-23.743=0.003
mean416.000-413.700=2.300
σ0.000-0.483=-0.483
min416.000-413.000=3.000
max416.000-414.000=2.000
mean0.066-0.063=0.002
σ0.001-0.004=-0.003
min0.065-0.059=0.005
max0.069-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.788=-0.002
σ0.361-0.362=-0.001
min1758.226-1758.212=0.014
max1759.371-1759.373=-0.003
mean1663.900-1658.200=5.700
σ621.974-624.781=-2.807
min632.000-625.000=7.000
max2506.000-2515.000=-9.000
mean2.858-2.822=0.036
σ0.202-0.143=0.059
min2.397-2.266=0.131
max3.551-2.969=0.582

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.013-324.016=-0.003
σ0.061-0.044=0.017
min323.905-323.939=-0.034
max324.046-324.046=0.000
mean2506.000-2515.000=-9.000
σ0.000
min2506.000-2515.000=-9.000
max2506.000-2515.000=-9.000
mean0.429-0.426=0.003
σ0.006-0.001=0.006
min0.423-0.425=-0.003
max0.436-0.427=0.010
iters=5
new-facts=1
prior-facts=6402
mean1984.588-1984.584=0.004
σ0.022-0.023=-0.001
min1984.550-1984.548=0.003
max1984.606-1984.602=0.004
mean2506.000-2515.000=-9.000
σ0.000
min2506.000-2515.000=-9.000
max2506.000-2515.000=-9.000
mean2.700-2.702=-0.002
σ0.171-0.277=-0.106
min2.566-2.516=0.049
max2.913-3.190=-0.277
iters=5
new-facts=6402
prior-facts=1
mean4808.171-4808.225=-0.054
σ7.548-7.777=-0.229
min4804.666-4804.722=-0.056
max4821.671-4822.136=-0.465
mean2506.000-2515.000=-9.000
σ0.000
min2506.000-2515.000=-9.000
max2506.000-2515.000=-9.000
mean8.754-8.591=0.163
σ0.517-0.299=0.218
min7.972-8.078=-0.106
max9.204-8.856=0.348
iters=5
new-facts=6402
prior-facts=6402
mean4995.802-4995.666=0.137
σ0.021-0.174=-0.153
min4995.773-4995.468=0.305
max4995.824-4995.810=0.014
mean2958.000-2964.600=-6.600
σ271.453-251.960=19.493
min2593.000-2642.000=-49.000
max3315.000-3303.000=12.000
mean8.574-8.575=-0.001
σ0.142-0.073=0.069
min8.399-8.487=-0.088
max8.778-8.643=0.135

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.673-1.562=0.111
σ0.174-0.230=-0.056
min1.372-1.223=0.149
max1.803-1.759=0.044

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.326-468.332=-0.006
σ574.232-574.235=-0.002
min181.208-181.211=-0.004
max1329.675-1329.684=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2506.000-2515.000=-9.000
σ0.000
min2506.000-2515.000=-9.000
max2506.000-2515.000=-9.000
mean0.548-0.562=-0.014
σ0.531-0.560=-0.028
min0.280-0.281=-0.001
max1.345-1.401=-0.056
policies=20
mean1812.428-1812.428=0.001
σ0.388-0.386=0.002
min1812.171-1812.157=0.014
max1813.003-1812.998=0.005
mean840.000
σ0.000
min840.000
max840.000
mean2506.000-2515.000=-9.000
σ0.000
min2506.000-2515.000=-9.000
max2506.000-2515.000=-9.000
mean2.813-2.817=-0.004
σ0.008-0.018=-0.010
min2.803-2.802=0.001
max2.820-2.842=-0.022
policies=200
mean18131.622-18131.468=0.154
σ0.446-0.588=-0.142
min18131.317-18131.093=0.224
max18132.281-18132.345=-0.064
mean8400.000
σ0.000
min8400.000
max8400.000
mean2506.000-2515.000=-9.000
σ0.000
min2506.000-2515.000=-9.000
max2506.000-2515.000=-9.000
mean28.291-28.265=0.027
σ0.084-0.040=0.045
min28.207-28.220=-0.013
max28.399-28.302=0.097