Compare commits

Home / Compare 45dec630 .. dced144e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.782=0.000
σ0.046-0.047=-0.001
min70.747-70.749=-0.002
max70.909-70.910=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.162-0.161=0.001
σ0.003-0.003=0.000
min0.158-0.157=0.000
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.000
σ0.002-0.003=-0.001
min21.488-21.488=0.000
max21.495-21.497=-0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.063-0.065=-0.001
σ0.004-0.003=0.001
min0.058-0.063=-0.005
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.093=-0.001
σ0.362-0.362=-0.001
min1753.531-1753.528=0.003
max1754.683-1754.687=-0.004
mean1665.000-1665.550=-0.550
σ630.727-629.355=1.372
min666.000-668.000=-2.000
max2620.000-2616.000=4.000
mean2.794-2.733=0.061
σ0.140-0.217=-0.077
min2.368-2.166=0.203
max2.971-2.943=0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.954=0.001
σ0.004-0.006=-0.002
min271.950-271.946=0.005
max271.960-271.961=-0.001
mean2620.000-2616.000=4.000
σ0.000
min2620.000-2616.000=4.000
max2620.000-2616.000=4.000
mean0.385-0.382=0.003
σ0.006-0.001=0.005
min0.380-0.380=0.001
max0.395-0.383=0.013
iters=5
new-facts=1
prior-facts=6402
mean1932.324-1932.321=0.003
σ0.025-0.010=0.015
min1932.298-1932.305=-0.008
max1932.358-1932.330=0.028
mean2620.000-2616.000=4.000
σ0.000
min2620.000-2616.000=4.000
max2620.000-2616.000=4.000
mean2.899-2.984=-0.085
σ0.278-0.067=0.211
min2.433-2.894=-0.461
max3.178-3.065=0.113
iters=5
new-facts=6402
prior-facts=1
mean4753.059-4752.880=0.179
σ0.924-1.173=-0.249
min4752.595-4751.461=1.133
max4754.710-4754.718=-0.009
mean2620.000-2616.000=4.000
σ0.000
min2620.000-2616.000=4.000
max2620.000-2616.000=4.000
mean8.667-8.477=0.190
σ0.474-0.579=-0.105
min7.867-7.616=0.251
max8.995-9.012=-0.017
iters=5
new-facts=6402
prior-facts=6402
mean4943.562-4943.557=0.006
σ0.013-0.021=-0.007
min4943.546-4943.531=0.015
max4943.576-4943.577=-0.001
mean2966.400-2967.400=-1.000
σ262.096-261.280=0.816
min2620.000-2616.000=4.000
max3316.000-3293.000=23.000
mean8.610-8.491=0.119
σ0.188-0.094=0.094
min8.430-8.391=0.040
max8.927-8.645=0.281

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.261-1.324=-0.063
σ0.364-0.420=-0.056
min0.937-0.938=-0.001
max1.819-1.894=-0.075

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.660-468.657=0.003
σ574.933-574.934=-0.000
min181.188-181.189=-0.001
max1331.060-1331.058=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2620.000-2616.000=4.000
σ0.000
min2620.000-2616.000=4.000
max2620.000-2616.000=4.000
mean0.586-0.534=0.052
σ0.594-0.497=0.097
min0.281-0.283=-0.001
max1.476-1.280=0.197
policies=20
mean1812.176-1812.200=-0.024
σ0.391-0.394=-0.002
min1811.918-1811.936=-0.018
max1812.753-1812.780=-0.027
mean840.000
σ0.000
min840.000
max840.000
mean2620.000-2616.000=4.000
σ0.000
min2620.000-2616.000=4.000
max2620.000-2616.000=4.000
mean2.839-2.833=0.006
σ0.019-0.019=-0.000
min2.817-2.805=0.013
max2.859-2.848=0.011
policies=200
mean18129.191-18129.214=-0.023
σ0.527-0.441=0.086
min18128.801-18128.932=-0.131
max18129.968-18129.873=0.095
mean8400.000
σ0.000
min8400.000
max8400.000
mean2620.000-2616.000=4.000
σ0.000
min2620.000-2616.000=4.000
max2620.000-2616.000=4.000
mean28.668-28.575=0.093
σ0.136-0.054=0.083
min28.537-28.537=-0.001
max28.857-28.654=0.203