Compare commits

Home / Compare a5ad1ab9 .. e2e482d8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.567=-0.002
σ0.044-0.045=-0.001
min70.532-70.537=-0.005
max70.686-70.692=-0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.154-0.160=-0.006
σ0.005-0.003=0.002
min0.147-0.157=-0.010
max0.162-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.289-21.288=0.000
σ0.003-0.003=0.000
min21.284-21.284=0.001
max21.294-21.292=0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.065=-0.000
σ0.003-0.003=0.000
min0.063-0.063=0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.655-1753.374=0.282
σ0.361-0.362=-0.002
min1753.084-1752.804=0.280
max1754.247-1753.954=0.292
mean1665.600-1662.100=3.500
σ653.695-637.753=15.942
min628.000-619.000=9.000
max2826.000-2813.000=13.000
mean2.816-2.774=0.042
σ0.260-0.120=0.141
min2.215-2.454=-0.240
max3.230-2.968=0.262

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.100-271.755=0.345
σ0.005-0.004=0.001
min272.093-271.747=0.346
max272.106-271.758=0.348
mean2826.000-2813.000=13.000
σ0.000
min2826.000-2813.000=13.000
max2826.000-2813.000=13.000
mean0.394-0.380=0.014
σ0.017-0.004=0.013
min0.374-0.377=-0.004
max0.418-0.387=0.030
iters=5
new-facts=1
prior-facts=6402
mean1932.522-1932.174=0.348
σ0.009-0.013=-0.004
min1932.511-1932.154=0.357
max1932.531-1932.189=0.342
mean2826.000-2813.000=13.000
σ0.000
min2826.000-2813.000=13.000
max2826.000-2813.000=13.000
mean3.058-3.016=0.042
σ0.164-0.042=0.122
min2.924-2.968=-0.045
max3.341-3.073=0.268
iters=5
new-facts=6402
prior-facts=1
mean4753.313-4752.873=0.439
σ0.831-0.922=-0.092
min4752.865-4752.415=0.450
max4754.796-4754.521=0.275
mean2826.000-2813.000=13.000
σ0.000
min2826.000-2813.000=13.000
max2826.000-2813.000=13.000
mean8.164-8.811=-0.647
σ0.382-0.217=0.165
min7.872-8.519=-0.646
max8.620-9.029=-0.409
iters=5
new-facts=6402
prior-facts=6402
mean4943.714-4943.373=0.341
σ0.014-0.020=-0.006
min4943.696-4943.349=0.347
max4943.734-4943.393=0.341
mean3040.200-3017.000=23.200
σ262.067-284.242=-22.175
min2826.000-2813.000=13.000
max3423.000-3471.000=-48.000
mean8.439-8.496=-0.057
σ0.185-0.148=0.036
min8.292-8.371=-0.079
max8.762-8.743=0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-1.076=-0.055
σ0.143-0.110=0.033
min0.928-0.935=-0.006
max1.254-1.243=0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.306-467.863=4.442
σ575.911-575.939=-0.028
min184.342-179.886=4.456
max1336.172-1331.771=4.401
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2826.000-2813.000=13.000
σ0.000
min2826.000-2813.000=13.000
max2826.000-2813.000=13.000
mean0.448-0.476=-0.028
σ0.309-0.386=-0.077
min0.290-0.281=0.009
max0.912-1.055=-0.143
policies=20
mean1843.670-1799.160=44.511
σ0.300-0.374=-0.074
min1843.466-1798.873=44.593
max1844.114-1799.710=44.404
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2826.000-2813.000=13.000
σ0.000
min2826.000-2813.000=13.000
max2826.000-2813.000=13.000
mean2.969-2.803=0.166
σ0.121-0.018=0.103
min2.844-2.785=0.059
max3.135-2.825=0.309
policies=200
mean18442.200-17998.394=443.806
σ0.550-0.485=0.065
min18441.866-17998.060=443.806
max18443.020-17999.106=443.914
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2826.000-2813.000=13.000
σ0.000
min2826.000-2813.000=13.000
max2826.000-2813.000=13.000
mean28.929-28.220=0.708
σ0.125-0.083=0.042
min28.779-28.113=0.666
max29.085-28.296=0.788