Compare commits

Home / Compare ac6290da .. 8fead471

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.563=0.005
σ0.047-0.045=0.001
min70.544-70.541=0.004
max70.697-70.691=0.006
mean413.000-413.800=-0.800
σ0.000-0.422=-0.422
min413.000
max413.000-414.000=-1.000
mean0.161-0.159=0.002
σ0.003-0.004=-0.001
min0.158-0.155=0.003
max0.168-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.289-21.287=0.001
σ0.003-0.003=0.000
min21.282-21.282=-0.001
max21.293-21.290=0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.062-0.062=0.000
σ0.004-0.003=0.001
min0.058-0.059=-0.000
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.372=0.001
σ0.360-0.362=-0.002
min1752.801-1752.805=-0.004
max1753.962-1753.973=-0.010
mean1638.700-1660.250=-21.550
σ633.678-637.270=-3.592
min629.000-618.000=11.000
max2849.000-2811.000=38.000
mean2.726-2.847=-0.121
σ0.236-0.171=0.065
min2.287-2.617=-0.330
max3.102-3.376=-0.275

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.761-271.755=0.005
σ0.006-0.006=-0.000
min271.753-271.746=0.008
max271.769-271.762=0.007
mean2849.000-2811.000=38.000
σ0.000
min2849.000-2811.000=38.000
max2849.000-2811.000=38.000
mean0.380-0.381=-0.002
σ0.004-0.005=-0.001
min0.376-0.376=0.000
max0.386-0.388=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.172-1932.188=-0.016
σ0.012-0.011=0.001
min1932.158-1932.174=-0.016
max1932.186-1932.203=-0.016
mean2849.000-2811.000=38.000
σ0.000
min2849.000-2811.000=38.000
max2849.000-2811.000=38.000
mean2.903-2.982=-0.080
σ0.150-0.150=-0.000
min2.716-2.732=-0.016
max3.069-3.131=-0.062
iters=5
new-facts=6402
prior-facts=1
mean4752.931-4752.830=0.101
σ0.892-0.965=-0.073
min4752.375-4752.214=0.162
max4754.515-4754.530=-0.015
mean2849.000-2811.000=38.000
σ0.000
min2849.000-2811.000=38.000
max2849.000-2811.000=38.000
mean8.483-8.401=0.081
σ0.595-0.771=-0.176
min7.631-7.743=-0.111
max9.179-9.397=-0.217
iters=5
new-facts=6402
prior-facts=6402
mean4943.231-4943.311=-0.080
σ0.200-0.154=0.046
min4943.004-4943.038=-0.033
max4943.399-4943.406=-0.008
mean3020.400-3028.600=-8.200
σ249.094-285.246=-36.152
min2849.000-2811.000=38.000
max3413.000-3462.000=-49.000
mean8.381-8.460=-0.079
σ0.020-0.138=-0.117
min8.350-8.362=-0.012
max8.396-8.702=-0.306

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.079=-0.002
σ0.187-0.182=0.005
min0.927-0.932=-0.005
max1.390-1.380=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.861-467.864=-0.002
σ575.926-575.931=-0.005
min179.891-179.890=0.001
max1331.751-1331.760=-0.009
mean86.250
σ8.500
min82.000
max99.000
mean2849.000-2811.000=38.000
σ0.000
min2849.000-2811.000=38.000
max2849.000-2811.000=38.000
mean0.443-0.484=-0.041
σ0.303-0.398=-0.095
min0.290-0.284=0.006
max0.897-1.081=-0.184
policies=20
mean1799.197-1799.176=0.021
σ0.394-0.367=0.027
min1798.917-1798.912=0.005
max1799.777-1799.720=0.057
mean820.000
σ0.000
min820.000
max820.000
mean2849.000-2811.000=38.000
σ0.000
min2849.000-2811.000=38.000
max2849.000-2811.000=38.000
mean2.859-2.823=0.036
σ0.025-0.048=-0.023
min2.823-2.790=0.033
max2.877-2.894=-0.017
policies=200
mean17998.519-17998.393=0.126
σ0.456-0.599=-0.142
min17998.217-17997.993=0.224
max17999.195-17999.274=-0.079
mean8200.000
σ0.000
min8200.000
max8200.000
mean2849.000-2811.000=38.000
σ0.000
min2849.000-2811.000=38.000
max2849.000-2811.000=38.000
mean28.347-28.177=0.171
σ0.425-0.243=0.182
min27.898-28.016=-0.118
max28.907-28.535=0.371