Compare commits

Home / Compare 3d941d4d .. a2fbb7b5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.559-70.560=-0.001
σ0.047-0.048=-0.001
min70.528-70.528=-0.000
max70.689-70.694=-0.005
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.156-0.160=-0.004
σ0.005-0.003=0.001
min0.150-0.157=-0.007
max0.162-0.168=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.002=0.001
min21.286-21.285=0.001
max21.292-21.292=0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.000
min0.058-0.061=-0.003
max0.067-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.070-1753.072=-0.002
σ0.359-0.361=-0.002
min1752.496-1752.498=-0.002
max1753.645-1753.644=0.000
mean1658.650-1654.000=4.650
σ634.070-633.910=0.160
min616.000-628.000=-12.000
max2767.000-2850.000=-83.000
mean2.746-2.756=-0.011
σ0.214-0.219=-0.005
min2.145-2.250=-0.106
max2.963-3.010=-0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.289-271.278=0.011
σ0.009-0.011=-0.002
min271.281-271.266=0.015
max271.304-271.291=0.013
mean2767.000-2850.000=-83.000
σ0.000
min2767.000-2850.000=-83.000
max2767.000-2850.000=-83.000
mean0.380-0.387=-0.007
σ0.006-0.012=-0.005
min0.372-0.372=-0.000
max0.388-0.401=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1931.719-1931.718=0.001
σ0.015-0.007=0.008
min1931.700-1931.709=-0.009
max1931.734-1931.725=0.008
mean2767.000-2850.000=-83.000
σ0.000
min2767.000-2850.000=-83.000
max2767.000-2850.000=-83.000
mean2.929-3.030=-0.101
σ0.308-0.220=0.088
min2.393-2.806=-0.412
max3.143-3.372=-0.229
iters=5
new-facts=6402
prior-facts=1
mean4752.531-4752.478=0.052
σ0.814-0.909=-0.095
min4752.083-4751.908=0.175
max4753.983-4754.075=-0.092
mean2767.000-2850.000=-83.000
σ0.000
min2767.000-2850.000=-83.000
max2767.000-2850.000=-83.000
mean7.944-8.506=-0.562
σ0.317-0.632=-0.315
min7.699-7.812=-0.112
max8.439-9.185=-0.746
iters=5
new-facts=6402
prior-facts=6402
mean4942.841-4942.850=-0.009
σ0.166-0.147=0.020
min4942.545-4942.590=-0.045
max4942.936-4942.935=0.000
mean3049.200-3063.800=-14.600
σ341.825-265.251=76.574
min2767.000-2850.000=-83.000
max3562.000-3458.000=104.000
mean8.472-8.645=-0.173
σ0.181-0.151=0.029
min8.294-8.484=-0.190
max8.686-8.804=-0.118

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.042-1.058=-0.016
σ0.129-0.137=-0.008
min0.929-0.941=-0.012
max1.245-1.276=-0.031

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.028-467.028=-0.001
σ575.924-575.921=0.003
min179.058-179.064=-0.006
max1330.914-1330.910=0.004
mean84.250
σ8.500
min80.000
max97.000
mean2767.000-2850.000=-83.000
σ0.000
min2767.000-2850.000=-83.000
max2767.000-2850.000=-83.000
mean0.476-0.444=0.032
σ0.288-0.304=-0.015
min0.272-0.287=-0.015
max0.892-0.899=-0.008
policies=20
mean1790.867-1790.882=-0.015
σ0.321-0.362=-0.041
min1790.635-1790.622=0.013
max1791.342-1791.414=-0.071
mean800.000
σ0.000
min800.000
max800.000
mean2767.000-2850.000=-83.000
σ0.000
min2767.000-2850.000=-83.000
max2767.000-2850.000=-83.000
mean2.769-2.853=-0.084
σ0.020-0.012=0.008
min2.741-2.837=-0.097
max2.786-2.864=-0.078
policies=200
mean17915.153-17915.339=-0.186
σ0.388-0.451=-0.063
min17914.841-17915.054=-0.213
max17915.717-17916.009=-0.293
mean8000.000
σ0.000
min8000.000
max8000.000
mean2767.000-2850.000=-83.000
σ0.000
min2767.000-2850.000=-83.000
max2767.000-2850.000=-83.000
mean27.988-28.475=-0.487
σ0.114-0.510=-0.396
min27.829-27.953=-0.124
max28.073-28.987=-0.914