Compare commits

Home / Compare 9186c0f2 .. ec130fd4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.782=-0.080
σ0.045-0.047=-0.002
min70.673-70.747=-0.074
max70.826-70.911=-0.084
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.161-0.158=0.003
σ0.003-0.005=-0.001
min0.158-0.151=0.007
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.409-21.492=-0.083
σ0.002-0.002=-0.000
min21.406-21.489=-0.083
max21.412-21.496=-0.084
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.065-0.067=-0.002
σ0.003-0.003=-0.000
min0.064-0.064=-0.000
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.093=0.837
σ0.361-0.361=0.000
min1754.367-1753.533=0.834
max1755.516-1754.678=0.837
mean1628.250-1673.550=-45.300
σ619.757-642.540=-22.784
min623.000-672.000=-49.000
max2757.000-2649.000=108.000
mean2.814-2.758=0.055
σ0.252-0.238=0.013
min2.286-2.259=0.027
max3.114-3.136=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.788-271.599=1.189
σ0.006-0.006=0.001
min272.781-271.590=1.191
max272.794-271.604=1.190
mean2757.000-2649.000=108.000
σ0.000
min2757.000-2649.000=108.000
max2757.000-2649.000=108.000
mean0.382-0.385=-0.003
σ0.008-0.004=0.004
min0.377-0.381=-0.005
max0.395-0.391=0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.230-1931.982=1.248
σ0.004-0.019=-0.015
min1933.227-1931.957=1.269
max1933.238-1932.006=1.231
mean2757.000-2649.000=108.000
σ0.000
min2757.000-2649.000=108.000
max2757.000-2649.000=108.000
mean3.044-2.536=0.507
σ0.348-0.112=0.236
min2.735-2.412=0.323
max3.593-2.699=0.894
iters=5
new-facts=6402
prior-facts=1
mean4756.641-4752.724=3.917
σ7.438-0.912=6.526
min4752.497-4752.245=0.253
max4769.918-4754.350=15.568
mean2757.000-2649.000=108.000
σ0.000
min2757.000-2649.000=108.000
max2757.000-2649.000=108.000
mean8.405-8.722=-0.316
σ0.362-0.338=0.024
min7.982-8.287=-0.304
max8.919-9.097=-0.179
iters=5
new-facts=6402
prior-facts=6402
mean4944.461-4943.210=1.251
σ0.020-0.015=0.005
min4944.433-4943.192=1.241
max4944.477-4943.222=1.256
mean3041.800-2953.800=88.000
σ272.668-334.478=-61.811
min2757.000-2649.000=108.000
max3422.000-3430.000=-8.000
mean8.483-8.496=-0.013
σ0.112-0.117=-0.005
min8.366-8.394=-0.027
max8.624-8.690=-0.066

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.012-1.222=-0.210
σ0.136-0.322=-0.186
min0.918-0.945=-0.027
max1.232-1.732=-0.500

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.337-468.633=-0.296
σ574.292-574.936=-0.644
min181.186-181.162=0.024
max1329.775-1331.036=-1.261
mean88.250
σ8.500
min84.000
max101.000
mean2757.000-2649.000=108.000
σ0.000
min2757.000-2649.000=108.000
max2757.000-2649.000=108.000
mean0.486-0.559=-0.073
σ0.405-0.544=-0.138
min0.282-0.286=-0.004
max1.094-1.375=-0.281
policies=20
mean1812.183-1811.952=0.232
σ0.380-0.396=-0.016
min1811.932-1811.676=0.256
max1812.748-1812.535=0.213
mean840.000
σ0.000
min840.000
max840.000
mean2757.000-2649.000=108.000
σ0.000
min2757.000-2649.000=108.000
max2757.000-2649.000=108.000
mean2.806-2.856=-0.050
σ0.009-0.014=-0.005
min2.795-2.842=-0.047
max2.816-2.875=-0.059
policies=200
mean18129.029-18126.467=2.561
σ0.398-0.590=-0.193
min18128.761-18126.112=2.649
max18129.619-18127.350=2.268
mean8400.000
σ0.000
min8400.000
max8400.000
mean2757.000-2649.000=108.000
σ0.000
min2757.000-2649.000=108.000
max2757.000-2649.000=108.000
mean28.428-28.722=-0.294
σ0.119-0.037=0.082
min28.322-28.674=-0.352
max28.586-28.759=-0.173