Compare commits

Home / Compare 93876c3b .. 71d4ae72

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.393=-0.002
σ0.046-0.044=0.003
min70.368-70.371=-0.003
max70.522-70.515=0.007
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.158-0.160=-0.002
σ0.005-0.003=0.002
min0.150-0.157=-0.007
max0.167-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.148=-0.003
σ0.003-0.011=-0.009
min21.140-21.140=-0.000
max21.148-21.179=-0.031
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.062-0.062=0.000
σ0.003-0.004=-0.000
min0.058-0.057=0.001
max0.066-0.067=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.698-1752.395=0.303
σ0.360-0.362=-0.002
min1752.125-1751.822=0.304
max1753.282-1752.984=0.298
mean1658.650-1637.750=20.900
σ631.548-603.263=28.285
min622.000-624.000=-2.000
max2777.000-2431.000=346.000
mean2.820-2.780=0.040
σ0.096-0.214=-0.117
min2.585-2.165=0.419
max2.975-3.044=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.605-270.240=0.365
σ0.003-0.008=-0.004
min270.601-270.231=0.370
max270.608-270.251=0.357
mean2777.000-2431.000=346.000
σ0.000
min2777.000-2431.000=346.000
max2777.000-2431.000=346.000
mean0.381-0.381=0.000
σ0.004-0.009=-0.005
min0.377-0.370=0.007
max0.387-0.395=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1931.051-1930.695=0.356
σ0.007-0.016=-0.009
min1931.045-1930.667=0.378
max1931.063-1930.708=0.355
mean2777.000-2431.000=346.000
σ0.000
min2777.000-2431.000=346.000
max2777.000-2431.000=346.000
mean2.934-2.544=0.389
σ0.176-0.130=0.047
min2.642-2.430=0.212
max3.102-2.740=0.362
iters=5
new-facts=6402
prior-facts=1
mean4751.792-4751.384=0.408
σ0.856-0.858=-0.002
min4751.313-4750.942=0.371
max4753.315-4752.917=0.398
mean2777.000-2431.000=346.000
σ0.000
min2777.000-2431.000=346.000
max2777.000-2431.000=346.000
mean8.441-8.607=-0.167
σ0.376-0.168=0.208
min7.906-8.481=-0.575
max8.911-8.882=0.029
iters=5
new-facts=6402
prior-facts=6402
mean4942.166-4941.791=0.376
σ0.152-0.163=-0.011
min4941.895-4941.500=0.395
max4942.255-4941.883=0.372
mean3058.400-2890.400=168.000
σ263.824-394.468=-130.643
min2777.000-2431.000=346.000
max3431.000-3435.000=-4.000
mean8.679-8.384=0.295
σ0.238-0.046=0.192
min8.420-8.348=0.073
max9.032-8.460=0.572

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-1.765=-0.711
σ0.183-0.095=0.088
min0.938-1.630=-0.692
max1.364-1.853=-0.489

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.205-466.745=0.460
σ575.946-575.926=0.020
min179.227-178.780=0.447
max1331.123-1330.634=0.490
mean86.250
σ8.500
min82.000
max99.000
mean2777.000-2431.000=346.000
σ0.000
min2777.000-2431.000=346.000
max2777.000-2431.000=346.000
mean0.482-0.579=-0.097
σ0.392-0.605=-0.213
min0.283-0.276=0.007
max1.069-1.486=-0.416
policies=20
mean1792.607-1788.115=4.492
σ0.355-0.377=-0.022
min1792.397-1787.876=4.521
max1793.137-1788.677=4.460
mean820.000
σ0.000
min820.000
max820.000
mean2777.000-2431.000=346.000
σ0.000
min2777.000-2431.000=346.000
max2777.000-2431.000=346.000
mean2.794-2.787=0.006
σ0.008-0.015=-0.007
min2.785-2.766=0.019
max2.803-2.800=0.003
policies=200
mean17932.957-17888.148=44.809
σ0.449-0.495=-0.046
min17932.660-17887.874=44.786
max17933.623-17888.890=44.733
mean8200.000
σ0.000
min8200.000
max8200.000
mean2777.000-2431.000=346.000
σ0.000
min2777.000-2431.000=346.000
max2777.000-2431.000=346.000
mean28.175-27.954=0.220
σ0.162-0.034=0.128
min28.043-27.904=0.139
max28.406-27.977=0.429