Compare commits

Home / Compare e408f733 .. a660870d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.561=0.001
σ0.045-0.046=-0.002
min70.538-70.535=0.003
max70.688-70.692=-0.004
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.159-0.158=0.002
σ0.004-0.005=-0.002
min0.155-0.149=0.006
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.291-21.287=0.004
σ0.010-0.002=0.008
min21.283-21.284=-0.000
max21.319-21.291=0.028
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.065=-0.000
σ0.002-0.002=-0.000
min0.063-0.063=0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.374=0.001
σ0.360-0.360=-0.000
min1752.807-1752.813=-0.006
max1753.966-1753.959=0.007
mean1648.800-1654.650=-5.850
σ640.929-642.665=-1.736
min649.000-629.000=20.000
max2848.000-2886.000=-38.000
mean2.829-2.834=-0.005
σ0.133-0.232=-0.099
min2.491-2.316=0.175
max3.012-3.541=-0.528

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.759-271.758=0.001
σ0.008-0.005=0.003
min271.750-271.753=-0.004
max271.769-271.765=0.004
mean2848.000-2886.000=-38.000
σ0.000
min2848.000-2886.000=-38.000
max2848.000-2886.000=-38.000
mean0.383-0.381=0.002
σ0.004-0.004=0.000
min0.380-0.377=0.003
max0.389-0.386=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.180-1932.175=0.005
σ0.013-0.007=0.006
min1932.165-1932.168=-0.004
max1932.199-1932.184=0.015
mean2848.000-2886.000=-38.000
σ0.000
min2848.000-2886.000=-38.000
max2848.000-2886.000=-38.000
mean3.008-3.094=-0.086
σ0.203-0.097=0.106
min2.698-3.008=-0.310
max3.234-3.252=-0.017
iters=5
new-facts=6402
prior-facts=1
mean4752.924-4752.965=-0.041
σ0.953-0.881=0.073
min4752.346-4752.385=-0.039
max4754.615-4754.527=0.088
mean2848.000-2886.000=-38.000
σ0.000
min2848.000-2886.000=-38.000
max2848.000-2886.000=-38.000
mean8.594-8.243=0.351
σ0.601-0.501=0.099
min7.955-7.755=0.200
max9.360-9.031=0.329
iters=5
new-facts=6402
prior-facts=6402
mean4943.312-4943.307=0.005
σ0.168-0.166=0.002
min4943.013-4943.012=0.000
max4943.398-4943.402=-0.004
mean3075.800-3069.000=6.800
σ238.688-265.868=-27.180
min2848.000-2886.000=-38.000
max3419.000-3484.000=-65.000
mean8.751-8.479=0.272
σ0.348-0.217=0.131
min8.431-8.235=0.196
max9.308-8.790=0.518

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.998-1.118=-0.120
σ0.132-0.267=-0.135
min0.936-0.936=0.000
max1.234-1.529=-0.295

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.856-467.861=-0.005
σ575.927-575.930=-0.003
min179.887-179.886=0.001
max1331.747-1331.756=-0.009
mean86.250
σ8.500
min82.000
max99.000
mean2848.000-2886.000=-38.000
σ0.000
min2848.000-2886.000=-38.000
max2848.000-2886.000=-38.000
mean0.444-0.445=-0.000
σ0.303-0.302=0.000
min0.288-0.291=-0.003
max0.899-0.898=0.000
policies=20
mean1799.197-1799.164=0.033
σ0.375-0.382=-0.007
min1798.939-1798.900=0.040
max1799.749-1799.726=0.023
mean820.000
σ0.000
min820.000
max820.000
mean2848.000-2886.000=-38.000
σ0.000
min2848.000-2886.000=-38.000
max2848.000-2886.000=-38.000
mean2.879-2.880=-0.001
σ0.004-0.014=-0.010
min2.875-2.871=0.004
max2.885-2.900=-0.015
policies=200
mean17998.583-17998.455=0.128
σ0.446-0.365=0.081
min17998.325-17998.154=0.171
max17999.250-17998.987=0.263
mean8200.000
σ0.000
min8200.000
max8200.000
mean2848.000-2886.000=-38.000
σ0.000
min2848.000-2886.000=-38.000
max2848.000-2886.000=-38.000
mean28.574-28.481=0.093
σ0.385-0.467=-0.082
min28.102-28.070=0.032
max29.011-28.911=0.101