Compare commits

Home / Compare 26b60803 .. 0b8ca2d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.562=0.000
σ0.046-0.049=-0.002
min70.540-70.532=0.008
max70.693-70.699=-0.005
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.156=0.004
σ0.004-0.005=-0.002
min0.152-0.150=0.002
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.286-21.289=-0.003
σ0.002-0.011=-0.010
min21.284-21.282=0.002
max21.289-21.320=-0.031
mean414.000
σ0.000
min414.000
max414.000
mean0.060-0.062=-0.002
σ0.003-0.004=-0.001
min0.058-0.058=-0.000
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1753.070=0.303
σ0.360-0.361=-0.001
min1752.805-1752.500=0.305
max1753.937-1753.656=0.281
mean1661.000-1657.500=3.500
σ634.467-632.509=1.958
min618.000
max2778.000-2765.000=13.000
mean2.729-2.778=-0.050
σ0.217-0.112=0.105
min2.086-2.508=-0.422
max2.993-2.973=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.752-271.382=0.370
σ0.006-0.007=-0.000
min271.743-271.372=0.371
max271.759-271.391=0.368
mean2778.000-2765.000=13.000
σ0.000
min2778.000-2765.000=13.000
max2778.000-2765.000=13.000
mean0.383-0.379=0.003
σ0.005-0.006=-0.001
min0.380-0.374=0.006
max0.392-0.389=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.189-1931.816=0.373
σ0.011-0.002=0.008
min1932.178-1931.813=0.365
max1932.203-1931.818=0.385
mean2778.000-2765.000=13.000
σ0.000
min2778.000-2765.000=13.000
max2778.000-2765.000=13.000
mean2.882-2.912=-0.030
σ0.285-0.168=0.117
min2.505-2.658=-0.153
max3.187-3.094=0.093
iters=5
new-facts=6402
prior-facts=1
mean4752.902-4752.540=0.362
σ0.882-0.853=0.030
min4752.400-4752.047=0.354
max4754.468-4754.055=0.414
mean2778.000-2765.000=13.000
σ0.000
min2778.000-2765.000=13.000
max2778.000-2765.000=13.000
mean8.704-8.512=0.192
σ0.475-0.496=-0.020
min7.896-7.745=0.151
max9.094-9.005=0.089
iters=5
new-facts=6402
prior-facts=6402
mean4943.369-4943.005=0.364
σ0.016-0.015=0.000
min4943.352-4942.982=0.370
max4943.387-4943.023=0.364
mean3022.000-3045.800=-23.800
σ229.290-252.112=-22.822
min2778.000-2765.000=13.000
max3330.000-3395.000=-65.000
mean8.730-8.538=0.192
σ0.187-0.170=0.017
min8.552-8.327=0.225
max9.033-8.788=0.245

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.123-1.035=0.088
σ0.259-0.143=0.116
min0.943-0.937=0.006
max1.573-1.263=0.310

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.861-467.414=0.446
σ575.925-575.929=-0.004
min179.888-179.441=0.447
max1331.747-1331.307=0.440
mean86.250
σ8.500
min82.000
max99.000
mean2778.000-2765.000=13.000
σ0.000
min2778.000-2765.000=13.000
max2778.000-2765.000=13.000
mean0.484-0.467=0.017
σ0.288-0.372=-0.083
min0.286-0.278=0.007
max0.898-1.024=-0.127
policies=20
mean1799.166-1794.685=4.481
σ0.337-0.358=-0.020
min1798.918-1794.485=4.433
max1799.664-1795.221=4.444
mean820.000
σ0.000
min820.000
max820.000
mean2778.000-2765.000=13.000
σ0.000
min2778.000-2765.000=13.000
max2778.000-2765.000=13.000
mean2.815-2.798=0.017
σ0.040-0.031=0.009
min2.773-2.771=0.002
max2.869-2.841=0.028
policies=200
mean17998.407-17953.554=44.853
σ0.594-0.433=0.161
min17997.996-17953.306=44.690
max17999.286-17954.202=45.084
mean8200.000
σ0.000
min8200.000
max8200.000
mean2778.000-2765.000=13.000
σ0.000
min2778.000-2765.000=13.000
max2778.000-2765.000=13.000
mean28.290-28.239=0.051
σ0.093-0.316=-0.223
min28.201-27.962=0.239
max28.421-28.693=-0.272