Compare commits

Home / Compare 7f0b3c24 .. d7e230e8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.781=-0.000
σ0.046-0.045=0.001
min70.754-70.751=0.003
max70.910-70.906=0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.158-0.157=0.001
σ0.005-0.004=0.001
min0.150-0.153=-0.003
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.002-0.003=-0.001
min21.489-21.490=-0.001
max21.497-21.499=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.065=-0.001
σ0.004-0.003=0.001
min0.060-0.063=-0.003
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.094=-0.000
σ0.359-0.360=-0.001
min1753.535-1753.531=0.005
max1754.671-1754.682=-0.010
mean1641.500-1668.550=-27.050
σ604.793-639.640=-34.848
min642.000-670.000=-28.000
max2457.000-2749.000=-292.000
mean2.768-2.853=-0.084
σ0.218-0.160=0.057
min2.182-2.439=-0.257
max3.145-3.081=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.958-271.956=0.003
σ0.003-0.006=-0.003
min271.954-271.949=0.005
max271.961-271.964=-0.003
mean2457.000-2749.000=-292.000
σ0.000
min2457.000-2749.000=-292.000
max2457.000-2749.000=-292.000
mean0.380-0.382=-0.002
σ0.001-0.001=0.000
min0.378-0.380=-0.003
max0.381-0.383=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.322-1932.318=0.004
σ0.005-0.012=-0.007
min1932.314-1932.310=0.004
max1932.326-1932.340=-0.014
mean2457.000-2749.000=-292.000
σ0.000
min2457.000-2749.000=-292.000
max2457.000-2749.000=-292.000
mean3.016-2.924=0.092
σ0.125-0.217=-0.092
min2.832-2.559=0.273
max3.182-3.128=0.054
iters=5
new-facts=6402
prior-facts=1
mean4752.811-4752.942=-0.131
σ1.099-1.013=0.086
min4752.021-4752.089=-0.068
max4754.694-4754.703=-0.008
mean2457.000-2749.000=-292.000
σ0.000
min2457.000-2749.000=-292.000
max2457.000-2749.000=-292.000
mean8.661-8.893=-0.232
σ0.595-0.156=0.439
min7.609-8.634=-1.025
max9.049-9.041=0.008
iters=5
new-facts=6402
prior-facts=6402
mean4943.554-4943.557=-0.003
σ0.021-0.015=0.006
min4943.525-4943.536=-0.011
max4943.575-4943.572=0.004
mean2937.800-2997.000=-59.200
σ411.036-228.579=182.456
min2457.000-2749.000=-292.000
max3474.000-3318.000=156.000
mean8.396-8.479=-0.083
σ0.086-0.112=-0.026
min8.323-8.339=-0.016
max8.540-8.650=-0.110

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.742-0.995=0.747
σ0.136-0.137=-0.001
min1.573-0.930=0.642
max1.912-1.240=0.673

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.658-468.662=-0.004
σ574.926-574.938=-0.012
min181.190-181.190=0.000
max1331.047-1331.069=-0.022
mean88.250
σ8.500
min84.000
max101.000
mean2457.000-2749.000=-292.000
σ0.000
min2457.000-2749.000=-292.000
max2457.000-2749.000=-292.000
mean0.561-0.582=-0.021
σ0.545-0.592=-0.047
min0.284-0.284=-0.001
max1.379-1.470=-0.091
policies=20
mean1812.197-1812.177=0.020
σ0.386-0.379=0.008
min1811.944-1811.925=0.020
max1812.769-1812.738=0.031
mean840.000
σ0.000
min840.000
max840.000
mean2457.000-2749.000=-292.000
σ0.000
min2457.000-2749.000=-292.000
max2457.000-2749.000=-292.000
mean2.834-2.833=0.001
σ0.021-0.014=0.007
min2.807-2.820=-0.013
max2.856-2.846=0.010
policies=200
mean18129.211-18129.203=0.008
σ0.473-0.499=-0.027
min18128.944-18128.924=0.020
max18129.918-18129.951=-0.033
mean8400.000
σ0.000
min8400.000
max8400.000
mean2457.000-2749.000=-292.000
σ0.000
min2457.000-2749.000=-292.000
max2457.000-2749.000=-292.000
mean28.566-28.561=0.004
σ0.094-0.014=0.080
min28.459-28.542=-0.083
max28.679-28.573=0.106