Compare commits

Home / Compare ca660578 .. 9e272b82

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.431-54.431=-0.001
σ0.049-0.048=0.001
min54.394-54.392=0.002
max54.566-54.563=0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.136-0.136=-0.000
σ0.005-0.004=0.001
min0.129-0.130=-0.001
max0.146-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean43.762-43.760=0.001
σ0.007-0.004=0.003
min43.749-43.754=-0.005
max43.776-43.767=0.009
mean412.200-416.000=-3.800
σ0.422-0.000=0.422
min412.000-416.000=-4.000
max413.000-416.000=-3.000
mean0.123-0.114=0.009
σ0.008-0.002=0.006
min0.115-0.112=0.003
max0.137-0.116=0.021

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1764.584-1764.849=-0.265
σ0.364-0.365=-0.001
min1764.008-1764.273=-0.265
max1765.171-1765.435=-0.265
mean1628.700-1648.250=-19.550
σ622.386-648.340=-25.954
min620.000-623.000=-3.000
max2762.000-2752.000=10.000
mean2.667-2.601=0.066
σ0.263-0.246=0.017
min2.313-2.283=0.030
max3.109-3.041=0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean344.929-345.171=-0.242
σ0.068-0.057=0.012
min344.807-345.070=-0.263
max344.965-345.204=-0.239
mean2762.000-2752.000=10.000
σ0.000
min2762.000-2752.000=10.000
max2762.000-2752.000=10.000
mean0.458-0.444=0.015
σ0.011-0.010=0.001
min0.444-0.438=0.006
max0.470-0.462=0.008
iters=5
new-facts=1
prior-facts=6402
mean2007.097-2007.364=-0.268
σ0.010-0.011=-0.001
min2007.082-2007.352=-0.269
max2007.105-2007.381=-0.276
mean2762.000-2752.000=10.000
σ0.000
min2762.000-2752.000=10.000
max2762.000-2752.000=10.000
mean2.734-2.767=-0.032
σ0.034-0.109=-0.074
min2.685-2.662=0.023
max2.766-2.944=-0.178
iters=5
new-facts=6402
prior-facts=1
mean4831.981-4832.114=-0.133
σ7.747-7.771=-0.023
min4828.427-4828.236=0.191
max4845.839-4846.008=-0.169
mean2762.000-2752.000=10.000
σ0.000
min2762.000-2752.000=10.000
max2762.000-2752.000=10.000
mean8.459-8.351=0.108
σ0.549-0.499=0.050
min7.846-7.875=-0.029
max9.154-9.148=0.006
iters=5
new-facts=6402
prior-facts=6402
mean5019.496-5019.707=-0.211
σ0.020-0.152=-0.133
min5019.475-5019.437=0.039
max5019.521-5019.797=-0.276
mean3004.200-3011.800=-7.600
σ299.670-306.889=-7.219
min2762.000-2752.000=10.000
max3448.000-3451.000=-3.000
mean9.387-9.739=-0.352
σ0.527-0.496=0.031
min8.619-8.901=-0.282
max9.913-10.116=-0.203

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.078-1.007=0.071
σ0.149-0.139=0.010
min0.927-0.915=0.011
max1.327-1.234=0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.131-466.723=-0.592
σ574.765-574.800=-0.035
min178.725-179.316=-0.592
max1328.278-1328.922=-0.644
mean90.250
σ8.500
min86.000
max103.000
mean2762.000-2752.000=10.000
σ0.000
min2762.000-2752.000=10.000
max2762.000-2752.000=10.000
mean0.501-0.541=-0.040
σ0.445-0.512=-0.067
min0.272-0.282=-0.009
max1.169-1.309=-0.140
policies=20
mean1787.532-1793.479=-5.947
σ0.376-0.383=-0.007
min1787.263-1793.211=-5.948
max1788.087-1794.046=-5.959
mean860.000
σ0.000
min860.000
max860.000
mean2762.000-2752.000=10.000
σ0.000
min2762.000-2752.000=10.000
max2762.000-2752.000=10.000
mean2.743-2.755=-0.012
σ0.017-0.009=0.007
min2.719-2.747=-0.028
max2.756-2.765=-0.008
policies=200
mean17882.835-17942.124=-59.288
σ0.490-0.519=-0.030
min17882.502-17941.858=-59.356
max17883.563-17942.903=-59.340
mean8600.000
σ0.000
min8600.000
max8600.000
mean2762.000-2752.000=10.000
σ0.000
min2762.000-2752.000=10.000
max2762.000-2752.000=10.000
mean27.785-27.886=-0.101
σ0.196-0.113=0.083
min27.607-27.759=-0.151
max28.053-28.006=0.047