Compare commits

Home / Compare b44e612d .. 01507b20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045-73.046=-0.001
σ0.046-0.049=-0.003
min73.025-73.015=0.011
max73.174-73.183=-0.008
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.161-0.158=0.003
σ0.003-0.005=-0.003
min0.158-0.150=0.008
max0.166-0.166=0.000
cache=y
dps=1
iters=10
policies=100
mean23.741-23.741=-0.000
σ0.003-0.002=0.001
min23.737-23.737=-0.000
max23.747-23.744=0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.066-0.066=0.000
σ0.002-0.002=0.000
min0.064-0.064=0.000
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.785-1758.785=-0.001
σ0.359-0.362=-0.003
min1758.210-1758.219=-0.009
max1759.364-1759.368=-0.004
mean1661.650-1628.800=32.850
σ626.691-597.390=29.301
min625.000-652.000=-27.000
max2520.000-2428.000=92.000
mean2.753-2.756=-0.002
σ0.203-0.204=-0.001
min2.162-2.296=-0.135
max2.979-3.252=-0.274

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.016-324.019=-0.003
σ0.056-0.046=0.010
min323.917-323.939=-0.022
max324.052-324.048=0.004
mean2520.000-2428.000=92.000
σ0.000
min2520.000-2428.000=92.000
max2520.000-2428.000=92.000
mean0.430-0.428=0.002
σ0.006-0.001=0.005
min0.425-0.427=-0.002
max0.439-0.429=0.010
iters=5
new-facts=1
prior-facts=6402
mean1984.582-1984.597=-0.015
σ0.015-0.004=0.012
min1984.562-1984.594=-0.032
max1984.597-1984.602=-0.005
mean2520.000-2428.000=92.000
σ0.000
min2520.000-2428.000=92.000
max2520.000-2428.000=92.000
mean2.617-2.695=-0.078
σ0.117-0.184=-0.067
min2.497-2.550=-0.053
max2.773-2.965=-0.192
iters=5
new-facts=6402
prior-facts=1
mean4808.172-4808.075=0.097
σ7.882-7.878=0.004
min4804.075-4804.144=-0.070
max4822.258-4822.157=0.100
mean2520.000-2428.000=92.000
σ0.000
min2520.000-2428.000=92.000
max2520.000-2428.000=92.000
mean8.837-8.394=0.442
σ0.651-0.573=0.078
min7.713-7.732=-0.019
max9.281-8.885=0.396
iters=5
new-facts=6402
prior-facts=6402
mean4995.804-4995.735=0.069
σ0.022-0.150=-0.128
min4995.780-4995.471=0.309
max4995.833-4995.826=0.007
mean2972.200-2912.200=60.000
σ275.213-402.242=-127.029
min2605.000-2428.000=177.000
max3340.000-3425.000=-85.000
mean8.726-8.575=0.151
σ0.355-0.153=0.202
min8.441-8.431=0.009
max9.342-8.754=0.588

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.557-1.652=-0.096
σ0.243-0.211=0.032
min1.226-1.307=-0.081
max1.875-1.846=0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.329-468.325=0.004
σ574.234-574.231=0.003
min181.208-181.208=-0.000
max1329.679-1329.671=0.008
mean88.250
σ8.500
min84.000
max101.000
mean2520.000-2428.000=92.000
σ0.000
min2520.000-2428.000=92.000
max2520.000-2428.000=92.000
mean0.576-0.561=0.015
σ0.589-0.553=0.036
min0.281-0.280=0.001
max1.460-1.391=0.069
policies=20
mean1812.394-1812.415=-0.021
σ0.387-0.389=-0.002
min1812.144-1812.146=-0.002
max1812.969-1812.989=-0.021
mean840.000
σ0.000
min840.000
max840.000
mean2520.000-2428.000=92.000
σ0.000
min2520.000-2428.000=92.000
max2520.000-2428.000=92.000
mean2.806-2.805=0.001
σ0.013-0.016=-0.003
min2.794-2.784=0.010
max2.820-2.821=-0.001
policies=200
mean18131.554-18131.412=0.142
σ0.508-0.456=0.052
min18131.116-18131.102=0.014
max18132.282-18132.071=0.211
mean8400.000
σ0.000
min8400.000
max8400.000
mean2520.000-2428.000=92.000
σ0.000
min2520.000-2428.000=92.000
max2520.000-2428.000=92.000
mean28.248-28.343=-0.096
σ0.057-0.083=-0.026
min28.183-28.269=-0.086
max28.321-28.428=-0.107