Compare commits

Home / Compare fe8e2b03 .. b6df6f8b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.000
σ0.053-0.053=-0.000
min35.215-35.220=-0.005
max35.395-35.396=-0.001
mean415.700-413.000=2.700
σ0.483-0.000=0.483
min415.000-413.000=2.000
max416.000-413.000=3.000
mean0.086-0.084=0.001
σ0.004-0.003=0.001
min0.083-0.082=0.000
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.771=-0.001
σ0.004-0.003=0.002
min23.765-23.768=-0.002
max23.778-23.776=0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.067-0.068=-0.001
σ0.004-0.003=0.002
min0.062-0.066=-0.004
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.366=-0.002
σ0.366-0.366=-0.000
min1755.787-1755.788=-0.001
max1756.954-1756.955=-0.001
mean1646.600-1665.050=-18.450
σ634.173-616.724=17.449
min627.000-676.000=-49.000
max2828.000-2504.000=324.000
mean2.325-2.309=0.016
σ0.073-0.063=0.010
min2.241-2.242=-0.002
max2.475-2.427=0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.587-324.583=0.004
σ0.039-0.051=-0.012
min324.520-324.493=0.027
max324.621-324.611=0.010
mean2828.000-2504.000=324.000
σ0.000
min2828.000-2504.000=324.000
max2828.000-2504.000=324.000
mean0.424-0.427=-0.003
σ0.001-0.010=-0.009
min0.422-0.422=0.000
max0.425-0.445=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1985.138-1985.140=-0.002
σ0.006-0.011=-0.005
min1985.128-1985.123=0.005
max1985.144-1985.149=-0.006
mean2828.000-2504.000=324.000
σ0.000
min2828.000-2504.000=324.000
max2828.000-2504.000=324.000
mean2.558-2.670=-0.112
σ0.074-0.180=-0.106
min2.493-2.550=-0.057
max2.681-2.964=-0.283
iters=5
new-facts=6402
prior-facts=1
mean4808.770-4808.755=0.015
σ7.656-7.741=-0.085
min4805.293-4805.244=0.049
max4822.464-4822.602=-0.137
mean2828.000-2504.000=324.000
σ0.000
min2828.000-2504.000=324.000
max2828.000-2504.000=324.000
mean8.718-8.835=-0.116
σ0.379-0.683=-0.304
min8.078-7.787=0.291
max9.087-9.603=-0.517
iters=5
new-facts=6402
prior-facts=6402
mean4996.344-4996.343=0.001
σ0.021-0.014=0.007
min4996.319-4996.323=-0.004
max4996.368-4996.359=0.009
mean3071.800-2937.000=134.800
σ235.388-400.282=-164.893
min2828.000-2504.000=324.000
max3419.000-3473.000=-54.000
mean8.744-8.479=0.265
σ0.164-0.140=0.023
min8.510-8.365=0.145
max8.958-8.721=0.236

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.519=-0.516
σ0.068-0.260=-0.192
min0.922-1.090=-0.168
max1.057-1.798=-0.741

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.978-462.946=0.032
σ574.252-574.251=0.002
min175.837-175.816=0.020
max1324.357-1324.322=0.035
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2504.000=324.000
σ0.000
min2828.000-2504.000=324.000
max2828.000-2504.000=324.000
mean0.433-0.546=-0.112
σ0.297-0.548=-0.251
min0.283-0.270=0.013
max0.879-1.368=-0.489
policies=20
mean1758.715-1758.516=0.199
σ0.350-0.339=0.010
min1758.484-1758.282=0.202
max1759.235-1759.018=0.216
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2504.000=324.000
σ0.000
min2828.000-2504.000=324.000
max2828.000-2504.000=324.000
mean2.785-2.726=0.059
σ0.011-0.029=-0.018
min2.769-2.692=0.077
max2.794-2.763=0.031
policies=200
mean17593.164-17592.324=0.839
σ0.657-0.452=0.205
min17592.216-17591.982=0.234
max17593.631-17592.987=0.644
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2504.000=324.000
σ0.000
min2828.000-2504.000=324.000
max2828.000-2504.000=324.000
mean27.857-27.364=0.493
σ0.360-0.154=0.205
min27.548-27.205=0.344
max28.291-27.528=0.763