Compare commits

Home / Compare 2ccd9b01 .. 59e3210d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=0.001
σ0.055-0.053=0.001
min35.233-35.235=-0.002
max35.417-35.413=0.004
mean415.000-415.700=-0.700
σ0.000-0.483=-0.483
min415.000
max415.000-416.000=-1.000
mean0.084-0.085=-0.001
σ0.003-0.003=0.000
min0.081-0.083=-0.002
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.768-23.770=-0.001
σ0.003-0.003=0.000
min23.763-23.767=-0.004
max23.771-23.775=-0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.066-0.068=-0.002
σ0.004-0.003=0.001
min0.061-0.066=-0.005
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.471-1756.471=0.000
σ0.365-0.366=-0.001
min1755.896-1755.894=0.001
max1757.055-1757.064=-0.009
mean1658.700-1648.450=10.250
σ641.986-639.307=2.679
min629.000-627.000=2.000
max2779.000-2824.000=-45.000
mean2.346-2.324=0.023
σ0.127-0.083=0.045
min2.219-2.234=-0.015
max2.773-2.505=0.268

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.690-324.704=-0.014
σ0.051-0.029=0.022
min324.601-324.653=-0.052
max324.726-324.726=-0.000
mean2779.000-2824.000=-45.000
σ0.000
min2779.000-2824.000=-45.000
max2779.000-2824.000=-45.000
mean0.426-0.423=0.003
σ0.001-0.001=-0.000
min0.424-0.421=0.003
max0.427-0.425=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.251-1985.246=0.004
σ0.015-0.014=0.000
min1985.230-1985.227=0.003
max1985.263-1985.258=0.005
mean2779.000-2824.000=-45.000
σ0.000
min2779.000-2824.000=-45.000
max2779.000-2824.000=-45.000
mean2.610-2.657=-0.048
σ0.087-0.097=-0.010
min2.518-2.548=-0.030
max2.723-2.785=-0.062
iters=5
new-facts=6402
prior-facts=1
mean4808.859-4808.865=-0.006
σ7.670-7.688=-0.018
min4805.377-4805.341=0.036
max4822.579-4822.617=-0.038
mean2779.000-2824.000=-45.000
σ0.000
min2779.000-2824.000=-45.000
max2779.000-2824.000=-45.000
mean9.008-8.880=0.128
σ0.215-0.245=-0.030
min8.843-8.467=0.376
max9.361-9.116=0.245
iters=5
new-facts=6402
prior-facts=6402
mean4996.461-4996.392=0.069
σ0.015-0.138=-0.123
min4996.448-4996.145=0.303
max4996.484-4996.464=0.021
mean3017.200-3055.600=-38.400
σ303.488-302.639=0.849
min2779.000-2824.000=-45.000
max3484.000-3523.000=-39.000
mean8.605-8.446=0.159
σ0.157-0.158=-0.001
min8.476-8.277=0.199
max8.862-8.694=0.168

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.968-0.976=-0.008
σ0.071-0.069=0.001
min0.907-0.916=-0.009
max1.046-1.053=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.953-462.954=-0.000
σ574.251-574.252=-0.001
min175.819-175.817=0.002
max1324.330-1324.331=-0.001
mean86.250
σ8.500
min82.000
max99.000
mean2779.000-2824.000=-45.000
σ0.000
min2779.000-2824.000=-45.000
max2779.000-2824.000=-45.000
mean0.431-0.419=0.012
σ0.297-0.294=0.003
min0.281-0.263=0.018
max0.876-0.859=0.017
policies=20
mean1758.485-1758.485=0.001
σ0.346-0.355=-0.009
min1758.257-1758.249=0.008
max1758.998-1759.012=-0.013
mean820.000
σ0.000
min820.000
max820.000
mean2779.000-2824.000=-45.000
σ0.000
min2779.000-2824.000=-45.000
max2779.000-2824.000=-45.000
mean2.796-2.797=-0.001
σ0.005-0.008=-0.003
min2.790-2.787=0.002
max2.800-2.807=-0.007
policies=200
mean17590.241-17590.954=-0.713
σ0.410-0.654=-0.244
min17589.975-17589.997=-0.022
max17590.848-17591.376=-0.528
mean8200.000
σ0.000
min8200.000
max8200.000
mean2779.000-2824.000=-45.000
σ0.000
min2779.000-2824.000=-45.000
max2779.000-2824.000=-45.000
mean27.506-27.845=-0.339
σ0.118-0.348=-0.230
min27.334-27.541=-0.207
max27.602-28.198=-0.596