Compare commits

Home / Compare bc22af0a .. 71690533

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.375=0.000
σ0.060-0.056=0.004
min70.334-70.339=-0.005
max70.542-70.532=0.010
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.157-0.160=-0.003
σ0.006-0.002=0.004
min0.148-0.157=-0.009
max0.165-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.001
σ0.002-0.003=-0.000
min21.139-21.139=-0.000
max21.147-21.148=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.064=0.000
σ0.003-0.002=0.001
min0.062-0.062=-0.000
max0.073-0.070=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.199=0.001
σ0.362-0.361=0.002
min1751.628-1751.631=-0.003
max1752.801-1752.789=0.012
mean1652.150-1651.100=1.050
σ646.440-635.367=11.073
min644.000-646.000=-2.000
max2851.000-2849.000=2.000
mean2.795-2.811=-0.016
σ0.245-0.180=0.065
min2.174-2.337=-0.162
max3.073-3.091=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.931-269.934=-0.003
σ0.011-0.012=-0.001
min269.921-269.917=0.004
max269.944-269.945=-0.002
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean0.378-0.379=-0.001
σ0.007-0.009=-0.001
min0.368-0.368=0.000
max0.389-0.393=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.384-1930.393=-0.009
σ0.025-0.011=0.014
min1930.356-1930.379=-0.022
max1930.410-1930.408=0.002
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean2.553-2.648=-0.094
σ0.139-0.148=-0.009
min2.456-2.492=-0.036
max2.793-2.812=-0.019
iters=5
new-facts=6402
prior-facts=1
mean4750.835-4750.950=-0.115
σ0.840-0.764=0.076
min4750.301-4750.554=-0.254
max4752.317-4752.310=0.007
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean8.714-8.119=0.595
σ0.237-0.291=-0.053
min8.485-7.780=0.706
max9.027-8.563=0.464
iters=5
new-facts=6402
prior-facts=6402
mean4941.329-4941.252=0.077
σ0.092-0.127=-0.034
min4941.260-4941.060=0.200
max4941.439-4941.412=0.027
mean3013.800-3059.000=-45.200
σ183.104-269.864=-86.760
min2851.000-2849.000=2.000
max3297.000-3472.000=-175.000
mean8.580-8.491=0.089
σ0.219-0.081=0.137
min8.411-8.383=0.028
max8.886-8.574=0.312

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.994-0.993=0.001
σ0.145-0.144=0.001
min0.919-0.920=-0.001
max1.252-1.250=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.913-465.915=-0.002
σ575.762-575.769=-0.007
min178.018-178.021=-0.002
max1329.555-1329.569=-0.014
mean81.750
σ7.500
min78.000
max93.000
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean0.442-0.438=0.004
σ0.304-0.303=0.001
min0.283-0.283=0.000
max0.898-0.892=0.006
policies=20
mean1780.501-1780.491=0.010
σ0.350-0.338=0.012
min1780.250-1780.256=-0.006
max1781.013-1780.989=0.024
mean780.000
σ0.000
min780.000
max780.000
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean2.856-2.843=0.013
σ0.022-0.007=0.015
min2.839-2.833=0.006
max2.888-2.848=0.040
policies=200
mean17811.382-17811.253=0.130
σ0.450-0.426=0.025
min17811.076-17810.775=0.301
max17812.052-17811.811=0.241
mean7800.000
σ0.000
min7800.000
max7800.000
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean28.300-28.236=0.065
σ0.471-0.470=0.001
min27.754-27.722=0.032
max28.754-28.669=0.084