Compare commits

Home / Compare c50fb6c5 .. dbb78729

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.001
σ0.367-0.368=-0.001
min53.777-53.783=-0.006
max54.958-54.962=-0.005
mean414.000-414.800=-0.800
σ0.000-0.422=-0.422
min414.000
max414.000-415.000=-1.000
mean0.138-0.139=-0.001
σ0.004-0.004=0.001
min0.134-0.135=-0.002
max0.147-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=0.001
σ0.008-0.008=-0.001
min43.126-43.128=-0.002
max43.152-43.157=-0.005
mean414.900-415.000=-0.100
σ0.316-0.000=0.316
min414.000-415.000=-1.000
max415.000
mean0.121-0.119=0.002
σ0.003-0.004=-0.001
min0.118-0.113=0.004
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.811-991.813=-0.002
σ1.238-1.243=-0.005
min991.232-991.232=-0.000
max997.017-997.039=-0.023
mean1072.100-1068.000=4.100
σ314.090-318.957=-4.867
min617.000-602.000=15.000
max1651.000-1641.000=10.000
mean1.526-1.535=-0.009
σ0.071-0.059=0.012
min1.389-1.458=-0.070
max1.723-1.676=0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.405-285.409=-0.004
σ0.014-0.009=0.004
min285.385-285.396=-0.010
max285.422-285.421=0.002
mean1651.000-1641.000=10.000
σ0.000
min1651.000-1641.000=10.000
max1651.000-1641.000=10.000
mean0.370-0.375=-0.006
σ0.004-0.007=-0.003
min0.367-0.369=-0.002
max0.376-0.384=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1285.373-1285.376=-0.003
σ0.137-0.125=0.011
min1285.307-1285.315=-0.008
max1285.618-1285.600=0.018
mean1651.000-1641.000=10.000
σ0.000
min1651.000-1641.000=10.000
max1651.000-1641.000=10.000
mean1.866-2.122=-0.256
σ0.043-0.277=-0.234
min1.808-1.843=-0.035
max1.902-2.439=-0.537
iters=5
new-facts=6402
prior-facts=1
mean1807.702-1807.736=-0.033
σ6.990-6.991=-0.001
min1804.341-1804.381=-0.039
max1820.190-1820.225=-0.035
mean1651.000-1641.000=10.000
σ0.000
min1651.000-1641.000=10.000
max1651.000-1641.000=10.000
mean4.185-4.270=-0.084
σ0.224-0.169=0.055
min3.815-4.074=-0.260
max4.392-4.454=-0.062
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.199=-0.003
σ0.011-0.012=-0.002
min2070.182-2070.184=-0.003
max2070.212-2070.219=-0.007
mean1848.000-1852.000=-4.000
σ187.888-187.900=-0.012
min1651.000-1641.000=10.000
max2089.000-2088.000=1.000
mean4.513-4.610=-0.097
σ0.045-0.126=-0.080
min4.477-4.483=-0.006
max4.590-4.810=-0.220

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.217-1.121=0.096
σ0.341-0.195=0.146
min0.921-0.906=0.015
max1.794-1.404=0.390

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.788-436.785=0.002
σ572.361-572.351=0.010
min150.598-150.597=0.001
max1295.330-1295.312=0.018
mean90.250
σ8.500
min86.000
max103.000
mean1651.000-1641.000=10.000
σ0.000
min1651.000-1641.000=10.000
max1651.000-1641.000=10.000
mean0.514-0.529=-0.015
σ0.528-0.560=-0.032
min0.249-0.248=0.001
max1.306-1.370=-0.063
policies=20
mean1506.275-1506.266=0.009
σ0.241-0.229=0.012
min1506.120-1506.119=0.002
max1506.634-1506.608=0.026
mean860.000
σ0.000
min860.000
max860.000
mean1651.000-1641.000=10.000
σ0.000
min1651.000-1641.000=10.000
max1651.000-1641.000=10.000
mean2.521-2.513=0.009
σ0.017-0.007=0.010
min2.508-2.503=0.005
max2.545-2.520=0.025
policies=200
mean15070.270-15070.282=-0.012
σ0.070-0.071=-0.001
min15070.206-15070.204=0.002
max15070.368-15070.366=0.002
mean8600.000
σ0.000
min8600.000
max8600.000
mean1651.000-1641.000=10.000
σ0.000
min1651.000-1641.000=10.000
max1651.000-1641.000=10.000
mean25.388-25.416=-0.028
σ0.144-0.198=-0.054
min25.253-25.177=0.077
max25.537-25.637=-0.099