Compare commits

Home / Compare ccaf1d16 .. 8a4c2698

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.566=-0.003
σ0.046-0.048=-0.002
min70.539-70.533=0.006
max70.692-70.699=-0.008
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.159-0.156=0.002
σ0.003-0.004=-0.002
min0.156-0.150=0.006
max0.163-0.163=0.000
cache=y
dps=1
iters=10
policies=100
mean21.286-21.287=-0.001
σ0.004-0.003=0.001
min21.281-21.282=-0.001
max21.292-21.291=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.065=-0.002
σ0.003-0.003=0.000
min0.059-0.063=-0.004
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.562-1753.567=-0.005
σ0.360-0.360=-0.001
min1752.989-1752.991=-0.002
max1754.148-1754.145=0.003
mean1673.550-1663.850=9.700
σ638.357-646.255=-7.898
min688.000-686.000=2.000
max2815.000-2769.000=46.000
mean2.803-2.759=0.044
σ0.132-0.244=-0.112
min2.478-2.178=0.300
max2.992-3.007=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.016-272.012=0.004
σ0.010-0.008=0.001
min272.005-271.998=0.007
max272.028-272.021=0.007
mean2815.000-2769.000=46.000
σ0.000
min2815.000-2769.000=46.000
max2815.000-2769.000=46.000
mean0.392-0.388=0.004
σ0.015-0.009=0.006
min0.378-0.378=-0.000
max0.413-0.396=0.017
iters=5
new-facts=1
prior-facts=6402
mean1932.438-1932.437=0.000
σ0.016-0.017=-0.001
min1932.416-1932.413=0.003
max1932.458-1932.459=-0.001
mean2815.000-2769.000=46.000
σ0.000
min2815.000-2769.000=46.000
max2815.000-2769.000=46.000
mean2.953-2.944=0.010
σ0.203-0.132=0.071
min2.736-2.750=-0.013
max3.166-3.088=0.078
iters=5
new-facts=6402
prior-facts=1
mean4753.168-4753.028=0.139
σ0.838-0.575=0.263
min4752.694-4752.622=0.072
max4754.659-4754.030=0.629
mean2815.000-2769.000=46.000
σ0.000
min2815.000-2769.000=46.000
max2815.000-2769.000=46.000
mean8.468-8.645=-0.177
σ0.454-0.380=0.074
min7.724-8.135=-0.411
max8.868-9.165=-0.297
iters=5
new-facts=6402
prior-facts=6402
mean4943.632-4943.630=0.002
σ0.018-0.019=-0.001
min4943.610-4943.608=0.003
max4943.654-4943.651=0.003
mean3046.000-3001.200=44.800
σ241.436-219.704=21.733
min2815.000-2769.000=46.000
max3392.000-3303.000=89.000
mean8.628-8.532=0.095
σ0.146-0.100=0.046
min8.408-8.429=-0.021
max8.800-8.640=0.160

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.043-1.039=0.004
σ0.128-0.127=0.001
min0.928-0.924=0.003
max1.241-1.235=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.071-473.091=-0.021
σ575.918-575.935=-0.017
min185.107-185.112=-0.005
max1336.947-1336.993=-0.046
mean88.250
σ8.500
min84.000
max101.000
mean2815.000-2769.000=46.000
σ0.000
min2815.000-2769.000=46.000
max2815.000-2769.000=46.000
mean0.453-0.477=-0.024
σ0.304-0.384=-0.079
min0.295-0.283=0.012
max0.909-1.053=-0.144
policies=20
mean1851.400-1851.435=-0.035
σ0.325-0.377=-0.052
min1851.165-1851.178=-0.012
max1851.866-1851.994=-0.127
mean840.000
σ0.000
min840.000
max840.000
mean2815.000-2769.000=46.000
σ0.000
min2815.000-2769.000=46.000
max2815.000-2769.000=46.000
mean2.911-2.847=0.065
σ0.128-0.012=0.115
min2.830-2.831=-0.001
max3.102-2.859=0.243
policies=200
mean18520.948-18521.183=-0.236
σ0.588-0.492=0.096
min18520.387-18520.894=-0.507
max18521.775-18521.918=-0.143
mean8400.000
σ0.000
min8400.000
max8400.000
mean2815.000-2769.000=46.000
σ0.000
min2815.000-2769.000=46.000
max2815.000-2769.000=46.000
mean28.863-28.773=0.090
σ0.022-0.077=-0.056
min28.845-28.691=0.155
max28.892-28.854=0.038