Compare commits

Home / Compare 1bc0c82e .. 825dc916

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.699=0.029
σ0.047-0.045=0.002
min70.700-70.673=0.027
max70.861-70.823=0.038
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.156-0.161=-0.005
σ0.003-0.002=0.001
min0.151-0.159=-0.007
max0.162-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.446-21.420=0.026
σ0.003-0.003=0.000
min21.441-21.415=0.026
max21.450-21.425=0.025
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.066-0.061=0.005
σ0.002-0.003=-0.001
min0.064-0.058=0.006
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.526-1754.456=0.070
σ0.360-0.360=0.000
min1753.953-1753.890=0.063
max1755.109-1755.038=0.071
mean1661.250-1662.900=-1.650
σ645.771-632.689=13.082
min627.000-673.000=-46.000
max2779.000-2686.000=93.000
mean2.815-2.831=-0.016
σ0.200-0.135=0.065
min2.389-2.537=-0.148
max3.353-3.038=0.315

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.608-273.500=0.108
σ0.006-0.005=0.001
min273.598-273.493=0.105
max273.614-273.506=0.108
mean2779.000-2686.000=93.000
σ0.000
min2779.000-2686.000=93.000
max2779.000-2686.000=93.000
mean0.389-0.373=0.016
σ0.011-0.002=0.009
min0.378-0.373=0.006
max0.403-0.376=0.026
iters=5
new-facts=1
prior-facts=6402
mean1933.991-1933.891=0.100
σ0.017-0.016=0.001
min1933.966-1933.865=0.101
max1934.012-1933.904=0.107
mean2779.000-2686.000=93.000
σ0.000
min2779.000-2686.000=93.000
max2779.000-2686.000=93.000
mean3.068-3.033=0.035
σ0.070-0.075=-0.004
min2.991-2.938=0.053
max3.137-3.112=0.025
iters=5
new-facts=6402
prior-facts=1
mean4754.689-4754.607=0.082
σ0.920-0.904=0.016
min4754.220-4754.138=0.082
max4756.331-4756.223=0.108
mean2779.000-2686.000=93.000
σ0.000
min2779.000-2686.000=93.000
max2779.000-2686.000=93.000
mean8.874-8.898=-0.024
σ0.282-0.146=0.136
min8.492-8.746=-0.254
max9.230-9.122=0.108
iters=5
new-facts=6402
prior-facts=6402
mean4945.219-4945.049=0.171
σ0.015-0.164=-0.149
min4945.204-4944.757=0.448
max4945.243-4945.137=0.106
mean3014.400-2960.000=54.400
σ298.513-264.631=33.883
min2779.000-2686.000=93.000
max3462.000-3364.000=98.000
mean8.403-8.427=-0.024
σ0.049-0.108=-0.060
min8.335-8.319=0.016
max8.461-8.579=-0.119

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.029-1.127=-0.098
σ0.152-0.144=0.008
min0.930-0.938=-0.008
max1.280-1.283=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.846-473.063=-0.217
σ574.926-575.932=-1.006
min185.371-185.092=0.279
max1335.235-1336.962=-1.726
mean88.250
σ8.500
min84.000
max101.000
mean2779.000-2686.000=93.000
σ0.000
min2779.000-2686.000=93.000
max2779.000-2686.000=93.000
mean0.487-0.565=-0.078
σ0.374-0.558=-0.184
min0.297-0.282=0.015
max1.047-1.401=-0.354
policies=20
mean1854.014-1851.241=2.773
σ0.364-0.374=-0.010
min1853.739-1850.991=2.748
max1854.540-1851.794=2.747
mean840.000
σ0.000
min840.000
max840.000
mean2779.000-2686.000=93.000
σ0.000
min2779.000-2686.000=93.000
max2779.000-2686.000=93.000
mean2.963-2.854=0.109
σ0.090-0.017=0.072
min2.868-2.840=0.028
max3.084-2.878=0.207
policies=200
mean18546.695-18519.471=27.225
σ0.445-0.505=-0.060
min18546.406-18519.146=27.260
max18547.355-18520.224=27.131
mean8400.000
σ0.000
min8400.000
max8400.000
mean2779.000-2686.000=93.000
σ0.000
min2779.000-2686.000=93.000
max2779.000-2686.000=93.000
mean28.786-28.860=-0.074
σ0.062-0.077=-0.015
min28.707-28.788=-0.082
max28.858-28.968=-0.110