Compare commits

Home / Compare 349253c0 .. 022f6331

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=-0.001
σ0.048-0.048=-0.000
min33.951-33.941=0.010
max34.110-34.112=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.081-0.081=0.001
σ0.004-0.004=0.000
min0.075-0.076=-0.000
max0.086-0.087=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.319=-0.002
σ0.003-0.003=-0.000
min23.313-23.314=-0.001
max23.322-23.324=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.066=-0.000
σ0.003-0.003=-0.000
min0.063-0.063=-0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.302=0.127
σ0.366-0.363=0.002
min1756.856-1756.728=0.129
max1758.023-1757.890=0.133
mean1649.600-1645.550=4.050
σ630.458-623.644=6.814
min636.000
max2836.000-2823.000=13.000
mean2.363-2.356=0.007
σ0.106-0.094=0.012
min2.107-2.232=-0.124
max2.657-2.651=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.572-326.455=0.117
σ0.060-0.030=0.030
min326.465-326.403=0.062
max326.609-326.475=0.133
mean2836.000-2823.000=13.000
σ0.000
min2836.000-2823.000=13.000
max2836.000-2823.000=13.000
mean0.430-0.422=0.008
σ0.015-0.002=0.013
min0.421-0.420=0.001
max0.455-0.425=0.030
iters=5
new-facts=1
prior-facts=6402
mean1988.735-1988.619=0.116
σ0.019-0.005=0.015
min1988.705-1988.613=0.092
max1988.750-1988.625=0.125
mean2836.000-2823.000=13.000
σ0.000
min2836.000-2823.000=13.000
max2836.000-2823.000=13.000
mean2.649-2.712=-0.064
σ0.076-0.109=-0.033
min2.561-2.635=-0.074
max2.766-2.897=-0.131
iters=5
new-facts=6402
prior-facts=1
mean4813.473-4813.458=0.015
σ7.810-7.698=0.112
min4809.615-4809.943=-0.328
max4827.439-4827.229=0.211
mean2836.000-2823.000=13.000
σ0.000
min2836.000-2823.000=13.000
max2836.000-2823.000=13.000
mean8.910-8.779=0.131
σ0.239-0.293=-0.054
min8.635-8.414=0.221
max9.130-9.119=0.012
iters=5
new-facts=6402
prior-facts=6402
mean5001.076-5000.871=0.205
σ0.143-0.328=-0.185
min5000.825-5000.285=0.540
max5001.182-5001.037=0.145
mean3030.000-3036.400=-6.400
σ200.259-194.235=6.023
min2836.000-2823.000=13.000
max3312.000-3314.000=-2.000
mean9.778-9.686=0.093
σ0.395-0.285=0.110
min9.189-9.265=-0.076
max10.217-10.020=0.197

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.950-1.055=-0.105
σ0.058-0.169=-0.111
min0.916-0.918=-0.002
max1.052-1.333=-0.282

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.569-464.440=0.129
σ574.775-574.773=0.002
min177.172-177.043=0.129
max1326.731-1326.599=0.133
mean88.250
σ8.500
min84.000
max101.000
mean2836.000-2823.000=13.000
σ0.000
min2836.000-2823.000=13.000
max2836.000-2823.000=13.000
mean0.437-0.410=0.026
σ0.308-0.265=0.044
min0.279-0.276=0.003
max0.899-0.807=0.091
policies=20
mean1772.067-1770.787=1.280
σ0.345-0.379=-0.034
min1771.831-1770.532=1.299
max1772.578-1771.351=1.228
mean840.000
σ0.000
min840.000
max840.000
mean2836.000-2823.000=13.000
σ0.000
min2836.000-2823.000=13.000
max2836.000-2823.000=13.000
mean2.791-2.798=-0.006
σ0.021-0.021=0.001
min2.776-2.782=-0.005
max2.823-2.828=-0.005
policies=200
mean17727.534-17715.029=12.506
σ0.556-0.438=0.118
min17727.147-17714.730=12.417
max17728.359-17715.679=12.679
mean8400.000
σ0.000
min8400.000
max8400.000
mean2836.000-2823.000=13.000
σ0.000
min2836.000-2823.000=13.000
max2836.000-2823.000=13.000
mean27.871-27.940=-0.069
σ0.405-0.428=-0.022
min27.434-27.511=-0.076
max28.301-28.315=-0.014