Compare commits

Home / Compare 9bc88156 .. 55a72312

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.730=0.052
σ0.045-0.047=-0.002
min70.755-70.704=0.051
max70.908-70.864=0.044
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.160=-0.001
σ0.004-0.003=0.001
min0.152-0.156=-0.004
max0.164-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.494-21.448=0.046
σ0.003-0.011=-0.009
min21.490-21.440=0.050
max21.499-21.480=0.019
mean414.000
σ0.000
min414.000
max414.000
mean0.066-0.065=0.002
σ0.003-0.003=0.000
min0.065-0.062=0.002
max0.075-0.072=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.526=-0.433
σ0.362-0.360=0.002
min1753.536-1753.952=-0.416
max1754.678-1755.103=-0.425
mean1642.150-1639.150=3.000
σ604.214-630.512=-26.298
min642.000-638.000=4.000
max2455.000-2838.000=-383.000
mean2.791-2.846=-0.056
σ0.201-0.118=0.083
min2.271-2.653=-0.382
max3.126-3.194=-0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.600-273.610=-2.010
σ0.006-0.009=-0.003
min271.594-273.598=-2.004
max271.608-273.622=-2.014
mean2455.000-2838.000=-383.000
σ0.000
min2455.000-2838.000=-383.000
max2455.000-2838.000=-383.000
mean0.383-0.389=-0.006
σ0.002-0.016=-0.014
min0.381-0.381=-0.000
max0.385-0.419=-0.033
iters=5
new-facts=1
prior-facts=6402
mean1932.006-1933.997=-1.991
σ0.011-0.008=0.003
min1931.991-1933.983=-1.992
max1932.021-1934.003=-1.983
mean2455.000-2838.000=-383.000
σ0.000
min2455.000-2838.000=-383.000
max2455.000-2838.000=-383.000
mean2.508-3.054=-0.545
σ0.094-0.106=-0.011
min2.393-2.960=-0.567
max2.623-3.178=-0.555
iters=5
new-facts=6402
prior-facts=1
mean4752.774-4754.759=-1.985
σ0.844-0.853=-0.009
min4752.254-4754.205=-1.951
max4754.271-4756.272=-2.001
mean2455.000-2838.000=-383.000
σ0.000
min2455.000-2838.000=-383.000
max2455.000-2838.000=-383.000
mean8.445-8.538=-0.093
σ0.488-0.517=-0.028
min7.851-7.855=-0.005
max8.945-9.308=-0.363
iters=5
new-facts=6402
prior-facts=6402
mean4943.138-4945.218=-2.080
σ0.167-0.027=0.140
min4942.840-4945.187=-2.346
max4943.233-4945.247=-2.014
mean3018.200-3057.600=-39.400
σ263.245-230.565=32.679
min2627.000-2838.000=-211.000
max3330.000-3390.000=-60.000
mean8.620-8.537=0.083
σ0.129-0.160=-0.031
min8.445-8.365=0.080
max8.746-8.790=-0.044

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.726-0.994=0.731
σ0.123-0.146=-0.024
min1.549-0.928=0.621
max1.819-1.256=0.562

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.632-472.837=-4.205
σ574.925-574.930=-0.005
min181.165-185.368=-4.202
max1331.020-1335.232=-4.213
mean88.250
σ8.500
min84.000
max101.000
mean2455.000-2838.000=-383.000
σ0.000
min2455.000-2838.000=-383.000
max2455.000-2838.000=-383.000
mean0.553-0.488=0.066
σ0.518-0.373=0.145
min0.288-0.299=-0.012
max1.331-1.047=0.284
policies=20
mean1811.964-1854.000=-42.036
σ0.393-0.368=0.026
min1811.703-1853.726=-42.023
max1812.545-1854.538=-41.993
mean840.000
σ0.000
min840.000
max840.000
mean2455.000-2838.000=-383.000
σ0.000
min2455.000-2838.000=-383.000
max2455.000-2838.000=-383.000
mean2.846-2.940=-0.093
σ0.027-0.011=0.015
min2.818-2.927=-0.109
max2.882-2.954=-0.072
policies=200
mean18126.638-18546.484=-419.846
σ0.590-0.488=0.102
min18126.241-18546.089=-419.847
max18127.497-18547.170=-419.673
mean8400.000
σ0.000
min8400.000
max8400.000
mean2455.000-2838.000=-383.000
σ0.000
min2455.000-2838.000=-383.000
max2455.000-2838.000=-383.000
mean28.691-29.014=-0.323
σ0.036-0.493=-0.457
min28.661-28.742=-0.081
max28.738-29.752=-1.014