Compare commits

Home / Compare a64b78b7 .. a49f4fd0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.430-33.979=20.451
σ0.050-0.048=0.002
min54.394-33.953=20.441
max54.568-34.112=20.456
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.137-0.084=0.052
σ0.003-0.003=-0.001
min0.134-0.082=0.051
max0.140-0.090=0.050
cache=y
dps=1
iters=10
policies=100
mean43.760-23.317=20.442
σ0.003-0.003=-0.000
min43.756-23.314=20.442
max43.766-23.323=20.443
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.118-0.066=0.052
σ0.004-0.003=0.001
min0.114-0.064=0.051
max0.126-0.074=0.052

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1764.851-1757.493=7.359
σ0.365-0.364=0.001
min1764.274-1756.919=7.355
max1765.432-1758.080=7.352
mean1657.950-1666.300=-8.350
σ638.232-623.379=14.853
min622.000-689.000=-67.000
max2766.000-2760.000=6.000
mean2.629-2.375=0.254
σ0.288-0.122=0.165
min2.291-2.168=0.124
max3.261-2.768=0.493

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean337.088-326.632=10.456
σ18.105-0.061=18.043
min304.702-326.523=-21.821
max345.233-326.671=18.563
mean2766.000-2760.000=6.000
σ0.000
min2766.000-2760.000=6.000
max2766.000-2760.000=6.000
mean0.436-0.429=0.007
σ0.028-0.006=0.023
min0.386-0.424=-0.038
max0.455-0.439=0.016
iters=5
new-facts=1
prior-facts=6402
mean2007.367-1988.799=18.568
σ0.011-0.015=-0.004
min2007.350-1988.782=18.568
max2007.378-1988.820=18.558
mean2766.000-2760.000=6.000
σ0.000
min2766.000-2760.000=6.000
max2766.000-2760.000=6.000
mean2.778-2.679=0.099
σ0.133-0.143=-0.010
min2.683-2.576=0.107
max3.010-2.926=0.084
iters=5
new-facts=6402
prior-facts=1
mean4832.148-4813.553=18.595
σ7.809-7.513=0.296
min4828.173-4810.142=18.030
max4846.107-4826.992=19.115
mean2766.000-2760.000=6.000
σ0.000
min2766.000-2760.000=6.000
max2766.000-2760.000=6.000
mean8.687-8.923=-0.236
σ0.687-0.444=0.242
min7.762-8.467=-0.705
max9.334-9.539=-0.204
iters=5
new-facts=6402
prior-facts=6402
mean5019.703-5001.131=18.571
σ0.162-0.156=0.005
min5019.416-5000.855=18.561
max5019.791-5001.231=18.561
mean2992.200-2989.200=3.000
σ222.365-228.327=-5.962
min2766.000-2760.000=6.000
max3314.000-3322.000=-8.000
mean9.805-9.645=0.160
σ0.165-0.182=-0.017
min9.578-9.460=0.118
max10.038-9.901=0.137

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.003=0.023
σ0.126-0.141=-0.014
min0.912-0.912=-0.000
max1.222-1.234=-0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.710-464.636=2.074
σ574.760-574.772=-0.013
min179.317-177.240=2.077
max1328.849-1326.795=2.055
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean2766.000-2760.000=6.000
σ0.000
min2766.000-2760.000=6.000
max2766.000-2760.000=6.000
mean0.438-0.433=0.005
σ0.308-0.310=-0.002
min0.282-0.278=0.004
max0.900-0.898=0.002
policies=20
mean1793.485-1772.712=20.773
σ0.374-0.407=-0.033
min1793.212-1772.443=20.769
max1794.033-1773.317=20.716
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean2766.000-2760.000=6.000
σ0.000
min2766.000-2760.000=6.000
max2766.000-2760.000=6.000
mean2.834-2.839=-0.005
σ0.006-0.076=-0.070
min2.828-2.799=0.029
max2.841-2.953=-0.112
policies=200
mean17942.093-17733.884=208.209
σ0.509-0.432=0.077
min17941.777-17733.480=208.296
max17942.852-17734.496=208.356
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean2766.000-2760.000=6.000
σ0.000
min2766.000-2760.000=6.000
max2766.000-2760.000=6.000
mean27.863-27.476=0.386
σ0.252-0.129=0.123
min27.585-27.321=0.264
max28.137-27.616=0.521