Compare commits

Home / Compare a8269ddc .. fc84fdbc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.310-33.979=19.331
σ0.367-0.048=0.319
min53.171-33.953=19.217
max54.353-34.112=20.241
mean417.300-415.000=2.300
σ0.483-0.000=0.483
min417.000-415.000=2.000
max418.000-415.000=3.000
mean0.136-0.084=0.051
σ0.005-0.003=0.002
min0.129-0.082=0.047
max0.144-0.090=0.054
cache=y
dps=1
iters=10
policies=100
mean42.545-23.317=19.228
σ0.013-0.003=0.010
min42.528-23.314=19.214
max42.574-23.323=19.251
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.118-0.066=0.053
σ0.003-0.003=-0.000
min0.115-0.064=0.052
max0.124-0.074=0.051

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean989.875-1757.493=-767.617
σ1.245-0.364=0.881
min989.292-1756.919=-767.628
max995.108-1758.080=-762.972
mean1055.200-1666.300=-611.100
σ294.917-623.379=-328.462
min622.000-689.000=-67.000
max1473.000-2760.000=-1287.000
mean1.531-2.375=-0.844
σ0.081-0.122=-0.041
min1.389-2.168=-0.779
max1.747-2.768=-1.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.215-326.632=-46.417
σ0.010-0.061=-0.052
min280.203-326.523=-46.320
max280.225-326.671=-46.445
mean1473.000-2760.000=-1287.000
σ0.000
min1473.000-2760.000=-1287.000
max1473.000-2760.000=-1287.000
mean0.370-0.429=-0.059
σ0.004-0.006=-0.002
min0.368-0.424=-0.057
max0.377-0.439=-0.062
iters=5
new-facts=1
prior-facts=6402
mean1280.283-1988.799=-708.516
σ0.124-0.015=0.109
min1280.214-1988.782=-708.568
max1280.502-1988.820=-708.318
mean1473.000-2760.000=-1287.000
σ0.000
min1473.000-2760.000=-1287.000
max1473.000-2760.000=-1287.000
mean1.841-2.679=-0.838
σ0.040-0.143=-0.103
min1.799-2.576=-0.777
max1.902-2.926=-1.024
iters=5
new-facts=6402
prior-facts=1
mean1802.580-4813.553=-3010.973
σ7.057-7.513=-0.455
min1799.178-4810.142=-3010.965
max1815.188-4826.992=-3011.804
mean1473.000-2760.000=-1287.000
σ0.000
min1473.000-2760.000=-1287.000
max1473.000-2760.000=-1287.000
mean4.305-8.923=-4.618
σ0.203-0.444=-0.242
min4.006-8.467=-4.461
max4.481-9.539=-5.058
iters=5
new-facts=6402
prior-facts=6402
mean2065.010-5001.131=-2936.122
σ0.011-0.156=-0.146
min2065.002-5000.855=-2935.853
max2065.028-5001.231=-2936.203
mean1802.000-2989.200=-1187.200
σ195.974-228.327=-32.352
min1561.000-2760.000=-1199.000
max1993.000-3322.000=-1329.000
mean4.412-9.645=-5.234
σ0.087-0.182=-0.095
min4.329-9.460=-5.131
max4.532-9.901=-5.369

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.793-1.003=0.791
σ0.064-0.141=-0.076
min1.702-0.912=0.790
max1.868-1.234=0.634

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean435.103-464.636=-29.534
σ572.812-574.772=-1.960
min148.692-177.240=-28.548
max1294.321-1326.795=-32.474
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1473.000-2760.000=-1287.000
σ0.000
min1473.000-2760.000=-1287.000
max1473.000-2760.000=-1287.000
mean0.524-0.433=0.090
σ0.539-0.310=0.229
min0.252-0.278=-0.026
max1.333-0.898=0.435
policies=20
mean1487.169-1772.712=-285.544
σ0.236-0.407=-0.172
min1487.007-1772.443=-285.436
max1487.519-1773.317=-285.799
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1473.000-2760.000=-1287.000
σ0.000
min1473.000-2760.000=-1287.000
max1473.000-2760.000=-1287.000
mean2.503-2.839=-0.336
σ0.022-0.076=-0.054
min2.471-2.799=-0.329
max2.518-2.953=-0.435
policies=200
mean14879.297-17733.884=-2854.587
σ0.101-0.432=-0.331
min14879.222-17733.480=-2854.258
max14879.442-17734.496=-2855.054
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1473.000-2760.000=-1287.000
σ0.000
min1473.000-2760.000=-1287.000
max1473.000-2760.000=-1287.000
mean25.315-27.476=-2.162
σ0.160-0.129=0.032
min25.178-27.321=-2.143
max25.505-27.616=-2.111