Compare commits

Home / Compare 5010fef9 .. 2c2f4757

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.314-33.978=19.336
σ0.367-0.049=0.318
min53.186-33.950=19.236
max54.358-34.115=20.243
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.137-0.084=0.052
σ0.004-0.003=0.001
min0.133-0.082=0.051
max0.144-0.092=0.052
cache=y
dps=1
iters=10
policies=100
mean42.542-23.317=19.225
σ0.006-0.003=0.003
min42.531-23.314=19.217
max42.553-23.322=19.231
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.120-0.065=0.055
σ0.003-0.002=0.001
min0.116-0.063=0.052
max0.125-0.072=0.054

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean989.862-1757.494=-767.632
σ1.269-0.365=0.904
min989.324-1756.921=-767.597
max995.208-1758.083=-762.875
mean1050.050-1666.150=-616.100
σ317.095-641.753=-324.657
min575.000-674.000=-99.000
max1662.000-2639.000=-977.000
mean1.567-2.386=-0.819
σ0.126-0.088=0.038
min1.407-2.264=-0.857
max1.995-2.547=-0.552

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.213-326.634=-46.421
σ0.012-0.051=-0.039
min280.195-326.545=-46.350
max280.227-326.669=-46.442
mean1662.000-2639.000=-977.000
σ0.000
min1662.000-2639.000=-977.000
max1662.000-2639.000=-977.000
mean0.371-0.424=-0.053
σ0.004-0.004=0.000
min0.368-0.420=-0.052
max0.378-0.429=-0.052
iters=5
new-facts=1
prior-facts=6402
mean1280.279-1988.809=-708.530
σ0.129-0.007=0.123
min1280.215-1988.803=-708.588
max1280.510-1988.819=-708.309
mean1662.000-2639.000=-977.000
σ0.000
min1662.000-2639.000=-977.000
max1662.000-2639.000=-977.000
mean1.955-2.685=-0.729
σ0.137-0.052=0.085
min1.856-2.643=-0.787
max2.167-2.768=-0.601
iters=5
new-facts=6402
prior-facts=1
mean1802.524-4813.585=-3011.061
σ6.955-7.766=-0.812
min1799.171-4809.665=-3010.494
max1814.947-4827.469=-3012.522
mean1662.000-2639.000=-977.000
σ0.000
min1662.000-2639.000=-977.000
max1662.000-2639.000=-977.000
mean4.193-8.221=-4.028
σ0.181-0.562=-0.381
min3.995-7.690=-3.695
max4.479-9.136=-4.657
iters=5
new-facts=6402
prior-facts=6402
mean2065.011-5001.060=-2936.049
σ0.011-0.197=-0.186
min2064.999-5000.830=-2935.832
max2065.028-5001.216=-2936.188
mean1852.200-2953.800=-1101.600
σ181.355-350.814=-169.459
min1662.000-2639.000=-977.000
max2089.000-3458.000=-1369.000
mean4.645-9.532=-4.887
σ0.174-0.588=-0.414
min4.494-8.494=-4.000
max4.915-9.938=-5.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-1.234=-0.115
σ0.260-0.284=-0.024
min0.905-1.038=-0.133
max1.520-1.713=-0.193

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean434.876-464.627=-29.750
σ572.350-574.786=-2.436
min148.701-177.231=-28.530
max1293.401-1326.806=-33.404
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1662.000-2639.000=-977.000
σ0.000
min1662.000-2639.000=-977.000
max1662.000-2639.000=-977.000
mean0.549-0.555=-0.006
σ0.590-0.560=0.030
min0.253-0.271=-0.017
max1.434-1.394=0.040
policies=20
mean1487.179-1772.681=-285.502
σ0.230-0.358=-0.128
min1487.032-1772.430=-285.398
max1487.522-1773.210=-285.689
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1662.000-2639.000=-977.000
σ0.000
min1662.000-2639.000=-977.000
max1662.000-2639.000=-977.000
mean2.509-2.717=-0.208
σ0.005-0.015=-0.010
min2.502-2.697=-0.195
max2.514-2.731=-0.217
policies=200
mean14879.409-17734.068=-2854.658
σ0.060-0.369=-0.309
min14879.324-17733.849=-2854.524
max14879.455-17734.620=-2855.165
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1662.000-2639.000=-977.000
σ0.000
min1662.000-2639.000=-977.000
max1662.000-2639.000=-977.000
mean25.305-27.517=-2.212
σ0.102-0.092=0.010
min25.188-27.385=-2.197
max25.416-27.585=-2.169