Compare commits

Home / Compare eafaf9cc .. 1de2e6d1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.432-55.692=-1.260
σ0.050-0.052=-0.002
min54.393-55.657=-1.264
max54.569-55.834=-1.265
mean413.000-419.300=-6.300
σ0.000-0.483=-0.483
min413.000-419.000=-6.000
max413.000-420.000=-7.000
mean0.137-0.136=0.001
σ0.003-0.004=-0.000
min0.133-0.129=0.004
max0.141-0.142=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.761-44.204=-0.443
σ0.005-0.006=-0.001
min43.748-44.195=-0.447
max43.768-44.211=-0.444
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.116-0.121=-0.005
σ0.004-0.004=-0.000
min0.111-0.118=-0.007
max0.123-0.127=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1764.659-1763.720=0.939
σ0.367-0.367=-0.001
min1764.085-1763.143=0.941
max1765.256-1764.313=0.942
mean1642.350-1646.700=-4.350
σ645.814-636.043=9.771
min630.000-648.000=-18.000
max2731.000-2843.000=-112.000
mean2.528-2.346=0.182
σ0.259-0.084=0.175
min2.280-2.209=0.071
max3.128-2.583=0.545

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean345.003-343.134=1.869
σ0.069-0.068=0.001
min344.880-343.013=1.867
max345.042-343.173=1.869
mean2731.000-2843.000=-112.000
σ0.000
min2731.000-2843.000=-112.000
max2731.000-2843.000=-112.000
mean0.450-0.443=0.007
σ0.019-0.005=0.013
min0.435-0.439=-0.004
max0.476-0.449=0.027
iters=5
new-facts=1
prior-facts=6402
mean2007.175-2003.705=3.470
σ0.008-0.012=-0.004
min2007.168-2003.684=3.484
max2007.186-2003.713=3.472
mean2731.000-2843.000=-112.000
σ0.000
min2731.000-2843.000=-112.000
max2731.000-2843.000=-112.000
mean2.741-2.601=0.140
σ0.101-0.095=0.006
min2.631-2.508=0.122
max2.899-2.714=0.185
iters=5
new-facts=6402
prior-facts=1
mean4832.125-4827.392=4.734
σ7.731-7.768=-0.037
min4828.505-4823.766=4.738
max4845.952-4841.285=4.667
mean2731.000-2843.000=-112.000
σ0.000
min2731.000-2843.000=-112.000
max2731.000-2843.000=-112.000
mean9.013-8.619=0.394
σ0.761-0.840=-0.079
min7.789-7.720=0.069
max9.591-9.424=0.166
iters=5
new-facts=6402
prior-facts=6402
mean5019.593-5014.857=4.736
σ0.031-0.123=-0.092
min5019.558-5014.644=4.915
max5019.644-5014.950=4.694
mean3014.000-3063.400=-49.400
σ237.072-291.733=-54.662
min2731.000-2843.000=-112.000
max3298.000-3516.000=-218.000
mean10.067-8.547=1.520
σ0.542-0.099=0.442
min9.483-8.501=0.983
max10.939-8.725=2.214

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.979-0.951=0.028
σ0.140-0.057=0.083
min0.913-0.914=-0.001
max1.228-1.049=0.180

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.527-465.060=1.467
σ574.787-574.253=0.535
min179.125-177.921=1.204
max1328.708-1326.439=2.269
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean2731.000-2843.000=-112.000
σ0.000
min2731.000-2843.000=-112.000
max2731.000-2843.000=-112.000
mean0.476-0.465=0.010
σ0.403-0.365=0.038
min0.272-0.281=-0.009
max1.081-1.013=0.067
policies=20
mean1791.547-1779.500=12.048
σ0.380-0.348=0.032
min1791.289-1779.290=11.999
max1792.112-1780.016=12.095
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean2731.000-2843.000=-112.000
σ0.000
min2731.000-2843.000=-112.000
max2731.000-2843.000=-112.000
mean2.771-2.830=-0.059
σ0.035-0.014=0.021
min2.737-2.816=-0.079
max2.819-2.849=-0.030
policies=200
mean17922.986-17801.219=121.766
σ0.506-0.707=-0.201
min17922.674-17800.192=122.481
max17923.740-17801.723=122.018
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean2731.000-2843.000=-112.000
σ0.000
min2731.000-2843.000=-112.000
max2731.000-2843.000=-112.000
mean27.772-28.265=-0.492
σ0.087-0.521=-0.433
min27.712-27.703=0.009
max27.901-28.878=-0.977