Compare commits

Home / Compare 8b532b5f .. 241a6229

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-73.125=-37.880
σ0.053-0.052=0.002
min35.218-73.097=-37.879
max35.396-73.271=-37.875
mean412.000
σ0.000
min412.000
max412.000
mean0.084-0.160=-0.077
σ0.004-0.003=0.001
min0.077-0.158=-0.081
max0.092-0.166=-0.074
cache=y
dps=1
iters=10
policies=100
mean23.769-23.755=0.014
σ0.002-0.002=0.000
min23.766-23.751=0.014
max23.773-23.759=0.013
mean412.000
σ0.000
min412.000
max412.000
mean0.066-0.068=-0.002
σ0.004-0.004=0.000
min0.061-0.066=-0.005
max0.074-0.077=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.362-1755.820=0.542
σ0.365-0.360=0.005
min1755.786-1755.266=0.520
max1756.946-1756.406=0.541
mean1651.800-1604.850=46.950
σ644.917-636.386=8.530
min624.000-608.000=16.000
max2845.000-2753.000=92.000
mean2.343-2.765=-0.421
σ0.073-0.204=-0.131
min2.262-2.325=-0.064
max2.492-3.076=-0.584

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.581-321.047=3.533
σ0.055-0.048=0.008
min324.482-320.963=3.520
max324.611-321.080=3.531
mean2845.000-2753.000=92.000
σ0.000
min2845.000-2753.000=92.000
max2845.000-2753.000=92.000
mean0.426-0.421=0.005
σ0.002-0.002=0.000
min0.423-0.419=0.004
max0.427-0.423=0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.135-1981.620=3.515
σ0.011-0.017=-0.006
min1985.123-1981.590=3.532
max1985.145-1981.629=3.516
mean2845.000-2753.000=92.000
σ0.000
min2845.000-2753.000=92.000
max2845.000-2753.000=92.000
mean2.651-2.584=0.068
σ0.100-0.096=0.004
min2.570-2.453=0.116
max2.789-2.712=0.077
iters=5
new-facts=6402
prior-facts=1
mean4808.667-4805.012=3.655
σ7.717-7.880=-0.163
min4804.668-4800.602=4.066
max4822.460-4819.078=3.382
mean2845.000-2753.000=92.000
σ0.000
min2845.000-2753.000=92.000
max2845.000-2753.000=92.000
mean8.725-8.875=-0.150
σ0.595-0.277=0.317
min7.719-8.492=-0.773
max9.260-9.242=0.018
iters=5
new-facts=6402
prior-facts=6402
mean4996.274-4992.827=3.447
σ0.150-0.028=0.123
min4996.008-4992.791=3.216
max4996.375-4992.859=3.516
mean3018.600-3012.000=6.600
σ260.301-230.861=29.440
min2845.000-2753.000=92.000
max3429.000-3316.000=113.000
mean8.604-8.707=-0.103
σ0.163-0.228=-0.064
min8.461-8.455=0.006
max8.835-8.983=-0.148

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.980-1.006=-0.027
σ0.071-0.135=-0.065
min0.921-0.917=0.004
max1.062-1.226=-0.164

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.974-462.422=0.552
σ574.252-574.248=0.004
min175.838-175.292=0.546
max1324.352-1323.793=0.559
mean86.250
σ8.500
min82.000
max99.000
mean2845.000-2753.000=92.000
σ0.000
min2845.000-2753.000=92.000
max2845.000-2753.000=92.000
mean0.431-0.430=0.001
σ0.298-0.296=0.002
min0.279-0.282=-0.003
max0.878-0.874=0.004
policies=20
mean1758.696-1753.134=5.563
σ0.349-0.354=-0.005
min1758.462-1752.925=5.537
max1759.213-1753.662=5.550
mean820.000
σ0.000
min820.000
max820.000
mean2845.000-2753.000=92.000
σ0.000
min2845.000-2753.000=92.000
max2845.000-2753.000=92.000
mean2.794-2.777=0.018
σ0.015-0.082=-0.067
min2.783-2.710=0.072
max2.816-2.893=-0.077
policies=200
mean17593.396-17537.862=55.534
σ0.538-0.515=0.024
min17592.716-17537.584=55.132
max17593.855-17538.633=55.222
mean8200.000
σ0.000
min8200.000
max8200.000
mean2845.000-2753.000=92.000
σ0.000
min2845.000-2753.000=92.000
max2845.000-2753.000=92.000
mean27.901-27.293=0.608
σ0.328-0.067=0.261
min27.527-27.214=0.313
max28.267-27.363=0.904