Compare commits

Home / Compare 2124ed51 .. db18b0e7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.687=0.094
σ0.047-0.048=-0.001
min70.750-70.661=0.090
max70.913-70.822=0.091
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.160-0.160=-0.000
σ0.004-0.004=0.000
min0.152-0.156=-0.004
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.492-21.420=0.072
σ0.002-0.004=-0.001
min21.487-21.414=0.073
max21.495-21.424=0.071
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.065-0.064=0.001
σ0.003-0.004=-0.001
min0.059-0.059=0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.091-1754.458=-0.367
σ0.357-0.362=-0.005
min1753.528-1753.886=-0.358
max1754.670-1755.042=-0.372
mean1659.150-1659.300=-0.150
σ627.037-626.824=0.212
min630.000-624.000=6.000
max2777.000-2837.000=-60.000
mean2.828-2.781=0.047
σ0.120-0.153=-0.033
min2.479-2.368=0.111
max3.065-2.959=0.107

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.953-273.505=-1.552
σ0.008-0.007=0.001
min271.944-273.499=-1.555
max271.965-273.517=-1.552
mean2777.000-2837.000=-60.000
σ0.000
min2777.000-2837.000=-60.000
max2777.000-2837.000=-60.000
mean0.384-0.385=-0.001
σ0.008-0.005=0.003
min0.377-0.380=-0.004
max0.397-0.393=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.319-1933.898=-1.578
σ0.013-0.007=0.005
min1932.299-1933.889=-1.590
max1932.332-1933.908=-1.576
mean2777.000-2837.000=-60.000
σ0.000
min2777.000-2837.000=-60.000
max2777.000-2837.000=-60.000
mean2.966-2.972=-0.006
σ0.071-0.069=0.002
min2.872-2.890=-0.019
max3.029-3.065=-0.036
iters=5
new-facts=6402
prior-facts=1
mean4753.031-4754.578=-1.548
σ0.941-0.911=0.030
min4752.574-4753.853=-1.279
max4754.712-4756.165=-1.453
mean2777.000-2837.000=-60.000
σ0.000
min2777.000-2837.000=-60.000
max2777.000-2837.000=-60.000
mean8.707-8.300=0.406
σ0.450-0.536=-0.086
min7.960-7.806=0.154
max9.038-9.087=-0.049
iters=5
new-facts=6402
prior-facts=6402
mean4943.556-4945.118=-1.563
σ0.017-0.013=0.004
min4943.530-4945.099=-1.570
max4943.571-4945.131=-1.559
mean3002.800-3073.200=-70.400
σ218.613-305.995=-87.382
min2777.000-2837.000=-60.000
max3326.000-3541.000=-215.000
mean8.470-8.570=-0.100
σ0.139-0.322=-0.183
min8.292-8.408=-0.116
max8.634-9.145=-0.511

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.965-1.096=-0.132
σ0.078-0.125=-0.047
min0.927-0.946=-0.019
max1.104-1.294=-0.190

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.626-472.572=-3.947
σ574.923-574.937=-0.013
min181.150-185.099=-3.949
max1331.011-1334.978=-3.967
mean88.250
σ8.500
min84.000
max101.000
mean2777.000-2837.000=-60.000
σ0.000
min2777.000-2837.000=-60.000
max2777.000-2837.000=-60.000
mean0.447-0.487=-0.040
σ0.303-0.375=-0.072
min0.287-0.296=-0.009
max0.901-1.049=-0.149
policies=20
mean1811.858-1851.295=-39.437
σ0.376-0.375=0.000
min1811.589-1851.014=-39.425
max1812.402-1851.841=-39.439
mean840.000
σ0.000
min840.000
max840.000
mean2777.000-2837.000=-60.000
σ0.000
min2777.000-2837.000=-60.000
max2777.000-2837.000=-60.000
mean2.884-2.955=-0.071
σ0.089-0.015=0.074
min2.834-2.937=-0.103
max3.017-2.970=0.047
policies=200
mean18126.064-18519.483=-393.419
σ0.883-0.339=0.544
min18125.170-18519.248=-394.077
max18127.278-18519.986=-392.708
mean8400.000
σ0.000
min8400.000
max8400.000
mean2777.000-2837.000=-60.000
σ0.000
min2777.000-2837.000=-60.000
max2777.000-2837.000=-60.000
mean28.559-29.370=-0.811
σ0.110-0.442=-0.332
min28.467-28.933=-0.465
max28.715-29.901=-1.186