Compare commits

Home / Compare 4f9a68a7 .. 36da23fc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.952-35.952=0.000
σ0.103-0.101=0.002
min35.912-35.901=0.011
max36.245-36.238=0.007
mean411.000-413.900=-2.900
σ0.000-0.316=-0.316
min411.000-413.000=-2.000
max411.000-414.000=-3.000
mean0.077-0.078=-0.002
σ0.004-0.004=-0.000
min0.074-0.073=0.001
max0.085-0.087=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.200-26.201=-0.000
σ0.004-0.004=0.000
min26.196-26.197=-0.001
max26.207-26.207=0.000
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.060-0.061=-0.001
σ0.002-0.003=-0.000
min0.059-0.060=-0.001
max0.067-0.068=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.299-1756.300=-0.001
σ0.370-0.367=0.003
min1755.723-1755.723=-0.000
max1756.895-1756.891=0.004
mean1640.700-1658.850=-18.150
σ635.116-632.080=3.036
min617.000-612.000=5.000
max2685.000-2727.000=-42.000
mean2.338-2.408=-0.070
σ0.105-0.128=-0.024
min2.185-2.282=-0.098
max2.594-2.819=-0.225

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.817-278.816=0.001
σ0.004-0.006=-0.002
min278.810-278.812=-0.002
max278.820-278.826=-0.006
mean2685.000-2727.000=-42.000
σ0.000
min2685.000-2727.000=-42.000
max2685.000-2727.000=-42.000
mean0.411-0.408=0.002
σ0.005-0.004=0.001
min0.406-0.405=0.001
max0.417-0.416=0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.880-2268.868=0.012
σ0.019-0.015=0.005
min2268.849-2268.848=0.002
max2268.896-2268.885=0.011
mean2685.000-2727.000=-42.000
σ0.000
min2685.000-2727.000=-42.000
max2685.000-2727.000=-42.000
mean3.157-2.921=0.237
σ0.215-0.142=0.073
min2.913-2.781=0.132
max3.390-3.130=0.259
iters=5
new-facts=6402
prior-facts=1
mean4954.024-4954.240=-0.216
σ1.123-0.814=0.308
min4952.648-4953.732=-1.084
max4955.781-4955.687=0.094
mean2685.000-2727.000=-42.000
σ0.000
min2685.000-2727.000=-42.000
max2685.000-2727.000=-42.000
mean7.943-7.974=-0.031
σ0.409-0.242=0.167
min7.665-7.688=-0.023
max8.655-8.232=0.422
iters=5
new-facts=6402
prior-facts=6402
mean5168.782-5168.784=-0.002
σ0.084-0.082=0.002
min5168.717-5168.716=0.001
max5168.875-5168.876=-0.001
mean3319.600-3396.800=-77.200
σ394.553-487.659=-93.106
min2928.000-2818.000=110.000
max3717.000-4070.000=-353.000
mean9.182-9.336=-0.154
σ0.194-0.337=-0.143
min8.973-9.088=-0.116
max9.403-9.886=-0.482

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.970-1.139=-0.169
σ0.054-0.228=-0.174
min0.941-0.926=0.015
max1.065-1.459=-0.394

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.807-459.810=-0.003
σ571.582-571.586=-0.003
min174.006-174.005=0.001
max1317.181-1317.188=-0.007
mean79.500
σ7.000
min76.000
max90.000
mean2685.000-2727.000=-42.000
σ0.000
min2685.000-2727.000=-42.000
max2685.000-2727.000=-42.000
mean0.537-0.546=-0.009
σ0.538-0.554=-0.016
min0.267-0.267=-0.001
max1.344-1.377=-0.032
policies=20
mean1740.313-1740.316=-0.003
σ0.304-0.314=-0.011
min1740.131-1740.115=0.016
max1740.767-1740.785=-0.018
mean760.000
σ0.000
min760.000
max760.000
mean2685.000-2727.000=-42.000
σ0.000
min2685.000-2727.000=-42.000
max2685.000-2727.000=-42.000
mean2.669-2.670=-0.000
σ0.018-0.015=0.002
min2.650-2.653=-0.004
max2.688-2.683=0.005
policies=200
mean17410.205-17410.197=0.008
σ0.485-0.476=0.009
min17409.944-17409.934=0.010
max17410.932-17410.910=0.022
mean7600.000
σ0.000
min7600.000
max7600.000
mean2685.000-2727.000=-42.000
σ0.000
min2685.000-2727.000=-42.000
max2685.000-2727.000=-42.000
mean26.955-27.036=-0.081
σ0.099-0.121=-0.021
min26.836-26.858=-0.023
max27.066-27.120=-0.054