Compare commits

Home / Compare 6de46ad9 .. 17245452

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.992-35.991=0.001
σ0.103-0.104=-0.002
min35.947-35.943=0.004
max36.283-36.286=-0.003
mean4036.000-4100.000=-64.000
σ0.000
min4036.000-4100.000=-64.000
max4036.000-4100.000=-64.000
mean0.074-0.074=-0.000
σ0.001-0.002=-0.002
min0.074-0.070=0.003
max0.075-0.077=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.215-26.214=0.001
σ0.002-0.004=-0.002
min26.212-26.208=0.004
max26.217-26.221=-0.003
mean4036.000-4100.000=-64.000
σ0.000
min4036.000-4100.000=-64.000
max4036.000-4100.000=-64.000
mean0.060-0.060=-0.001
σ0.001-0.001=0.000
min0.059-0.060=-0.001
max0.061-0.061=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.369-1756.369=-0.001
σ0.373-0.374=-0.001
min1755.801-1755.790=0.010
max1756.963-1756.966=-0.003
mean1649.200-1650.300=-1.100
σ630.266-633.410=-3.144
min619.000-617.000=2.000
max2591.000-2598.000=-7.000
mean2.307-2.323=-0.016
σ0.198-0.193=0.005
min2.140-2.086=0.055
max2.787-2.779=0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.697-278.697=-0.000
σ0.014-0.014=-0.000
min278.683-278.683=0.000
max278.718-278.720=-0.002
mean2591.000-2598.000=-7.000
σ0.000
min2591.000-2598.000=-7.000
max2591.000-2598.000=-7.000
mean0.420-0.419=0.000
σ0.001-0.001=0.000
min0.418-0.418=0.000
max0.421-0.420=0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.856-2268.864=-0.009
σ0.029-0.010=0.019
min2268.808-2268.849=-0.041
max2268.876-2268.873=0.003
mean2591.000-2598.000=-7.000
σ0.000
min2591.000-2598.000=-7.000
max2591.000-2598.000=-7.000
mean2.950-2.990=-0.040
σ0.142-0.132=0.010
min2.866-2.865=0.001
max3.202-3.207=-0.005
iters=5
new-facts=6402
prior-facts=1
mean4952.186-4952.180=0.006
σ0.875-0.832=0.043
min4951.710-4951.739=-0.029
max4953.749-4953.666=0.083
mean2591.000-2598.000=-7.000
σ0.000
min2591.000-2598.000=-7.000
max2591.000-2598.000=-7.000
mean7.925-8.025=-0.100
σ0.372-0.272=0.100
min7.566-7.686=-0.119
max8.496-8.427=0.069
iters=5
new-facts=6402
prior-facts=6402
mean5166.922-5166.850=0.072
σ0.010-0.160=-0.149
min5166.913-5166.566=0.346
max5166.938-5166.940=-0.002
mean3363.600-3432.000=-68.400
σ467.036-473.541=-6.506
min2802.000-2822.000=-20.000
max4036.000-4100.000=-64.000
mean9.222-9.259=-0.037
σ0.241-0.458=-0.218
min8.960-8.491=0.469
max9.572-9.604=-0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.114-1.092=0.022
σ0.249-0.106=0.143
min0.935-0.958=-0.023
max1.543-1.255=0.288

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.259=-0.000
σ572.607-572.608=-0.001
min173.951-173.954=-0.003
max1319.168-1319.170=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean437.000
σ0.000
min437.000
max437.000
mean0.572-0.552=0.020
σ0.593-0.548=0.045
min0.273-0.272=0.000
max1.461-1.373=0.088
policies=20
mean1740.057-1740.041=0.016
σ0.350-0.328=0.022
min1739.802-1739.808=-0.006
max1740.569-1740.522=0.047
mean760.000
σ0.000
min760.000
max760.000
mean447.500-447.000=0.500
σ9.950-9.381=0.569
min437.000
max456.000-455.000=1.000
mean2.681-2.669=0.013
σ0.010-0.008=0.001
min2.673-2.657=0.017
max2.693-2.674=0.019
policies=200
mean17409.908-17409.689=0.219
σ0.072-0.060=0.012
min17409.853-17409.617=0.236
max17410.012-17409.740=0.272
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.500-492.000=-1.500
σ3.000-2.309=0.691
min488.000-490.000=-2.000
max494.000
mean27.036-26.997=0.040
σ0.120-0.166=-0.046
min26.922-26.827=0.095
max27.156-27.211=-0.055