Compare commits

Home / Compare 3427e6d5 .. 7613cf6c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.951=0.015
σ0.103-0.102=0.001
min35.922-35.908=0.013
max36.258-36.241=0.017
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.077-0.076=0.001
σ0.004-0.003=0.000
min0.075-0.074=0.001
max0.085-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.200=0.008
σ0.005-0.004=0.001
min26.201-26.196=0.005
max26.217-26.206=0.010
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.061-0.061=0.000
σ0.002-0.003=-0.001
min0.060-0.058=0.001
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.307-1756.300=0.007
σ0.369-0.368=0.000
min1755.731-1755.725=0.007
max1756.901-1756.893=0.008
mean1656.200-1658.200=-2.000
σ627.619-639.309=-11.690
min609.000
max2642.000-2697.000=-55.000
mean2.364-2.388=-0.024
σ0.175-0.183=-0.008
min2.244-2.261=-0.017
max3.058-3.095=-0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.826-278.818=0.008
σ0.004-0.005=-0.001
min278.821-278.812=0.009
max278.832-278.823=0.009
mean2642.000-2697.000=-55.000
σ0.000
min2642.000-2697.000=-55.000
max2642.000-2697.000=-55.000
mean0.409-0.412=-0.003
σ0.005-0.004=0.001
min0.405-0.409=-0.004
max0.417-0.417=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.892-2268.880=0.012
σ0.013-0.010=0.004
min2268.877-2268.873=0.005
max2268.914-2268.897=0.017
mean2642.000-2697.000=-55.000
σ0.000
min2642.000-2697.000=-55.000
max2642.000-2697.000=-55.000
mean2.995-3.080=-0.085
σ0.111-0.193=-0.082
min2.871-2.886=-0.015
max3.114-3.309=-0.195
iters=5
new-facts=6402
prior-facts=1
mean4954.264-4954.265=-0.001
σ0.804-0.837=-0.033
min4953.813-4953.856=-0.042
max4955.697-4955.760=-0.063
mean2642.000-2697.000=-55.000
σ0.000
min2642.000-2697.000=-55.000
max2642.000-2697.000=-55.000
mean7.922-7.945=-0.023
σ0.137-0.358=-0.220
min7.828-7.573=0.255
max8.161-8.532=-0.371
iters=5
new-facts=6402
prior-facts=6402
mean5168.795-5168.789=0.006
σ0.076-0.076=0.000
min5168.733-5168.718=0.015
max5168.881-5168.872=0.009
mean3394.600-3301.800=92.800
σ491.430-389.066=102.364
min2821.000-2916.000=-95.000
max4126.000-3694.000=432.000
mean9.273-9.166=0.107
σ0.280-0.394=-0.113
min8.908-8.726=0.182
max9.668-9.751=-0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.157-1.064=0.093
σ0.403-0.187=0.217
min0.941-0.944=-0.003
max1.872-1.384=0.488

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.350-459.808=0.541
σ572.654-571.584=1.070
min174.013-174.009=0.004
max1319.331-1317.184=2.147
mean79.500
σ7.000
min76.000
max90.000
mean2642.000-2697.000=-55.000
σ0.000
min2642.000-2697.000=-55.000
max2642.000-2697.000=-55.000
mean0.530-0.547=-0.017
σ0.509-0.552=-0.044
min0.268-0.268=-0.000
max1.293-1.376=-0.083
policies=20
mean1740.425-1740.327=0.098
σ0.319-0.329=-0.010
min1740.227-1740.124=0.103
max1740.901-1740.817=0.084
mean760.000
σ0.000
min760.000
max760.000
mean2642.000-2697.000=-55.000
σ0.000
min2642.000-2697.000=-55.000
max2642.000-2697.000=-55.000
mean2.666-2.698=-0.032
σ0.015-0.024=-0.010
min2.648-2.675=-0.028
max2.680-2.731=-0.052
policies=200
mean17411.411-17410.195=1.217
σ0.497-0.499=-0.002
min17411.077-17409.928=1.149
max17412.147-17410.943=1.204
mean7600.000
σ0.000
min7600.000
max7600.000
mean2642.000-2697.000=-55.000
σ0.000
min2642.000-2697.000=-55.000
max2642.000-2697.000=-55.000
mean26.930-27.107=-0.177
σ0.142-0.056=0.085
min26.775-27.054=-0.279
max27.114-27.186=-0.073