Compare commits

Home / Compare 3a1eadee .. cf6284b0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.952-35.952=0.001
σ0.103-0.103=-0.001
min35.909-35.905=0.004
max36.244-36.244=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.077-0.076=0.001
σ0.004-0.004=0.000
min0.074-0.074=-0.000
max0.083-0.083=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.200-26.200=-0.000
σ0.004-0.004=0.000
min26.195-26.193=0.002
max26.206-26.205=0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.060-0.060=0.000
σ0.003-0.003=0.001
min0.056-0.057=-0.001
max0.067-0.066=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.299-1756.300=-0.001
σ0.369-0.368=0.001
min1755.723-1755.724=-0.001
max1756.895-1756.893=0.002
mean1661.200-1651.950=9.250
σ637.747-628.734=9.013
min614.000
max2696.000-2726.000=-30.000
mean2.367-2.363=0.004
σ0.190-0.109=0.081
min2.180-2.245=-0.065
max3.109-2.700=0.410

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.819-278.820=-0.000
σ0.006-0.006=-0.000
min278.810-278.809=0.001
max278.826-278.826=0.000
mean2696.000-2726.000=-30.000
σ0.000
min2696.000-2726.000=-30.000
max2696.000-2726.000=-30.000
mean0.409-0.407=0.002
σ0.002-0.007=-0.004
min0.406-0.403=0.003
max0.412-0.418=-0.007
iters=5
new-facts=1
prior-facts=6402
mean2268.885-2268.870=0.015
σ0.016-0.019=-0.003
min2268.863-2268.841=0.021
max2268.903-2268.892=0.011
mean2696.000-2726.000=-30.000
σ0.000
min2696.000-2726.000=-30.000
max2696.000-2726.000=-30.000
mean3.044-3.070=-0.026
σ0.165-0.160=0.005
min2.852-2.921=-0.069
max3.208-3.305=-0.096
iters=5
new-facts=6402
prior-facts=1
mean4954.002-4954.271=-0.269
σ1.150-0.808=0.343
min4952.648-4953.847=-1.199
max4955.837-4955.710=0.127
mean2696.000-2726.000=-30.000
σ0.000
min2696.000-2726.000=-30.000
max2696.000-2726.000=-30.000
mean8.209-7.855=0.354
σ0.412-0.274=0.138
min7.870-7.591=0.279
max8.866-8.313=0.553
iters=5
new-facts=6402
prior-facts=6402
mean5168.783-5168.788=-0.005
σ0.072-0.081=-0.009
min5168.724-5168.717=0.007
max5168.870-5168.878=-0.008
mean3468.400-3454.800=13.600
σ508.551-480.558=27.993
min2840.000-2874.000=-34.000
max4184.000-4151.000=33.000
mean9.388-9.255=0.133
σ0.523-0.303=0.220
min8.513-8.876=-0.363
max9.795-9.663=0.131

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.150-1.028=0.122
σ0.381-0.067=0.314
min0.932-0.945=-0.013
max1.821-1.087=0.735

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.806-459.805=0.001
σ571.588-571.587=0.001
min174.008-174.005=0.003
max1317.189-1317.185=0.003
mean79.500
σ7.000
min76.000
max90.000
mean2696.000-2726.000=-30.000
σ0.000
min2696.000-2726.000=-30.000
max2696.000-2726.000=-30.000
mean0.549-0.536=0.013
σ0.553-0.533=0.020
min0.272-0.266=0.005
max1.379-1.336=0.043
policies=20
mean1740.322-1740.314=0.008
σ0.318-0.311=0.007
min1740.119-1740.119=0.001
max1740.796-1740.779=0.017
mean760.000
σ0.000
min760.000
max760.000
mean2696.000-2726.000=-30.000
σ0.000
min2696.000-2726.000=-30.000
max2696.000-2726.000=-30.000
mean2.686-2.684=0.003
σ0.012-0.016=-0.005
min2.672-2.667=0.005
max2.698-2.703=-0.004
policies=200
mean17410.178-17410.203=-0.025
σ0.497-0.497=0.000
min17409.883-17409.927=-0.044
max17410.918-17410.947=-0.029
mean7600.000
σ0.000
min7600.000
max7600.000
mean2696.000-2726.000=-30.000
σ0.000
min2696.000-2726.000=-30.000
max2696.000-2726.000=-30.000
mean26.980-26.961=0.019
σ0.093-0.056=0.037
min26.914-26.917=-0.003
max27.114-27.040=0.073