Compare commits

Home / Compare ba76efd1 .. 288be963

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.966=0.007
σ0.107-0.103=0.005
min35.925-35.920=0.006
max36.277-36.256=0.021
mean415.600-415.000=0.600
σ0.516-0.000=0.516
min415.000
max416.000-415.000=1.000
mean0.077-0.076=0.000
σ0.003-0.004=-0.000
min0.074-0.074=0.000
max0.083-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.209-26.209=-0.001
σ0.005-0.004=0.001
min26.200-26.205=-0.005
max26.214-26.215=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.061-0.061=0.000
σ0.003-0.003=0.001
min0.059-0.059=0.000
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.377-1756.314=2.063
σ0.370-0.370=0.000
min1757.799-1755.737=2.062
max1758.979-1756.908=2.070
mean1638.600-1674.300=-35.700
σ622.803-633.459=-10.656
min679.000-680.000=-1.000
max2833.000-2682.000=151.000
mean2.416-2.340=0.075
σ0.136-0.073=0.063
min2.243-2.238=0.005
max2.822-2.496=0.326

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.541-278.850=0.691
σ0.009-0.004=0.005
min279.528-278.845=0.683
max279.552-278.854=0.698
mean2833.000-2682.000=151.000
σ0.000
min2833.000-2682.000=151.000
max2833.000-2682.000=151.000
mean0.414-0.411=0.003
σ0.009-0.004=0.005
min0.404-0.407=-0.003
max0.427-0.418=0.009
iters=5
new-facts=1
prior-facts=6402
mean2178.456-2268.906=-90.450
σ0.015-0.011=0.004
min2178.435-2268.894=-90.459
max2178.472-2268.922=-90.450
mean2833.000-2682.000=151.000
σ0.000
min2833.000-2682.000=151.000
max2833.000-2682.000=151.000
mean3.392-3.208=0.184
σ0.185-0.227=-0.042
min3.286-2.876=0.409
max3.722-3.504=0.217
iters=5
new-facts=6402
prior-facts=1
mean5056.405-4954.281=102.124
σ0.989-0.849=0.140
min5055.797-4953.866=101.932
max5058.164-4955.797=102.367
mean2833.000-2682.000=151.000
σ0.000
min2833.000-2682.000=151.000
max2833.000-2682.000=151.000
mean8.924-8.007=0.917
σ0.457-0.376=0.081
min8.556-7.639=0.917
max9.525-8.618=0.907
iters=5
new-facts=6402
prior-facts=6402
mean5193.688-5168.742=24.946
σ0.208-0.128=0.079
min5193.376-5168.548=24.827
max5193.879-5168.908=24.970
mean3253.600-3355.000=-101.400
σ467.802-408.538=59.264
min2833.000-2949.000=-116.000
max3923.000-3766.000=157.000
mean8.822-9.126=-0.304
σ0.193-0.261=-0.068
min8.656-8.683=-0.027
max9.041-9.338=-0.297

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.160-1.033=0.127
σ0.242-0.130=0.111
min0.957-0.945=0.012
max1.581-1.255=0.326

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.535-460.365=5.170
σ572.655-572.658=-0.003
min179.201-174.027=5.174
max1324.517-1319.352=5.166
mean79.500
σ7.000
min76.000
max90.000
mean2833.000-2682.000=151.000
σ0.000
min2833.000-2682.000=151.000
max2833.000-2682.000=151.000
mean0.446-0.549=-0.103
σ0.309-0.553=-0.244
min0.288-0.268=0.020
max0.909-1.379=-0.470
policies=20
mean1792.314-1740.497=51.817
σ0.353-0.311=0.042
min1792.069-1740.299=51.770
max1792.831-1740.961=51.870
mean760.000
σ0.000
min760.000
max760.000
mean2833.000-2682.000=151.000
σ0.000
min2833.000-2682.000=151.000
max2833.000-2682.000=151.000
mean2.894-2.665=0.229
σ0.015-0.007=0.007
min2.874-2.658=0.216
max2.908-2.675=0.233
policies=200
mean17929.586-17411.892=517.694
σ0.476-0.368=0.109
min17929.288-17411.687=517.601
max17930.297-17412.443=517.853
mean7600.000
σ0.000
min7600.000
max7600.000
mean2833.000-2682.000=151.000
σ0.000
min2833.000-2682.000=151.000
max2833.000-2682.000=151.000
mean28.524-26.941=1.582
σ0.382-0.030=0.352
min28.209-26.910=1.300
max29.080-26.981=2.099