Compare commits

Home / Compare 3cc8200c .. de4327eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.244=0.374
σ0.053-0.054=-0.001
min35.589-35.217=0.372
max35.767-35.396=0.371
mean415.600-412.000=3.600
σ0.516-0.000=0.516
min415.000-412.000=3.000
max416.000-412.000=4.000
mean0.086-0.085=0.001
σ0.004-0.003=0.000
min0.082-0.082=0.001
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean24.048-23.769=0.279
σ0.002-0.003=-0.001
min24.045-23.764=0.281
max24.051-23.774=0.277
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.068-0.067=0.002
σ0.003-0.005=-0.001
min0.066-0.061=0.005
max0.076-0.076=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.471=0.020
σ0.364-0.364=0.001
min1755.916-1755.896=0.020
max1757.081-1757.062=0.019
mean1653.900-1647.700=6.200
σ629.168-639.664=-10.497
min619.000-624.000=-5.000
max2690.000-2824.000=-134.000
mean2.350-2.367=-0.018
σ0.104-0.145=-0.041
min2.239-2.116=0.123
max2.652-2.794=-0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-324.692=0.074
σ0.048-0.043=0.005
min324.681-324.616=0.065
max324.793-324.720=0.073
mean2690.000-2824.000=-134.000
σ0.000
min2690.000-2824.000=-134.000
max2690.000-2824.000=-134.000
mean0.427-0.424=0.004
σ0.010-0.005=0.005
min0.420-0.420=-0.000
max0.445-0.432=0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.241=0.076
σ0.020-0.017=0.003
min1985.284-1985.217=0.067
max1985.332-1985.257=0.075
mean2690.000-2824.000=-134.000
σ0.000
min2690.000-2824.000=-134.000
max2690.000-2824.000=-134.000
mean2.617-2.562=0.055
σ0.079-0.059=0.020
min2.558-2.506=0.052
max2.733-2.657=0.077
iters=5
new-facts=6402
prior-facts=1
mean4808.975-4808.846=0.129
σ7.796-7.672=0.125
min4805.048-4805.365=-0.317
max4822.914-4822.569=0.345
mean2690.000-2824.000=-134.000
σ0.000
min2690.000-2824.000=-134.000
max2690.000-2824.000=-134.000
mean9.029-8.929=0.100
σ0.132-0.147=-0.016
min8.889-8.803=0.086
max9.234-9.154=0.080
iters=5
new-facts=6402
prior-facts=6402
mean4996.494-4996.385=0.109
σ0.178-0.161=0.017
min4996.285-4996.099=0.186
max4996.640-4996.478=0.163
mean3058.800-3050.200=8.600
σ293.251-208.422=84.829
min2690.000-2824.000=-134.000
max3333.000-3354.000=-21.000
mean8.914-8.630=0.284
σ0.415-0.191=0.224
min8.568-8.437=0.132
max9.554-8.888=0.666

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.952-1.049=-0.098
σ0.057-0.166=-0.109
min0.917-0.913=0.004
max1.050-1.321=-0.270

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.215-462.951=0.263
σ574.773-574.253=0.519
min175.813-175.815=-0.002
max1325.373-1324.331=1.042
mean86.250
σ8.500
min82.000
max99.000
mean2690.000-2824.000=-134.000
σ0.000
min2690.000-2824.000=-134.000
max2690.000-2824.000=-134.000
mean0.564-0.434=0.130
σ0.578-0.301=0.277
min0.272-0.281=-0.009
max1.431-0.886=0.545
policies=20
mean1758.505-1758.483=0.022
σ0.333-0.354=-0.020
min1758.295-1758.237=0.058
max1759.001-1759.006=-0.005
mean820.000
σ0.000
min820.000
max820.000
mean2690.000-2824.000=-134.000
σ0.000
min2690.000-2824.000=-134.000
max2690.000-2824.000=-134.000
mean2.717-2.781=-0.065
σ0.012-0.012=0.000
min2.704-2.771=-0.067
max2.729-2.798=-0.069
policies=200
mean17592.116-17590.983=1.133
σ0.421-0.748=-0.327
min17591.847-17590.085=1.762
max17592.744-17591.639=1.104
mean8200.000
σ0.000
min8200.000
max8200.000
mean2690.000-2824.000=-134.000
σ0.000
min2690.000-2824.000=-134.000
max2690.000-2824.000=-134.000
mean27.450-27.854=-0.404
σ0.029-0.441=-0.412
min27.432-27.405=0.027
max27.492-28.361=-0.869