Compare commits

Home / Compare 41cf8bfd .. 956b8413

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.794=0.004
σ0.105-0.108=-0.003
min35.756-35.748=0.008
max36.095-36.101=-0.006
mean411.900-410.000=1.900
σ0.316-0.000=0.316
min411.000-410.000=1.000
max412.000-410.000=2.000
mean0.076-0.074=0.002
σ0.003-0.004=-0.001
min0.073-0.066=0.007
max0.082-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.065-26.066=-0.001
σ0.004-0.003=0.001
min26.060-26.062=-0.002
max26.072-26.070=0.003
mean412.000-410.000=2.000
σ0.000
min412.000-410.000=2.000
max412.000-410.000=2.000
mean0.061-0.061=0.000
σ0.003-0.002=0.001
min0.059-0.059=0.000
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1751.238=-0.002
σ0.361-0.363=-0.002
min1750.665-1750.670=-0.005
max1751.807-1751.825=-0.017
mean1633.150-1662.700=-29.550
σ612.935-639.833=-26.899
min629.000-676.000=-47.000
max2464.000-2693.000=-229.000
mean2.806-2.895=-0.089
σ0.193-0.096=0.097
min2.196-2.688=-0.492
max3.068-3.095=-0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.561-275.569=-0.007
σ0.013-0.003=0.010
min275.539-275.566=-0.027
max275.572-275.573=-0.000
mean2464.000-2693.000=-229.000
σ0.000
min2464.000-2693.000=-229.000
max2464.000-2693.000=-229.000
mean0.394-0.403=-0.009
σ0.008-0.007=0.001
min0.385-0.396=-0.011
max0.404-0.412=-0.007
iters=5
new-facts=1
prior-facts=6402
mean2168.083-2168.094=-0.011
σ0.011-0.013=-0.002
min2168.073-2168.080=-0.006
max2168.101-2168.111=-0.010
mean2464.000-2693.000=-229.000
σ0.000
min2464.000-2693.000=-229.000
max2464.000-2693.000=-229.000
mean3.011-2.986=0.025
σ0.155-0.188=-0.033
min2.796-2.658=0.138
max3.135-3.127=0.008
iters=5
new-facts=6402
prior-facts=1
mean5047.901-5047.926=-0.025
σ0.911-0.880=0.030
min5047.364-5047.390=-0.025
max5049.523-5049.492=0.031
mean2464.000-2693.000=-229.000
σ0.000
min2464.000-2693.000=-229.000
max2464.000-2693.000=-229.000
mean8.803-8.761=0.042
σ0.384-0.510=-0.126
min8.217-8.124=0.093
max9.151-9.368=-0.217
iters=5
new-facts=6402
prior-facts=6402
mean5179.048-5179.054=-0.005
σ0.090-0.084=0.006
min5178.962-5178.964=-0.002
max5179.156-5179.145=0.011
mean3224.800-3222.800=2.000
σ359.297-364.863=-5.566
min2719.000-2720.000=-1.000
max3667.000-3679.000=-12.000
mean9.716-10.139=-0.423
σ0.502-0.559=-0.057
min8.996-9.594=-0.598
max10.197-11.084=-0.887

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.807-1.091=0.716
σ0.137-0.145=-0.008
min1.638-0.947=0.691
max2.014-1.257=0.757

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.194-463.207=-0.014
σ572.650-572.659=-0.009
min176.867-176.871=-0.003
max1322.168-1322.196=-0.028
mean77.500
σ7.000
min74.000
max88.000
mean2464.000-2693.000=-229.000
σ0.000
min2464.000-2693.000=-229.000
max2464.000-2693.000=-229.000
mean0.551-0.558=-0.007
σ0.547-0.566=-0.019
min0.273-0.272=0.001
max1.371-1.407=-0.036
policies=20
mean1768.966-1768.946=0.020
σ0.348-0.340=0.008
min1768.732-1768.721=0.011
max1769.483-1769.452=0.031
mean740.000
σ0.000
min740.000
max740.000
mean2464.000-2693.000=-229.000
σ0.000
min2464.000-2693.000=-229.000
max2464.000-2693.000=-229.000
mean2.753-2.757=-0.004
σ0.010-0.027=-0.017
min2.739-2.725=0.014
max2.761-2.791=-0.030
policies=200
mean17696.235-17696.103=0.132
σ0.468-0.410=0.058
min17695.988-17695.848=0.140
max17696.936-17696.710=0.226
mean7400.000
σ0.000
min7400.000
max7400.000
mean2464.000-2693.000=-229.000
σ0.000
min2464.000-2693.000=-229.000
max2464.000-2693.000=-229.000
mean27.757-27.672=0.085
σ0.100-0.090=0.010
min27.641-27.549=0.092
max27.882-27.764=0.118