Compare commits

Home / Compare b5747888 .. b7891eff

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.729=0.003
σ0.051-0.050=0.000
min70.702-70.700=0.001
max70.873-70.868=0.005
mean419.000-416.500=2.500
σ0.000-0.527=-0.527
min419.000-416.000=3.000
max419.000-417.000=2.000
mean0.162-0.159=0.002
σ0.003-0.003=-0.001
min0.159-0.155=0.004
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.446-21.445=0.001
σ0.003-0.003=-0.000
min21.443-21.439=0.003
max21.450-21.450=0.001
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.065-0.065=-0.000
σ0.002-0.002=-0.000
min0.063-0.064=-0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.288-1755.286=0.001
σ0.361-0.361=-0.000
min1754.722-1754.721=0.002
max1755.876-1755.866=0.011
mean1639.400-1629.200=10.200
σ628.664-594.007=34.656
min619.000-642.000=-23.000
max2771.000-2421.000=350.000
mean2.877-2.851=0.025
σ0.220-0.160=0.060
min2.165-2.390=-0.224
max3.169-3.169=0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.363-274.367=-0.004
σ0.008-0.006=0.001
min274.353-274.359=-0.006
max274.371-274.373=-0.002
mean2771.000-2421.000=350.000
σ0.000
min2771.000-2421.000=350.000
max2771.000-2421.000=350.000
mean0.383-0.385=-0.001
σ0.001-0.004=-0.003
min0.382-0.382=0.001
max0.384-0.392=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1934.751-1934.758=-0.007
σ0.017-0.015=0.002
min1934.729-1934.737=-0.009
max1934.774-1934.777=-0.002
mean2771.000-2421.000=350.000
σ0.000
min2771.000-2421.000=350.000
max2771.000-2421.000=350.000
mean3.051-2.954=0.097
σ0.105-0.091=0.014
min2.926-2.827=0.099
max3.192-3.057=0.135
iters=5
new-facts=6402
prior-facts=1
mean4755.480-4755.393=0.087
σ0.949-0.997=-0.048
min4754.976-4754.443=0.533
max4757.174-4757.091=0.083
mean2771.000-2421.000=350.000
σ0.000
min2771.000-2421.000=350.000
max2771.000-2421.000=350.000
mean8.797-8.653=0.144
σ0.541-0.321=0.219
min7.925-8.320=-0.395
max9.266-9.082=0.184
iters=5
new-facts=6402
prior-facts=6402
mean4945.915-4945.981=-0.066
σ0.167-0.019=0.149
min4945.619-4945.961=-0.342
max4946.021-4946.003=0.018
mean2992.400-2918.000=74.400
σ207.535-332.282=-124.747
min2771.000-2421.000=350.000
max3288.000-3308.000=-20.000
mean8.559-8.502=0.056
σ0.068-0.123=-0.056
min8.491-8.361=0.131
max8.645-8.686=-0.041

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.873=-0.828
σ0.171-0.068=0.103
min0.935-1.794=-0.859
max1.332-1.962=-0.630

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.856-472.835=0.022
σ574.967-574.929=0.038
min185.367-185.369=-0.002
max1335.307-1335.228=0.079
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2421.000=350.000
σ0.000
min2771.000-2421.000=350.000
max2771.000-2421.000=350.000
mean0.608-0.552=0.056
σ0.616-0.520=0.097
min0.289-0.285=0.005
max1.532-1.331=0.201
policies=20
mean1853.968-1853.975=-0.006
σ0.362-0.357=0.005
min1853.711-1853.731=-0.020
max1854.502-1854.502=0.000
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2421.000=350.000
σ0.000
min2771.000-2421.000=350.000
max2771.000-2421.000=350.000
mean2.883-2.873=0.009
σ0.038-0.009=0.029
min2.849-2.865=-0.017
max2.937-2.886=0.051
policies=200
mean18546.596-18546.622=-0.026
σ0.376-0.571=-0.195
min18546.287-18546.237=0.049
max18547.130-18547.452=-0.322
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2421.000=350.000
σ0.000
min2771.000-2421.000=350.000
max2771.000-2421.000=350.000
mean28.815-28.908=-0.093
σ0.117-0.088=0.029
min28.663-28.811=-0.147
max28.947-29.012=-0.065