Compare commits

Home / Compare 8ce0ae6f .. cd2c8ecc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-30.773=4.490
σ0.054-0.046=0.008
min35.230-30.754=4.477
max35.416-30.905=4.511
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.084-0.077=0.007
σ0.003-0.003=-0.000
min0.082-0.071=0.011
max0.092-0.085=0.007
cache=y
dps=1
iters=10
policies=100
mean23.770-21.059=2.711
σ0.004-0.003=0.001
min23.764-21.054=2.710
max23.776-21.063=2.713
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.069-0.064=0.005
σ0.003-0.002=0.001
min0.066-0.062=0.004
max0.075-0.069=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1751.236=5.250
σ0.365-0.363=0.002
min1755.909-1750.671=5.238
max1757.072-1751.815=5.257
mean1647.900-1651.650=-3.750
σ642.307-645.486=-3.179
min623.000-648.000=-25.000
max2840.000-2843.000=-3.000
mean2.345-2.805=-0.459
σ0.098-0.204=-0.106
min2.245-2.361=-0.116
max2.583-3.233=-0.650

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.683-275.565=49.118
σ0.041-0.006=0.035
min324.611-275.559=49.053
max324.708-275.573=49.135
mean2840.000-2843.000=-3.000
σ0.000
min2840.000-2843.000=-3.000
max2840.000-2843.000=-3.000
mean0.430-0.387=0.043
σ0.007-0.002=0.006
min0.423-0.384=0.039
max0.440-0.389=0.051
iters=5
new-facts=1
prior-facts=6402
mean1985.261-2168.090=-182.829
σ0.015-0.022=-0.008
min1985.244-2168.059=-182.815
max1985.273-2168.117=-182.844
mean2840.000-2843.000=-3.000
σ0.000
min2840.000-2843.000=-3.000
max2840.000-2843.000=-3.000
mean2.659-2.844=-0.185
σ0.146-0.129=0.017
min2.520-2.673=-0.153
max2.855-2.995=-0.139
iters=5
new-facts=6402
prior-facts=1
mean4808.898-5047.949=-239.051
σ7.688-0.923=6.766
min4805.396-5047.372=-241.976
max4822.651-5049.590=-226.939
mean2840.000-2843.000=-3.000
σ0.000
min2840.000-2843.000=-3.000
max2840.000-2843.000=-3.000
mean9.109-8.872=0.236
σ0.292-0.641=-0.349
min8.673-8.091=0.582
max9.362-9.533=-0.171
iters=5
new-facts=6402
prior-facts=6402
mean4996.469-5179.048=-182.579
σ0.009-0.095=-0.087
min4996.458-5178.958=-182.500
max4996.480-5179.154=-182.674
mean3041.800-3283.000=-241.200
σ203.884-392.859=-188.975
min2840.000-2843.000=-3.000
max3319.000-3848.000=-529.000
mean8.806-9.712=-0.906
σ0.247-0.588=-0.340
min8.501-8.795=-0.294
max9.144-10.177=-1.033

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.998-1.098=-0.099
σ0.062-0.217=-0.155
min0.920-0.972=-0.052
max1.048-1.475=-0.427

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.978-463.203=-0.225
σ574.252-572.650=1.602
min175.838-176.870=-1.032
max1324.356-1322.178=2.178
mean86.250-77.500=8.750
σ8.500-7.000=1.500
min82.000-74.000=8.000
max99.000-88.000=11.000
mean2840.000-2843.000=-3.000
σ0.000
min2840.000-2843.000=-3.000
max2840.000-2843.000=-3.000
mean0.431-0.439=-0.008
σ0.299-0.313=-0.014
min0.276-0.275=0.001
max0.880-0.908=-0.028
policies=20
mean1758.707-1768.973=-10.266
σ0.347-0.346=0.001
min1758.470-1768.734=-10.264
max1759.220-1769.484=-10.263
mean820.000-740.000=80.000
σ0.000
min820.000-740.000=80.000
max820.000-740.000=80.000
mean2840.000-2843.000=-3.000
σ0.000
min2840.000-2843.000=-3.000
max2840.000-2843.000=-3.000
mean2.803-2.850=-0.047
σ0.007-0.017=-0.010
min2.797-2.829=-0.032
max2.814-2.871=-0.057
policies=200
mean17593.288-17696.042=-102.754
σ0.676-0.488=0.188
min17592.420-17695.732=-103.311
max17593.861-17696.765=-102.904
mean8200.000-7400.000=800.000
σ0.000
min8200.000-7400.000=800.000
max8200.000-7400.000=800.000
mean2840.000-2843.000=-3.000
σ0.000
min2840.000-2843.000=-3.000
max2840.000-2843.000=-3.000
mean27.931-28.156=-0.224
σ0.374-0.531=-0.157
min27.475-27.502=-0.027
max28.362-28.646=-0.283