Compare commits

Home / Compare 41dc3dbc .. 95ef81db

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.063-73.046=0.017
σ0.053-0.044=0.010
min73.037-73.027=0.010
max73.213-73.169=0.044
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.163-0.166=-0.003
σ0.003-0.011=-0.008
min0.161-0.150=0.010
max0.170-0.182=-0.012
cache=y
dps=1
iters=10
policies=100
mean23.755-23.739=0.016
σ0.003-0.003=-0.001
min23.750-23.735=0.016
max23.759-23.746=0.013
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.069-0.065=0.004
σ0.003-0.004=-0.001
min0.066-0.060=0.006
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.819-1758.790=-2.971
σ0.361-0.361=-0.000
min1755.252-1758.212=-2.960
max1756.405-1759.375=-2.970
mean1656.150-1643.500=12.650
σ636.606-624.541=12.065
min616.000-620.000=-4.000
max2784.000-2772.000=12.000
mean2.879-2.860=0.019
σ0.154-0.085=0.069
min2.629-2.715=-0.085
max3.354-3.031=0.323

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.043-324.009=-2.965
σ0.055-0.051=0.004
min320.945-323.918=-2.973
max321.073-324.039=-2.965
mean2784.000-2772.000=12.000
σ0.000
min2784.000-2772.000=12.000
max2784.000-2772.000=12.000
mean0.425-0.426=-0.002
σ0.002-0.005=-0.002
min0.421-0.424=-0.003
max0.428-0.435=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1981.613-1984.595=-2.982
σ0.015-0.010=0.005
min1981.586-1984.581=-2.995
max1981.625-1984.607=-2.982
mean2784.000-2772.000=12.000
σ0.000
min2784.000-2772.000=12.000
max2784.000-2772.000=12.000
mean2.671-2.594=0.077
σ0.134-0.117=0.016
min2.531-2.454=0.077
max2.852-2.737=0.115
iters=5
new-facts=6402
prior-facts=1
mean4805.125-4808.239=-3.114
σ7.791-7.818=-0.027
min4801.192-4804.675=-3.484
max4819.054-4822.224=-3.170
mean2784.000-2772.000=12.000
σ0.000
min2784.000-2772.000=12.000
max2784.000-2772.000=12.000
mean8.752-8.937=-0.185
σ0.229-0.200=0.029
min8.523-8.591=-0.068
max9.038-9.099=-0.062
iters=5
new-facts=6402
prior-facts=6402
mean4992.830-4995.811=-2.981
σ0.025-0.014=0.011
min4992.802-4995.798=-2.996
max4992.859-4995.833=-2.975
mean3071.600-3029.000=42.600
σ297.743-217.800=79.942
min2784.000-2772.000=12.000
max3378.000-3324.000=54.000
mean8.676-8.688=-0.012
σ0.203-0.257=-0.053
min8.431-8.441=-0.010
max8.924-9.113=-0.189

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.073-1.003=0.070
σ0.218-0.138=0.080
min0.908-0.911=-0.004
max1.441-1.230=0.211

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.418-468.353=-5.935
σ574.242-574.229=0.013
min175.293-181.230=-5.937
max1323.782-1329.697=-5.915
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2784.000-2772.000=12.000
σ0.000
min2784.000-2772.000=12.000
max2784.000-2772.000=12.000
mean0.427-0.480=-0.053
σ0.299-0.378=-0.078
min0.272-0.289=-0.016
max0.876-1.046=-0.170
policies=20
mean1753.224-1812.628=-59.405
σ0.376-0.387=-0.011
min1752.972-1812.353=-59.380
max1753.784-1813.197=-59.413
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2784.000-2772.000=12.000
σ0.000
min2784.000-2772.000=12.000
max2784.000-2772.000=12.000
mean2.769-2.881=-0.112
σ0.009-0.008=0.000
min2.758-2.870=-0.112
max2.778-2.890=-0.112
policies=200
mean17537.564-18131.638=-594.074
σ0.635-0.505=0.130
min17537.191-18131.319=-594.128
max17538.514-18132.389=-593.875
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2784.000-2772.000=12.000
σ0.000
min2784.000-2772.000=12.000
max2784.000-2772.000=12.000
mean27.443-28.343=-0.899
σ0.147-0.128=0.019
min27.236-28.229=-0.992
max27.570-28.518=-0.948