Compare commits

Home / Compare 8f789863 .. b5d444cc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.000
σ0.054-0.054=-0.000
min35.593-35.591=0.002
max35.771-35.771=0.000
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.085-0.084=0.001
σ0.003-0.003=-0.000
min0.082-0.080=0.003
max0.091-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean24.048-24.048=0.000
σ0.002-0.003=-0.001
min24.045-24.044=0.001
max24.052-24.053=-0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.068-0.067=0.001
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.074-0.074=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.492=-0.001
σ0.365-0.365=-0.000
min1755.917-1755.915=0.001
max1757.080-1757.077=0.003
mean1654.000-1654.700=-0.700
σ641.406-645.186=-3.780
min630.000-652.000=-22.000
max2847.000-2843.000=4.000
mean2.365-2.322=0.043
σ0.113-0.092=0.020
min2.233-2.212=0.020
max2.624-2.608=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.758=0.004
σ0.056-0.060=-0.004
min324.662-324.652=0.010
max324.800-324.800=0.000
mean2847.000-2843.000=4.000
σ0.000
min2847.000-2843.000=4.000
max2847.000-2843.000=4.000
mean0.432-0.425=0.007
σ0.008-0.001=0.007
min0.422-0.424=-0.002
max0.440-0.427=0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.308=0.009
σ0.016-0.018=-0.002
min1985.291-1985.285=0.006
max1985.330-1985.327=0.003
mean2847.000-2843.000=4.000
σ0.000
min2847.000-2843.000=4.000
max2847.000-2843.000=4.000
mean2.621-2.740=-0.119
σ0.068-0.122=-0.055
min2.551-2.576=-0.025
max2.715-2.897=-0.182
iters=5
new-facts=6402
prior-facts=1
mean4809.106-4808.935=0.171
σ7.628-7.684=-0.056
min4805.595-4805.428=0.166
max4822.749-4822.680=0.070
mean2847.000-2843.000=4.000
σ0.000
min2847.000-2843.000=4.000
max2847.000-2843.000=4.000
mean8.935-8.881=0.054
σ0.456-0.155=0.301
min8.367-8.762=-0.395
max9.633-9.142=0.490
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.468=0.161
σ0.023-0.156=-0.133
min4996.598-4996.190=0.408
max4996.653-4996.561=0.092
mean3056.600-3089.200=-32.600
σ226.085-231.435=-5.350
min2847.000-2843.000=4.000
max3393.000-3323.000=70.000
mean8.751-8.825=-0.073
σ0.170-0.437=-0.267
min8.496-8.485=0.010
max8.958-9.542=-0.584

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-0.948=-0.025
σ0.014-0.054=-0.041
min0.912-0.917=-0.005
max0.947-1.044=-0.098

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-462.948=0.259
σ574.766-574.251=0.515
min175.818-175.819=-0.002
max1325.356-1324.325=1.032
mean86.250
σ8.500
min82.000
max99.000
mean2847.000-2843.000=4.000
σ0.000
min2847.000-2843.000=4.000
max2847.000-2843.000=4.000
mean0.423-0.432=-0.009
σ0.292-0.298=-0.006
min0.271-0.280=-0.010
max0.861-0.879=-0.018
policies=20
mean1758.519-1758.525=-0.006
σ0.350-0.346=0.003
min1758.301-1758.307=-0.006
max1759.040-1759.039=0.001
mean820.000
σ0.000
min820.000
max820.000
mean2847.000-2843.000=4.000
σ0.000
min2847.000-2843.000=4.000
max2847.000-2843.000=4.000
mean2.780-2.782=-0.001
σ0.007-0.014=-0.007
min2.771-2.767=0.005
max2.788-2.799=-0.011
policies=200
mean17592.188-17592.105=0.083
σ0.486-0.445=0.041
min17591.867-17591.825=0.043
max17592.911-17592.765=0.146
mean8200.000
σ0.000
min8200.000
max8200.000
mean2847.000-2843.000=4.000
σ0.000
min2847.000-2843.000=4.000
max2847.000-2843.000=4.000
mean27.898-28.016=-0.117
σ0.342-0.275=0.067
min27.428-27.772=-0.344
max28.189-28.303=-0.114