Compare commits

Home / Compare 4e123ea4 .. 96035c35

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.265-35.263=0.002
σ0.052-0.054=-0.002
min35.240-35.232=0.008
max35.413-35.415=-0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.084-0.084=-0.000
σ0.004-0.003=0.001
min0.077-0.082=-0.005
max0.092-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.771-23.769=0.002
σ0.002-0.002=0.000
min23.768-23.766=0.002
max23.775-23.773=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.068-0.067=0.001
σ0.004-0.002=0.001
min0.065-0.066=-0.001
max0.076-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.363=0.123
σ0.365-0.364=0.001
min1755.910-1755.789=0.121
max1757.075-1756.956=0.119
mean1659.700-1641.800=17.900
σ642.195-631.959=10.236
min629.000-624.000=5.000
max2780.000-2837.000=-57.000
mean2.343-2.331=0.012
σ0.082-0.066=0.015
min2.250-2.244=0.006
max2.548-2.467=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.708-324.591=0.117
σ0.054-0.037=0.017
min324.612-324.528=0.084
max324.734-324.620=0.115
mean2780.000-2837.000=-57.000
σ0.000
min2780.000-2837.000=-57.000
max2780.000-2837.000=-57.000
mean0.428-0.423=0.004
σ0.006-0.001=0.005
min0.423-0.422=0.000
max0.438-0.425=0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.269-1985.142=0.127
σ0.013-0.010=0.003
min1985.249-1985.134=0.114
max1985.282-1985.158=0.124
mean2780.000-2837.000=-57.000
σ0.000
min2780.000-2837.000=-57.000
max2780.000-2837.000=-57.000
mean2.646-2.679=-0.034
σ0.111-0.178=-0.067
min2.554-2.548=0.006
max2.812-2.936=-0.124
iters=5
new-facts=6402
prior-facts=1
mean4808.777-4808.741=0.036
σ7.726-7.665=0.061
min4804.844-4805.288=-0.444
max4822.587-4822.452=0.135
mean2780.000-2837.000=-57.000
σ0.000
min2780.000-2837.000=-57.000
max2780.000-2837.000=-57.000
mean8.721-8.939=-0.218
σ0.387-0.143=0.244
min8.082-8.815=-0.733
max9.097-9.121=-0.025
iters=5
new-facts=6402
prior-facts=6402
mean4996.458-4996.296=0.162
σ0.023-0.130=-0.107
min4996.431-4996.065=0.366
max4996.476-4996.371=0.104
mean3046.200-3052.800=-6.600
σ328.116-231.108=97.009
min2780.000-2837.000=-57.000
max3543.000-3394.000=149.000
mean8.551-8.865=-0.315
σ0.118-0.524=-0.406
min8.481-8.432=0.049
max8.761-9.726=-0.965

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.964-0.971=-0.007
σ0.074-0.063=0.011
min0.891-0.914=-0.023
max1.047-1.044=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-462.967=0.007
σ574.253-574.254=-0.001
min175.840-175.831=0.009
max1324.355-1324.349=0.006
mean86.250
σ8.500
min82.000
max99.000
mean2780.000-2837.000=-57.000
σ0.000
min2780.000-2837.000=-57.000
max2780.000-2837.000=-57.000
mean0.434-0.431=0.004
σ0.304-0.295=0.009
min0.280-0.279=0.001
max0.890-0.874=0.017
policies=20
mean1758.725-1758.691=0.034
σ0.367-0.349=0.018
min1758.465-1758.458=0.008
max1759.267-1759.209=0.058
mean820.000
σ0.000
min820.000
max820.000
mean2780.000-2837.000=-57.000
σ0.000
min2780.000-2837.000=-57.000
max2780.000-2837.000=-57.000
mean2.796-2.798=-0.002
σ0.006-0.006=-0.000
min2.787-2.790=-0.002
max2.800-2.805=-0.005
policies=200
mean17592.468-17593.298=-0.829
σ0.412-0.645=-0.233
min17592.228-17592.418=-0.190
max17593.085-17593.878=-0.792
mean8200.000
σ0.000
min8200.000
max8200.000
mean2780.000-2837.000=-57.000
σ0.000
min2780.000-2837.000=-57.000
max2780.000-2837.000=-57.000
mean27.433-27.931=-0.498
σ0.120-0.462=-0.342
min27.257-27.527=-0.270
max27.522-28.443=-0.921