Compare commits

Home / Compare bc4eb76a .. 284f9b78

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.794-35.795=-0.001
σ0.108-0.109=-0.001
min35.738-35.739=-0.001
max36.100-36.102=-0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.074-0.072=0.002
σ0.004-0.004=-0.001
min0.069-0.068=0.001
max0.080-0.081=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.066-26.066=0.000
σ0.005-0.003=0.002
min26.055-26.061=-0.005
max26.070-26.071=-0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.061-0.061=-0.001
σ0.003-0.002=0.001
min0.057-0.059=-0.002
max0.068-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.999-1756.999=-0.000
σ0.369-0.364=0.005
min1756.423-1756.425=-0.002
max1757.594-1757.568=0.025
mean1662.950-1654.950=8.000
σ626.983-635.849=-8.866
min675.000-670.000=5.000
max2745.000-2731.000=14.000
mean2.813-2.871=-0.058
σ0.191-0.150=0.042
min2.292-2.513=-0.221
max3.086-3.148=-0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.284-278.264=0.020
σ0.006-0.007=-0.001
min278.274-278.258=0.016
max278.290-278.277=0.013
mean2745.000-2731.000=14.000
σ0.000
min2745.000-2731.000=14.000
max2745.000-2731.000=14.000
mean0.412-0.414=-0.002
σ0.008-0.011=-0.002
min0.403-0.404=-0.002
max0.423-0.428=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2175.540-2175.522=0.018
σ0.024-0.011=0.013
min2175.517-2175.510=0.008
max2175.578-2175.537=0.041
mean2745.000-2731.000=14.000
σ0.000
min2745.000-2731.000=14.000
max2745.000-2731.000=14.000
mean2.923-2.886=0.036
σ0.177-0.230=-0.053
min2.741-2.687=0.054
max3.165-3.277=-0.112
iters=5
new-facts=6402
prior-facts=1
mean5134.569-5134.468=0.100
σ0.977-1.061=-0.084
min5134.065-5133.600=0.465
max5136.315-5136.317=-0.002
mean2745.000-2731.000=14.000
σ0.000
min2745.000-2731.000=14.000
max2745.000-2731.000=14.000
mean8.933-9.075=-0.142
σ0.324-0.323=0.001
min8.490-8.617=-0.127
max9.296-9.528=-0.233
iters=5
new-facts=6402
prior-facts=6402
mean5238.376-5238.359=0.017
σ0.096-0.102=-0.006
min5238.293-5238.265=0.028
max5238.486-5238.470=0.016
mean3256.400-3205.600=50.800
σ444.151-448.846=-4.695
min2745.000-2731.000=14.000
max3849.000-3841.000=8.000
mean8.984-8.829=0.155
σ0.298-0.101=0.197
min8.519-8.732=-0.213
max9.229-8.987=0.242

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.084-1.037=0.047
σ0.111-0.134=-0.023
min0.943-0.945=-0.002
max1.253-1.254=-0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.469-467.473=-0.004
σ572.657-572.658=-0.001
min181.134-181.134=-0.000
max1326.454-1326.460=-0.006
mean85.500
σ7.000
min82.000
max96.000
mean2745.000-2731.000=14.000
σ0.000
min2745.000-2731.000=14.000
max2745.000-2731.000=14.000
mean0.544-0.581=-0.037
σ0.502-0.575=-0.073
min0.286-0.292=-0.006
max1.297-1.443=-0.147
policies=20
mean1811.667-1811.664=0.004
σ0.385-0.376=0.009
min1811.407-1811.412=-0.005
max1812.235-1812.221=0.014
mean820.000
σ0.000
min820.000
max820.000
mean2745.000-2731.000=14.000
σ0.000
min2745.000-2731.000=14.000
max2745.000-2731.000=14.000
mean2.896-2.852=0.044
σ0.016-0.015=0.002
min2.874-2.836=0.038
max2.914-2.869=0.045
policies=200
mean18123.370-18123.512=-0.143
σ0.507-0.508=-0.001
min18123.031-18123.258=-0.227
max18124.119-18124.274=-0.155
mean8200.000
σ0.000
min8200.000
max8200.000
mean2745.000-2731.000=14.000
σ0.000
min2745.000-2731.000=14.000
max2745.000-2731.000=14.000
mean28.908-28.989=-0.081
σ0.079-0.289=-0.209
min28.832-28.674=0.157
max29.015-29.295=-0.280