Compare commits

Home / Compare 3313d5c0 .. 61501804

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.568=-0.006
σ0.044-0.045=-0.001
min70.539-70.540=-0.000
max70.687-70.691=-0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.157-0.160=-0.004
σ0.005-0.003=0.002
min0.150-0.158=-0.008
max0.162-0.166=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.291-21.288=0.002
σ0.010-0.003=0.007
min21.283-21.282=0.002
max21.319-21.292=0.027
mean414.700-416.000=-1.300
σ0.483-0.000=0.483
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.063-0.065=-0.002
σ0.003-0.002=0.001
min0.058-0.063=-0.005
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.569=0.000
σ0.360-0.362=-0.003
min1752.999-1752.998=0.000
max1754.155-1754.164=-0.009
mean1667.800-1650.550=17.250
σ646.884-616.427=30.457
min687.000-689.000=-2.000
max2774.000-2763.000=11.000
mean2.805-2.752=0.053
σ0.154-0.151=0.003
min2.308-2.477=-0.170
max2.987-2.962=0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.013-272.014=-0.001
σ0.008-0.005=0.003
min272.003-272.008=-0.005
max272.023-272.021=0.002
mean2774.000-2763.000=11.000
σ0.000
min2774.000-2763.000=11.000
max2774.000-2763.000=11.000
mean0.389-0.391=-0.002
σ0.010-0.007=0.003
min0.379-0.379=-0.000
max0.404-0.399=0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.442-1932.445=-0.003
σ0.011-0.009=0.002
min1932.431-1932.435=-0.004
max1932.457-1932.459=-0.001
mean2774.000-2763.000=11.000
σ0.000
min2774.000-2763.000=11.000
max2774.000-2763.000=11.000
mean2.920-2.899=0.021
σ0.191-0.174=0.017
min2.585-2.691=-0.106
max3.066-3.056=0.010
iters=5
new-facts=6402
prior-facts=1
mean4753.128-4753.041=0.087
σ0.863-0.637=0.226
min4752.697-4752.666=0.031
max4754.668-4754.173=0.495
mean2774.000-2763.000=11.000
σ0.000
min2774.000-2763.000=11.000
max2774.000-2763.000=11.000
mean8.765-8.721=0.044
σ0.272-0.241=0.031
min8.443-8.377=0.066
max9.070-9.000=0.071
iters=5
new-facts=6402
prior-facts=6402
mean4943.632-4943.630=0.002
σ0.015-0.014=0.002
min4943.612-4943.617=-0.005
max4943.649-4943.652=-0.003
mean3027.400-3029.400=-2.000
σ235.208-238.358=-3.150
min2774.000-2763.000=11.000
max3331.000-3333.000=-2.000
mean8.757-8.641=0.115
σ0.366-0.213=0.152
min8.432-8.417=0.015
max9.216-8.908=0.308

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.992-1.035=-0.043
σ0.143-0.137=0.006
min0.916-0.943=-0.027
max1.247-1.258=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.102-473.091=0.011
σ575.959-575.948=0.010
min185.116-185.114=0.002
max1337.040-1337.014=0.026
mean88.250
σ8.500
min84.000
max101.000
mean2774.000-2763.000=11.000
σ0.000
min2774.000-2763.000=11.000
max2774.000-2763.000=11.000
mean0.622-0.587=0.035
σ0.647-0.600=0.047
min0.295-0.285=0.010
max1.593-1.487=0.106
policies=20
mean1851.433-1851.412=0.021
σ0.368-0.375=-0.007
min1851.179-1851.152=0.027
max1851.976-1851.966=0.011
mean840.000
σ0.000
min840.000
max840.000
mean2774.000-2763.000=11.000
σ0.000
min2774.000-2763.000=11.000
max2774.000-2763.000=11.000
mean2.856-2.867=-0.011
σ0.029-0.009=0.019
min2.830-2.858=-0.028
max2.896-2.876=0.019
policies=200
mean18521.031-18521.098=-0.067
σ0.571-0.548=0.023
min18520.706-18520.675=0.031
max18521.886-18521.897=-0.011
mean8400.000
σ0.000
min8400.000
max8400.000
mean2774.000-2763.000=11.000
σ0.000
min2774.000-2763.000=11.000
max2774.000-2763.000=11.000
mean28.781-28.871=-0.090
σ0.189-0.079=0.110
min28.561-28.765=-0.204
max29.018-28.956=0.061