Compare commits

Home / Compare 968e6573 .. d2a949ca

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.001
σ0.368-0.369=-0.001
min53.783-53.784=-0.000
max54.962-54.965=-0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.137-0.146=-0.009
σ0.004-0.010=-0.006
min0.131-0.134=-0.002
max0.143-0.161=-0.019
cache=y
dps=1
iters=10
policies=100
mean43.140-43.146=-0.006
σ0.006-0.009=-0.002
min43.131-43.132=-0.001
max43.152-43.166=-0.015
mean416.400-414.000=2.400
σ0.516-0.000=0.516
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.120-0.141=-0.021
σ0.005-0.004=0.001
min0.113-0.135=-0.022
max0.128-0.149=-0.021

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.139-992.136=0.003
σ1.205-1.221=-0.016
min991.607-991.596=0.011
max997.190-997.259=-0.069
mean1057.350-1048.050=9.300
σ310.954-309.647=1.307
min603.000-600.000=3.000
max1516.000
mean1.558-1.546=0.012
σ0.136-0.140=-0.004
min1.454-1.411=0.043
max2.066-2.060=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.724-285.723=0.002
σ0.011-0.010=0.001
min285.710-285.713=-0.003
max285.736-285.734=0.002
mean1516.000
σ0.000
min1516.000
max1516.000
mean0.389-0.377=0.012
σ0.008-0.001=0.007
min0.376-0.375=0.001
max0.395-0.379=0.016
iters=5
new-facts=1
prior-facts=6402
mean1285.799-1285.781=0.018
σ0.072-0.082=-0.010
min1285.696-1285.643=0.053
max1285.869-1285.846=0.023
mean1516.000
σ0.000
min1516.000
max1516.000
mean2.004-1.924=0.080
σ0.279-0.085=0.194
min1.821-1.816=0.006
max2.483-2.031=0.452
iters=5
new-facts=6402
prior-facts=1
mean1706.118-1706.111=0.007
σ6.933-6.845=0.087
min1702.918-1702.922=-0.004
max1718.516-1718.351=0.166
mean1516.000
σ0.000
min1516.000
max1516.000
mean2.949-3.004=-0.055
σ0.531-0.371=0.161
min2.526-2.560=-0.034
max3.849-3.382=0.467
iters=5
new-facts=6402
prior-facts=6402
mean1968.720-1968.675=0.044
σ0.046-0.072=-0.026
min1968.656-1968.588=0.067
max1968.786-1968.734=0.052
mean1738.000-1780.200=-42.200
σ168.394-184.752=-16.358
min1516.000-1536.000=-20.000
max1947.000-2006.000=-59.000
mean3.282-3.297=-0.015
σ0.345-0.294=0.051
min3.026-3.067=-0.041
max3.872-3.679=0.192

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.579-1.540=0.039
σ0.324-0.247=0.077
min1.223-1.228=-0.006
max1.869-1.812=0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.373-437.375=-0.001
σ572.352-572.354=-0.002
min151.192-151.192=-0.000
max1295.902-1295.907=-0.005
mean90.250
σ8.500
min86.000
max103.000
mean1516.000
σ0.000
min1516.000
max1516.000
mean0.514-0.527=-0.013
σ0.516-0.549=-0.033
min0.250-0.250=0.000
max1.289-1.351=-0.062
policies=20
mean1512.206-1512.187=0.019
σ0.256-0.252=0.004
min1512.039-1512.013=0.025
max1512.586-1512.561=0.025
mean860.000
σ0.000
min860.000
max860.000
mean1516.000
σ0.000
min1516.000
max1516.000
mean2.529-2.530=-0.001
σ0.015-0.019=-0.003
min2.513-2.506=0.007
max2.549-2.552=-0.003
policies=200
mean15129.580-15129.689=-0.109
σ0.110-0.113=-0.002
min15129.418-15129.535=-0.117
max15129.662-15129.786=-0.124
mean8600.000
σ0.000
min8600.000
max8600.000
mean1516.000
σ0.000
min1516.000
max1516.000
mean25.722-25.713=0.009
σ0.225-0.038=0.188
min25.434-25.666=-0.232
max25.902-25.758=0.144