Compare commits

Home / Compare fa5c32b3 .. ed6c9997

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.001
σ0.366-0.368=-0.001
min53.781-53.785=-0.004
max54.956-54.960=-0.005
mean414.100-414.000=0.100
σ0.316-0.000=0.316
min414.000
max415.000-414.000=1.000
mean0.138-0.140=-0.002
σ0.006-0.004=0.001
min0.129-0.136=-0.007
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.140-43.141=-0.002
σ0.008-0.005=0.003
min43.126-43.132=-0.007
max43.156-43.148=0.008
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.118-0.121=-0.003
σ0.004-0.004=0.000
min0.113-0.115=-0.002
max0.125-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.808-991.806=0.002
σ1.242-1.226=0.016
min991.231-991.229=0.002
max997.035-996.959=0.076
mean1073.600-1069.800=3.800
σ318.872-313.816=5.056
min616.000
max1634.000-1649.000=-15.000
mean1.528-1.518=0.011
σ0.070-0.072=-0.002
min1.462-1.320=0.142
max1.735-1.667=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.414=-0.004
σ0.012-0.006=0.005
min285.395-285.408=-0.013
max285.423-285.422=0.001
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.380-0.390=-0.010
σ0.008-0.009=-0.001
min0.374-0.375=-0.001
max0.390-0.396=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.378-1285.377=0.001
σ0.135-0.134=0.001
min1285.314-1285.308=0.005
max1285.619-1285.616=0.002
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean2.039-1.938=0.101
σ0.221-0.123=0.098
min1.820-1.832=-0.012
max2.410-2.133=0.277
iters=5
new-facts=6402
prior-facts=1
mean1807.736-1807.718=0.018
σ6.991-7.054=-0.062
min1804.397-1804.342=0.056
max1820.227-1820.321=-0.094
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean4.255-4.239=0.016
σ0.149-0.293=-0.144
min4.103-3.949=0.154
max4.455-4.730=-0.275
iters=5
new-facts=6402
prior-facts=6402
mean2070.209-2070.200=0.010
σ0.035-0.012=0.023
min2070.186-2070.189=-0.003
max2070.270-2070.219=0.051
mean1838.000-1842.200=-4.200
σ187.293-176.204=11.089
min1634.000-1649.000=-15.000
max2094.000-2076.000=18.000
mean4.535-4.536=-0.001
σ0.239-0.051=0.187
min4.345-4.488=-0.143
max4.952-4.622=0.330

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.157=0.039
σ0.228-0.287=-0.059
min0.918-0.911=0.007
max1.504-1.598=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.782-436.784=-0.002
σ572.366-572.362=0.004
min150.596-150.598=-0.001
max1295.331-1295.327=0.004
mean90.250
σ8.500
min86.000
max103.000
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean0.522-0.525=-0.002
σ0.543-0.543=-0.000
min0.247-0.249=-0.002
max1.336-1.339=-0.003
policies=20
mean1506.267-1506.258=0.009
σ0.239-0.241=-0.003
min1506.104-1506.109=-0.005
max1506.622-1506.619=0.003
mean860.000
σ0.000
min860.000
max860.000
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean2.514-2.522=-0.007
σ0.013-0.021=-0.007
min2.503-2.504=-0.001
max2.531-2.544=-0.012
policies=200
mean15070.414-15070.156=0.257
σ0.062-0.358=-0.297
min15070.329-15069.619=0.710
max15070.470-15070.349=0.121
mean8600.000
σ0.000
min8600.000
max8600.000
mean1634.000-1649.000=-15.000
σ0.000
min1634.000-1649.000=-15.000
max1634.000-1649.000=-15.000
mean25.490-25.535=-0.045
σ0.177-0.152=0.025
min25.320-25.328=-0.007
max25.666-25.677=-0.011