Compare commits

Home / Compare 5801dd23 .. af9195a9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.001
σ0.368-0.367=0.000
min53.783-53.787=-0.004
max54.961-54.961=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.140-0.141=-0.001
σ0.005-0.003=0.001
min0.133-0.137=-0.004
max0.147-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.144-43.141=0.004
σ0.014-0.006=0.008
min43.131-43.130=0.001
max43.175-43.149=0.026
mean416.000-414.100=1.900
σ0.000-0.316=-0.316
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.122-0.121=0.001
σ0.004-0.005=-0.001
min0.119-0.114=0.005
max0.131-0.129=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.818-991.819=-0.001
σ1.246-1.250=-0.004
min991.232-991.233=-0.001
max997.053-997.072=-0.019
mean1071.900-1065.850=6.050
σ321.554-322.215=-0.661
min616.000-568.000=48.000
max1649.000-1639.000=10.000
mean1.515-1.522=-0.007
σ0.085-0.091=-0.006
min1.407-1.418=-0.011
max1.719-1.763=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.408=0.005
σ0.010-0.014=-0.004
min285.395-285.387=0.008
max285.420-285.424=-0.004
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.379-0.380=-0.001
σ0.011-0.009=0.002
min0.374-0.373=0.001
max0.399-0.395=0.004
iters=5
new-facts=1
prior-facts=6402
mean1285.363-1285.374=-0.010
σ0.110-0.128=-0.018
min1285.309-1285.314=-0.006
max1285.560-1285.603=-0.043
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean1.919-2.038=-0.119
σ0.083-0.246=-0.163
min1.842-1.860=-0.018
max2.056-2.399=-0.342
iters=5
new-facts=6402
prior-facts=1
mean1807.724-1807.712=0.012
σ7.000-7.035=-0.035
min1804.342-1804.325=0.016
max1820.231-1820.281=-0.050
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean4.253-4.193=0.060
σ0.211-0.260=-0.049
min3.978-3.848=0.130
max4.439-4.567=-0.127
iters=5
new-facts=6402
prior-facts=6402
mean2070.198-2070.197=0.000
σ0.012-0.011=0.001
min2070.183-2070.183=-0.001
max2070.214-2070.213=0.001
mean1831.600-1836.200=-4.600
σ164.394-169.661=-5.267
min1649.000-1639.000=10.000
max2063.000-2072.000=-9.000
mean4.532-4.521=0.012
σ0.089-0.044=0.045
min4.459-4.486=-0.026
max4.684-4.596=0.088

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.209-1.173=0.036
σ0.345-0.308=0.037
min0.915-0.904=0.011
max1.792-1.658=0.134

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.787-436.784=0.003
σ572.360-572.363=-0.003
min150.599-150.602=-0.003
max1295.328-1295.329=-0.001
mean90.250
σ8.500
min86.000
max103.000
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean0.520-0.530=-0.010
σ0.535-0.557=-0.022
min0.251-0.249=0.002
max1.322-1.365=-0.043
policies=20
mean1506.273-1506.251=0.022
σ0.241-0.229=0.012
min1506.117-1506.104=0.013
max1506.632-1506.592=0.040
mean860.000
σ0.000
min860.000
max860.000
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean2.522-2.515=0.007
σ0.013-0.014=-0.000
min2.508-2.501=0.006
max2.539-2.532=0.007
policies=200
mean15070.356-15070.353=0.003
σ0.072-0.108=-0.037
min15070.259-15070.252=0.007
max15070.417-15070.469=-0.052
mean8600.000
σ0.000
min8600.000
max8600.000
mean1649.000-1639.000=10.000
σ0.000
min1649.000-1639.000=10.000
max1649.000-1639.000=10.000
mean25.547-25.545=0.002
σ0.131-0.175=-0.044
min25.401-25.379=0.022
max25.690-25.755=-0.065