Compare commits

Home / Compare 825dc916 .. ace8d51c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.728-70.729=-0.000
σ0.045-0.047=-0.002
min70.706-70.700=0.006
max70.854-70.861=-0.007
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.157-0.156=0.001
σ0.005-0.003=0.001
min0.149-0.151=-0.002
max0.162-0.162=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=0.001
σ0.003-0.003=0.000
min21.442-21.441=0.001
max21.452-21.450=0.002
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.066-0.066=0.000
σ0.002-0.002=0.000
min0.064-0.064=0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.524-1754.526=-0.002
σ0.360-0.360=-0.001
min1753.964-1753.953=0.011
max1755.105-1755.109=-0.004
mean1662.550-1661.250=1.300
σ624.233-645.771=-21.538
min637.000-627.000=10.000
max2503.000-2779.000=-276.000
mean2.836-2.815=0.021
σ0.175-0.200=-0.025
min2.461-2.389=0.072
max3.272-3.353=-0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.612-273.608=0.004
σ0.005-0.006=-0.001
min273.606-273.598=0.009
max273.620-273.614=0.006
mean2503.000-2779.000=-276.000
σ0.000
min2503.000-2779.000=-276.000
max2503.000-2779.000=-276.000
mean0.387-0.389=-0.002
σ0.007-0.011=-0.004
min0.381-0.378=0.003
max0.398-0.403=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1934.002-1933.991=0.011
σ0.007-0.017=-0.009
min1933.994-1933.966=0.028
max1934.013-1934.012=0.001
mean2503.000-2779.000=-276.000
σ0.000
min2503.000-2779.000=-276.000
max2503.000-2779.000=-276.000
mean2.976-3.068=-0.091
σ0.214-0.070=0.143
min2.736-2.991=-0.256
max3.255-3.137=0.118
iters=5
new-facts=6402
prior-facts=1
mean4754.703-4754.689=0.014
σ0.907-0.920=-0.013
min4754.284-4754.220=0.064
max4756.325-4756.331=-0.006
mean2503.000-2779.000=-276.000
σ0.000
min2503.000-2779.000=-276.000
max2503.000-2779.000=-276.000
mean8.881-8.874=0.007
σ0.031-0.282=-0.251
min8.850-8.492=0.358
max8.922-9.230=-0.307
iters=5
new-facts=6402
prior-facts=6402
mean4945.222-4945.219=0.003
σ0.014-0.015=-0.001
min4945.202-4945.204=-0.002
max4945.240-4945.243=-0.003
mean2988.800-3014.400=-25.600
σ286.732-298.513=-11.782
min2607.000-2779.000=-172.000
max3346.000-3462.000=-116.000
mean8.491-8.403=0.088
σ0.043-0.049=-0.006
min8.443-8.335=0.109
max8.543-8.461=0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.707-1.029=0.679
σ0.290-0.152=0.139
min1.274-0.930=0.343
max1.936-1.280=0.655

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.832-472.846=-0.014
σ574.930-574.926=0.004
min185.365-185.371=-0.005
max1335.227-1335.235=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2503.000-2779.000=-276.000
σ0.000
min2503.000-2779.000=-276.000
max2503.000-2779.000=-276.000
mean0.558-0.487=0.071
σ0.537-0.374=0.163
min0.288-0.297=-0.010
max1.363-1.047=0.316
policies=20
mean1853.982-1854.014=-0.032
σ0.380-0.364=0.017
min1853.712-1853.739=-0.027
max1854.539-1854.540=-0.002
mean840.000
σ0.000
min840.000
max840.000
mean2503.000-2779.000=-276.000
σ0.000
min2503.000-2779.000=-276.000
max2503.000-2779.000=-276.000
mean2.891-2.963=-0.071
σ0.054-0.090=-0.036
min2.840-2.868=-0.028
max2.959-3.084=-0.125
policies=200
mean18546.603-18546.695=-0.093
σ0.469-0.445=0.024
min18546.296-18546.406=-0.109
max18547.294-18547.355=-0.061
mean8400.000
σ0.000
min8400.000
max8400.000
mean2503.000-2779.000=-276.000
σ0.000
min2503.000-2779.000=-276.000
max2503.000-2779.000=-276.000
mean29.004-28.786=0.218
σ0.098-0.062=0.036
min28.929-28.707=0.223
max29.145-28.858=0.287