Compare commits

Home / Compare cb237a8e .. 9f435ecf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.697=-0.001
σ0.046-0.047=-0.001
min70.672-70.674=-0.001
max70.824-70.828=-0.004
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.160-0.159=0.000
σ0.004-0.005=-0.001
min0.154-0.151=0.002
max0.168-0.169=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.420-21.421=-0.001
σ0.003-0.003=0.000
min21.415-21.418=-0.003
max21.423-21.427=-0.003
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.061-0.063=-0.002
σ0.004-0.004=-0.000
min0.058-0.060=-0.001
max0.067-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.458=-0.000
σ0.361-0.360=0.001
min1753.891-1753.886=0.005
max1755.039-1755.038=0.002
mean1675.450-1673.550=1.900
σ649.794-649.852=-0.057
min629.000-625.000=4.000
max2871.000-2868.000=3.000
mean2.834-2.820=0.014
σ0.098-0.100=-0.002
min2.593-2.621=-0.028
max2.984-2.967=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.504-273.502=0.002
σ0.007-0.005=0.002
min273.495-273.496=-0.001
max273.513-273.509=0.005
mean2871.000-2868.000=3.000
σ0.000
min2871.000-2868.000=3.000
max2871.000-2868.000=3.000
mean0.376-0.384=-0.007
σ0.005-0.004=0.001
min0.372-0.379=-0.008
max0.386-0.391=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.893-1933.900=-0.007
σ0.011-0.021=-0.011
min1933.881-1933.879=0.002
max1933.902-1933.933=-0.031
mean2871.000-2868.000=3.000
σ0.000
min2871.000-2868.000=3.000
max2871.000-2868.000=3.000
mean2.955-2.878=0.077
σ0.057-0.253=-0.196
min2.875-2.445=0.430
max3.020-3.097=-0.077
iters=5
new-facts=6402
prior-facts=1
mean4754.644-4754.653=-0.008
σ0.805-0.832=-0.027
min4754.158-4754.165=-0.007
max4756.069-4756.135=-0.066
mean2871.000-2868.000=3.000
σ0.000
min2871.000-2868.000=3.000
max2871.000-2868.000=3.000
mean8.687-8.551=0.136
σ0.424-0.269=0.155
min8.153-8.292=-0.140
max9.015-8.997=0.018
iters=5
new-facts=6402
prior-facts=6402
mean4945.121-4945.122=-0.001
σ0.013-0.015=-0.002
min4945.109-4945.108=0.002
max4945.138-4945.144=-0.006
mean3067.200-3023.800=43.400
σ193.133-178.203=14.930
min2871.000-2868.000=3.000
max3316.000-3303.000=13.000
mean8.646-8.482=0.164
σ0.054-0.141=-0.087
min8.584-8.359=0.225
max8.715-8.711=0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-1.085=-0.036
σ0.131-0.166=-0.035
min0.929-0.922=0.007
max1.252-1.265=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.079-473.065=0.015
σ575.912-575.922=-0.010
min185.115-185.090=0.025
max1336.947-1336.948=-0.000
mean88.250
σ8.500
min84.000
max101.000
mean2871.000-2868.000=3.000
σ0.000
min2871.000-2868.000=3.000
max2871.000-2868.000=3.000
mean0.479-0.486=-0.007
σ0.361-0.378=-0.018
min0.297-0.294=0.003
max1.020-1.053=-0.033
policies=20
mean1851.447-1851.279=0.167
σ0.375-0.374=0.002
min1851.160-1851.006=0.154
max1851.991-1851.823=0.168
mean840.000
σ0.000
min840.000
max840.000
mean2871.000-2868.000=3.000
σ0.000
min2871.000-2868.000=3.000
max2871.000-2868.000=3.000
mean2.944-2.952=-0.008
σ0.005-0.007=-0.002
min2.937-2.944=-0.007
max2.948-2.961=-0.013
policies=200
mean18519.818-18519.510=0.308
σ0.860-0.490=0.370
min18518.975-18519.114=-0.139
max18520.830-18520.222=0.608
mean8400.000
σ0.000
min8400.000
max8400.000
mean2871.000-2868.000=3.000
σ0.000
min2871.000-2868.000=3.000
max2871.000-2868.000=3.000
mean29.073-29.080=-0.007
σ0.462-0.605=-0.144
min28.753-28.740=0.014
max29.758-29.986=-0.228