Compare commits

Home / Compare 17d22dbd .. 298f7b4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean32.840-32.839=0.000
σ0.372-0.370=0.002
min32.707-32.707=0.000
max33.899-33.892=0.007
mean415.700-413.000=2.700
σ0.483-0.000=0.483
min415.000-413.000=2.000
max416.000-413.000=3.000
mean0.086-0.085=0.001
σ0.004-0.004=-0.001
min0.082-0.077=0.004
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean22.089-22.087=0.002
σ0.003-0.003=0.001
min22.082-22.082=0.001
max22.096-22.091=0.005
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.067-0.065=0.002
σ0.003-0.001=0.002
min0.065-0.063=0.002
max0.073-0.067=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean983.408-983.408=-0.000
σ1.107-1.107=0.000
min982.893-982.886=0.007
max988.054-988.051=0.003
mean1066.500-1050.900=15.600
σ325.444-304.547=20.897
min567.000-631.000=-64.000
max1633.000-1515.000=118.000
mean1.380-1.398=-0.018
σ0.054-0.072=-0.018
min1.305-1.332=-0.027
max1.483-1.590=-0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean262.594-262.594=0.000
σ0.010-0.008=0.002
min262.583-262.581=0.002
max262.602-262.599=0.003
mean1633.000-1515.000=118.000
σ0.000
min1633.000-1515.000=118.000
max1633.000-1515.000=118.000
mean0.353-0.356=-0.003
σ0.008-0.008=-0.000
min0.346-0.347=-0.001
max0.366-0.364=0.001
iters=5
new-facts=1
prior-facts=6402
mean1262.651-1262.655=-0.005
σ0.079-0.091=-0.012
min1262.613-1262.612=0.001
max1262.791-1262.818=-0.027
mean1633.000-1515.000=118.000
σ0.000
min1633.000-1515.000=118.000
max1633.000-1515.000=118.000
mean1.993-1.906=0.086
σ0.229-0.099=0.129
min1.778-1.789=-0.011
max2.381-2.020=0.361
iters=5
new-facts=6402
prior-facts=1
mean2058.207-2058.190=0.017
σ7.011-7.023=-0.013
min2054.873-2054.858=0.015
max2070.737-2070.742=-0.004
mean1633.000-1515.000=118.000
σ0.000
min1633.000-1515.000=118.000
max1633.000-1515.000=118.000
mean4.734-4.545=0.189
σ0.301-0.263=0.038
min4.236-4.279=-0.044
max5.034-4.860=0.174
iters=5
new-facts=6402
prior-facts=6402
mean2047.396-2047.396=0.000
σ0.002-0.006=-0.003
min2047.394-2047.391=0.003
max2047.400-2047.405=-0.005
mean1764.600-1821.000=-56.400
σ142.831-196.757=-53.926
min1633.000-1515.000=118.000
max1957.000-1982.000=-25.000
mean4.385-4.433=-0.048
σ0.056-0.035=0.021
min4.342-4.401=-0.059
max4.475-4.481=-0.006

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.156-1.546=-0.390
σ0.238-0.122=0.116
min0.903-1.336=-0.433
max1.475-1.642=-0.167

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.112-437.102=0.010
σ572.833-572.824=0.009
min150.688-150.683=0.004
max1296.361-1296.337=0.024
mean88.250
σ8.500
min84.000
max101.000
mean1633.000-1515.000=118.000
σ0.000
min1633.000-1515.000=118.000
max1633.000-1515.000=118.000
mean0.529-0.533=-0.004
σ0.571-0.565=0.006
min0.232-0.249=-0.017
max1.385-1.381=0.004
policies=20
mean1507.087-1507.090=-0.003
σ0.229-0.264=-0.034
min1506.928-1506.898=0.030
max1507.427-1507.479=-0.052
mean840.000
σ0.000
min840.000
max840.000
mean1633.000-1515.000=118.000
σ0.000
min1633.000-1515.000=118.000
max1633.000-1515.000=118.000
mean2.520-2.531=-0.011
σ0.011-0.034=-0.023
min2.514-2.500=0.014
max2.536-2.576=-0.041
policies=200
mean15078.623-15078.648=-0.025
σ0.570-0.399=0.171
min15078.257-15078.383=-0.126
max15079.466-15079.236=0.229
mean8400.000
σ0.000
min8400.000
max8400.000
mean1633.000-1515.000=118.000
σ0.000
min1633.000-1515.000=118.000
max1633.000-1515.000=118.000
mean25.480-25.451=0.029
σ0.143-0.128=0.015
min25.360-25.285=0.075
max25.667-25.575=0.093