Compare commits

Home / Compare 001b3b59 .. 61b4dee1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean32.841-32.839=0.002
σ0.372-0.372=-0.000
min32.710-32.707=0.003
max33.898-33.897=0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.084-0.085=-0.000
σ0.003-0.003=-0.000
min0.082-0.082=0.000
max0.092-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean22.088-22.088=0.000
σ0.003-0.004=-0.001
min22.083-22.083=-0.001
max22.092-22.096=-0.003
mean415.900-416.000=-0.100
σ0.316-0.000=0.316
min415.000-416.000=-1.000
max416.000
mean0.066-0.067=-0.001
σ0.002-0.003=-0.001
min0.064-0.065=-0.001
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean983.412-983.409=0.003
σ1.116-1.112=0.005
min982.892-982.889=0.003
max988.097-988.072=0.025
mean1057.200-1054.850=2.350
σ305.129-305.083=0.046
min648.000-635.000=13.000
max1513.000-1520.000=-7.000
mean1.394-1.381=0.013
σ0.079-0.065=0.013
min1.315-1.317=-0.001
max1.628-1.549=0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean262.590-262.593=-0.003
σ0.005-0.010=-0.005
min262.584-262.582=0.002
max262.595-262.605=-0.009
mean1513.000-1520.000=-7.000
σ0.000
min1513.000-1520.000=-7.000
max1513.000-1520.000=-7.000
mean0.356-0.353=0.002
σ0.007-0.011=-0.003
min0.347-0.345=0.002
max0.364-0.368=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1262.666-1262.650=0.016
σ0.110-0.081=0.029
min1262.613-1262.610=0.003
max1262.862-1262.794=0.068
mean1513.000-1520.000=-7.000
σ0.000
min1513.000-1520.000=-7.000
max1513.000-1520.000=-7.000
mean1.923-1.834=0.089
σ0.096-0.116=-0.019
min1.775-1.681=0.094
max2.038-1.969=0.069
iters=5
new-facts=6402
prior-facts=1
mean2058.163-2058.204=-0.041
σ6.877-7.015=-0.138
min2054.902-2054.874=0.028
max2070.452-2070.742=-0.290
mean1513.000-1520.000=-7.000
σ0.000
min1513.000-1520.000=-7.000
max1513.000-1520.000=-7.000
mean4.590-4.651=-0.061
σ0.239-0.282=-0.043
min4.304-4.363=-0.059
max4.849-5.043=-0.194
iters=5
new-facts=6402
prior-facts=6402
mean2047.396-2047.392=0.004
σ0.008-0.006=0.002
min2047.389-2047.386=0.003
max2047.409-2047.401=0.008
mean1755.200-1822.600=-67.400
σ186.209-203.147=-16.938
min1513.000-1520.000=-7.000
max1979.000-1994.000=-15.000
mean4.468-4.417=0.051
σ0.095-0.062=0.033
min4.376-4.355=0.021
max4.607-4.518=0.090

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.523-1.652=-0.129
σ0.310-0.213=0.097
min1.167-1.334=-0.167
max1.823-1.815=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.103-437.102=0.001
σ572.825-572.820=0.005
min150.686-150.688=-0.003
max1296.341-1296.332=0.009
mean88.250
σ8.500
min84.000
max101.000
mean1513.000-1520.000=-7.000
σ0.000
min1513.000-1520.000=-7.000
max1513.000-1520.000=-7.000
mean0.515-0.522=-0.007
σ0.523-0.546=-0.023
min0.250-0.247=0.003
max1.300-1.341=-0.042
policies=20
mean1507.077-1507.088=-0.010
σ0.258-0.250=0.008
min1506.890-1506.906=-0.016
max1507.458-1507.458=0.000
mean840.000
σ0.000
min840.000
max840.000
mean1513.000-1520.000=-7.000
σ0.000
min1513.000-1520.000=-7.000
max1513.000-1520.000=-7.000
mean2.512-2.510=0.002
σ0.022-0.019=0.003
min2.491-2.492=-0.001
max2.541-2.534=0.007
policies=200
mean15078.829-15078.696=0.133
σ0.444-0.577=-0.133
min15078.565-15078.346=0.219
max15079.491-15079.555=-0.063
mean8400.000
σ0.000
min8400.000
max8400.000
mean1513.000-1520.000=-7.000
σ0.000
min1513.000-1520.000=-7.000
max1513.000-1520.000=-7.000
mean25.400-25.347=0.053
σ0.091-0.123=-0.032
min25.300-25.202=0.098
max25.513-25.482=0.031