Compare commits

Home / Compare c87fa0ed .. 1bc0c82e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.699-70.697=0.002
σ0.045-0.050=-0.004
min70.673-70.665=0.008
max70.823-70.837=-0.013
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.161-0.161=-0.001
σ0.002-0.003=-0.000
min0.159-0.159=-0.000
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.420-21.423=-0.003
σ0.003-0.011=-0.008
min21.415-21.415=0.001
max21.425-21.453=-0.028
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.061-0.063=-0.002
σ0.003-0.004=-0.001
min0.058-0.060=-0.001
max0.068-0.073=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.456-1754.459=-0.002
σ0.360-0.360=-0.000
min1753.890-1753.892=-0.001
max1755.038-1755.035=0.003
mean1662.900-1645.550=17.350
σ632.689-633.043=-0.354
min673.000-614.000=59.000
max2686.000-2772.000=-86.000
mean2.831-2.863=-0.032
σ0.135-0.174=-0.039
min2.537-2.304=0.233
max3.038-3.215=-0.177

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.500-273.498=0.002
σ0.005-0.006=-0.001
min273.493-273.493=-0.001
max273.506-273.508=-0.002
mean2686.000-2772.000=-86.000
σ0.000
min2686.000-2772.000=-86.000
max2686.000-2772.000=-86.000
mean0.373-0.374=-0.000
σ0.002-0.003=-0.001
min0.373-0.371=0.001
max0.376-0.378=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.891-1933.887=0.003
σ0.016-0.012=0.004
min1933.865-1933.868=-0.003
max1933.904-1933.899=0.005
mean2686.000-2772.000=-86.000
σ0.000
min2686.000-2772.000=-86.000
max2686.000-2772.000=-86.000
mean3.033-2.928=0.104
σ0.075-0.101=-0.026
min2.938-2.808=0.131
max3.112-3.083=0.029
iters=5
new-facts=6402
prior-facts=1
mean4754.607-4754.639=-0.032
σ0.904-0.889=0.015
min4754.138-4754.165=-0.027
max4756.223-4756.225=-0.002
mean2686.000-2772.000=-86.000
σ0.000
min2686.000-2772.000=-86.000
max2686.000-2772.000=-86.000
mean8.898-8.792=0.106
σ0.146-0.214=-0.068
min8.746-8.493=0.254
max9.122-9.042=0.080
iters=5
new-facts=6402
prior-facts=6402
mean4945.049-4945.118=-0.069
σ0.164-0.018=0.146
min4944.757-4945.098=-0.341
max4945.137-4945.138=-0.001
mean2960.000-3010.000=-50.000
σ264.631-295.079=-30.448
min2686.000-2772.000=-86.000
max3364.000-3463.000=-99.000
mean8.427-8.376=0.052
σ0.108-0.046=0.063
min8.319-8.329=-0.010
max8.579-8.425=0.155

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.127-1.076=0.051
σ0.144-0.113=0.031
min0.938-0.937=0.000
max1.283-1.252=0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.063-473.061=0.002
σ575.932-575.929=0.003
min185.092-185.090=0.002
max1336.962-1336.955=0.006
mean88.250
σ8.500
min84.000
max101.000
mean2686.000-2772.000=-86.000
σ0.000
min2686.000-2772.000=-86.000
max2686.000-2772.000=-86.000
mean0.565-0.451=0.114
σ0.558-0.299=0.258
min0.282-0.298=-0.016
max1.401-0.900=0.502
policies=20
mean1851.241-1851.283=-0.043
σ0.374-0.382=-0.008
min1850.991-1851.018=-0.027
max1851.794-1851.845=-0.052
mean840.000
σ0.000
min840.000
max840.000
mean2686.000-2772.000=-86.000
σ0.000
min2686.000-2772.000=-86.000
max2686.000-2772.000=-86.000
mean2.854-2.919=-0.065
σ0.017-0.086=-0.069
min2.840-2.846=-0.006
max2.878-3.043=-0.165
policies=200
mean18519.471-18519.363=0.107
σ0.505-0.448=0.058
min18519.146-18519.052=0.094
max18520.224-18520.026=0.198
mean8400.000
σ0.000
min8400.000
max8400.000
mean2686.000-2772.000=-86.000
σ0.000
min2686.000-2772.000=-86.000
max2686.000-2772.000=-86.000
mean28.860-28.829=0.031
σ0.077-0.057=0.020
min28.788-28.764=0.024
max28.968-28.893=0.075