Compare commits

Home / Compare e4918834 .. c8250065

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.975-35.973=0.001
σ0.106-0.106=0.000
min35.928-35.927=0.001
max36.276-36.274=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.078-0.078=-0.000
σ0.004-0.004=-0.000
min0.075-0.075=-0.000
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean26.209-26.208=0.001
σ0.004-0.004=0.000
min26.203-26.203=0.000
max26.215
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.062-0.061=0.002
σ0.002-0.003=-0.001
min0.061-0.058=0.003
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1758.364=-0.001
σ0.372-0.373=-0.001
min1757.790-1757.790=0.000
max1758.964-1758.962=0.002
mean1657.250-1639.150=18.100
σ623.575-625.460=-1.885
min686.000-642.000=44.000
max2768.000-2836.000=-68.000
mean2.375-2.374=0.000
σ0.098-0.108=-0.009
min2.268-2.278=-0.009
max2.603-2.763=-0.160

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.508-279.514=-0.006
σ0.005-0.005=-0.001
min279.502-279.508=-0.006
max279.515-279.521=-0.006
mean2768.000-2836.000=-68.000
σ0.000
min2768.000-2836.000=-68.000
max2768.000-2836.000=-68.000
mean0.409-0.407=0.002
σ0.007-0.002=0.005
min0.403-0.405=-0.003
max0.419-0.410=0.009
iters=5
new-facts=1
prior-facts=6402
mean2178.430-2178.425=0.004
σ0.011-0.025=-0.014
min2178.419-2178.383=0.036
max2178.443-2178.442=0.001
mean2768.000-2836.000=-68.000
σ0.000
min2768.000-2836.000=-68.000
max2768.000-2836.000=-68.000
mean3.327-3.333=-0.006
σ0.117-0.283=-0.166
min3.200-2.867=0.333
max3.465-3.553=-0.088
iters=5
new-facts=6402
prior-facts=1
mean5056.368-5056.277=0.091
σ0.975-0.748=0.227
min5055.758-5055.803=-0.045
max5058.098-5057.603=0.495
mean2768.000-2836.000=-68.000
σ0.000
min2768.000-2836.000=-68.000
max2768.000-2836.000=-68.000
mean9.171-8.809=0.362
σ0.515-0.674=-0.159
min8.278-8.322=-0.044
max9.549-9.932=-0.383
iters=5
new-facts=6402
prior-facts=6402
mean5193.742-5193.686=0.056
σ0.069-0.127=-0.058
min5193.689-5193.498=0.192
max5193.852-5193.856=-0.003
mean3288.000-3307.200=-19.200
σ383.766-365.011=18.755
min2768.000-2836.000=-68.000
max3654.000-3664.000=-10.000
mean9.123-9.032=0.091
σ0.461-0.409=0.052
min8.819-8.690=0.130
max9.940-9.738=0.202

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.980-0.951=0.029
σ0.056-0.010=0.046
min0.945-0.944=0.001
max1.079-0.968=0.111

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.483-465.493=-0.011
σ572.668-572.659=0.010
min179.140-179.157=-0.017
max1324.485-1324.481=0.004
mean79.500
σ7.000
min76.000
max90.000
mean2768.000-2836.000=-68.000
σ0.000
min2768.000-2836.000=-68.000
max2768.000-2836.000=-68.000
mean0.480-0.439=0.041
σ0.396-0.299=0.097
min0.278-0.287=-0.009
max1.074-0.888=0.186
policies=20
mean1791.702-1791.861=-0.158
σ0.327-0.345=-0.018
min1791.501-1791.620=-0.119
max1792.187-1792.367=-0.181
mean760.000
σ0.000
min760.000
max760.000
mean2768.000-2836.000=-68.000
σ0.000
min2768.000-2836.000=-68.000
max2768.000-2836.000=-68.000
mean2.801-2.872=-0.071
σ0.051-0.011=0.040
min2.756-2.862=-0.106
max2.875-2.887=-0.012
policies=200
mean17923.398-17923.802=-0.403
σ0.363-0.743=-0.379
min17923.207-17923.046=0.161
max17923.943-17924.566=-0.623
mean7600.000
σ0.000
min7600.000
max7600.000
mean2768.000-2836.000=-68.000
σ0.000
min2768.000-2836.000=-68.000
max2768.000-2836.000=-68.000
mean28.212-28.537=-0.325
σ0.136-0.395=-0.260
min28.083-28.068=0.015
max28.330-28.992=-0.662