Compare commits

Home / Compare 883dfe24 .. 60289c49

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.964=0.002
σ0.103-0.102=0.000
min35.920-35.919=0.001
max36.256-36.254=0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.076-0.076=0.000
σ0.004-0.003=0.001
min0.074-0.074=0.000
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean26.209-26.208=0.001
σ0.004-0.004=-0.000
min26.205-26.203=0.002
max26.215-26.215=-0.000
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.061-0.061=0.000
σ0.003-0.003=-0.000
min0.059-0.059=-0.000
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.314-1756.313=0.001
σ0.370-0.368=0.002
min1755.737-1755.737=-0.001
max1756.908-1756.905=0.003
mean1674.300-1658.050=16.250
σ633.459-635.605=-2.146
min680.000-609.000=71.000
max2682.000-2736.000=-54.000
mean2.340-2.348=-0.008
σ0.073-0.109=-0.036
min2.238-2.219=0.019
max2.496-2.703=-0.207

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.850-278.849=0.001
σ0.004-0.005=-0.001
min278.845-278.845=0.000
max278.854-278.858=-0.003
mean2682.000-2736.000=-54.000
σ0.000
min2682.000-2736.000=-54.000
max2682.000-2736.000=-54.000
mean0.411-0.410=0.000
σ0.004-0.004=0.000
min0.407-0.407=-0.000
max0.418-0.418=0.000
iters=5
new-facts=1
prior-facts=6402
mean2268.906-2268.903=0.003
σ0.011-0.014=-0.003
min2268.894-2268.887=0.008
max2268.922-2268.918=0.004
mean2682.000-2736.000=-54.000
σ0.000
min2682.000-2736.000=-54.000
max2682.000-2736.000=-54.000
mean3.208-2.947=0.261
σ0.227-0.164=0.062
min2.876-2.851=0.025
max3.504-3.238=0.266
iters=5
new-facts=6402
prior-facts=1
mean4954.281-4953.928=0.353
σ0.849-1.133=-0.284
min4953.866-4952.871=0.994
max4955.797-4955.818=-0.021
mean2682.000-2736.000=-54.000
σ0.000
min2682.000-2736.000=-54.000
max2682.000-2736.000=-54.000
mean8.007-7.993=0.014
σ0.376-0.405=-0.028
min7.639-7.668=-0.029
max8.618-8.670=-0.052
iters=5
new-facts=6402
prior-facts=6402
mean5168.742-5168.809=-0.067
σ0.128-0.084=0.044
min5168.548-5168.743=-0.195
max5168.908-5168.903=0.005
mean3355.000-3438.600=-83.600
σ408.538-490.788=-82.250
min2949.000-2796.000=153.000
max3766.000-4086.000=-320.000
mean9.126-9.415=-0.289
σ0.261-0.270=-0.009
min8.683-8.988=-0.305
max9.338-9.656=-0.319

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.033-1.029=0.005
σ0.130-0.135=-0.005
min0.945-0.940=0.006
max1.255-1.247=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.365-460.358=0.007
σ572.658-572.651=0.006
min174.027-174.024=0.003
max1319.352-1319.335=0.016
mean79.500
σ7.000
min76.000
max90.000
mean2682.000-2736.000=-54.000
σ0.000
min2682.000-2736.000=-54.000
max2682.000-2736.000=-54.000
mean0.549-0.550=-0.000
σ0.553-0.567=-0.014
min0.268-0.263=0.005
max1.379-1.401=-0.022
policies=20
mean1740.497-1740.479=0.017
σ0.311-0.303=0.008
min1740.299-1740.279=0.020
max1740.961-1740.930=0.031
mean760.000
σ0.000
min760.000
max760.000
mean2682.000-2736.000=-54.000
σ0.000
min2682.000-2736.000=-54.000
max2682.000-2736.000=-54.000
mean2.665-2.661=0.004
σ0.007-0.001=0.006
min2.658-2.660=-0.001
max2.675-2.662=0.013
policies=200
mean17411.892-17411.840=0.052
σ0.368-0.415=-0.047
min17411.687-17411.500=0.187
max17412.443-17412.441=0.002
mean7600.000
σ0.000
min7600.000
max7600.000
mean2682.000-2736.000=-54.000
σ0.000
min2682.000-2736.000=-54.000
max2682.000-2736.000=-54.000
mean26.941-26.900=0.041
σ0.030-0.057=-0.027
min26.910-26.825=0.085
max26.981-26.960=0.021