Compare commits

Home / Compare 282785c1 .. a6db3796

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956-35.956=-0.000
σ0.102-0.101=0.001
min35.912-35.904=0.008
max36.245-36.241=0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.075-0.077=-0.002
σ0.005-0.005=-0.000
min0.070-0.071=-0.001
max0.083-0.085=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.204-26.203=0.001
σ0.005-0.004=0.001
min26.197-26.198=-0.001
max26.211-26.211=0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.062-0.060=0.001
σ0.003-0.004=-0.001
min0.059-0.056=0.003
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.304-1756.304=-0.001
σ0.368-0.369=-0.001
min1755.725-1755.725=0.000
max1756.887-1756.895=-0.008
mean1664.000-1659.650=4.350
σ647.723-630.635=17.088
min629.000-621.000=8.000
max2821.000-2728.000=93.000
mean2.377-2.393=-0.016
σ0.068-0.122=-0.054
min2.288-2.288=-0.000
max2.537-2.798=-0.261

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.827-278.822=0.005
σ0.010-0.006=0.005
min278.814-278.816=-0.002
max278.842-278.829=0.013
mean2821.000-2728.000=93.000
σ0.000
min2821.000-2728.000=93.000
max2821.000-2728.000=93.000
mean0.412-0.410=0.002
σ0.003-0.004=-0.001
min0.408-0.407=0.001
max0.415-0.418=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.878-2268.877=0.001
σ0.019-0.011=0.008
min2268.860-2268.867=-0.006
max2268.908-2268.892=0.016
mean2821.000-2728.000=93.000
σ0.000
min2821.000-2728.000=93.000
max2821.000-2728.000=93.000
mean3.128-2.980=0.148
σ0.239-0.140=0.099
min2.925-2.888=0.038
max3.515-3.225=0.290
iters=5
new-facts=6402
prior-facts=1
mean4954.103-4954.284=-0.181
σ1.061-0.955=0.106
min4953.400-4953.657=-0.257
max4955.982-4955.974=0.008
mean2821.000-2728.000=93.000
σ0.000
min2821.000-2728.000=93.000
max2821.000-2728.000=93.000
mean8.320-8.009=0.311
σ0.437-0.433=0.004
min7.806-7.699=0.107
max8.830-8.760=0.070
iters=5
new-facts=6402
prior-facts=6402
mean5168.825-5168.749=0.076
σ0.092-0.144=-0.052
min5168.722-5168.530=0.192
max5168.907-5168.881=0.026
mean3443.800-3435.200=8.600
σ475.089-493.571=-18.482
min2888.000-2776.000=112.000
max4131.000-4077.000=54.000
mean9.424-9.258=0.166
σ0.317-0.273=0.043
min9.031-8.912=0.119
max9.891-9.660=0.231

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.943-0.966=-0.023
σ0.013-0.064=-0.051
min0.932-0.928=0.005
max0.965-1.079=-0.113

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.820-459.815=0.005
σ571.585-571.585=-0.000
min174.023-174.021=0.002
max1317.197-1317.193=0.005
mean79.500
σ7.000
min76.000
max90.000
mean2821.000-2728.000=93.000
σ0.000
min2821.000-2728.000=93.000
max2821.000-2728.000=93.000
mean0.427-0.545=-0.118
σ0.304-0.550=-0.246
min0.274-0.266=0.008
max0.883-1.370=-0.487
policies=20
mean1740.477-1740.423=0.055
σ0.349-0.309=0.041
min1740.266-1740.239=0.027
max1741.000-1740.885=0.115
mean760.000
σ0.000
min760.000
max760.000
mean2821.000-2728.000=93.000
σ0.000
min2821.000-2728.000=93.000
max2821.000-2728.000=93.000
mean2.770-2.672=0.098
σ0.011-0.025=-0.014
min2.756-2.650=0.106
max2.783-2.706=0.076
policies=200
mean17411.309-17411.166=0.143
σ0.450-0.453=-0.003
min17411.038-17410.815=0.223
max17411.982-17411.825=0.157
mean7600.000
σ0.000
min7600.000
max7600.000
mean2821.000-2728.000=93.000
σ0.000
min2821.000-2728.000=93.000
max2821.000-2728.000=93.000
mean27.250-27.108=0.142
σ0.307-0.105=0.202
min27.082-27.007=0.075
max27.709-27.244=0.465