Compare commits

Home / Compare ed58a209 .. 883dfe24

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.964-36.727=-0.763
σ0.102-0.583=-0.481
min35.919-35.921=-0.002
max36.254-37.219=-0.964
mean412.000-3934.000=-3522.000
σ0.000
min412.000-3934.000=-3522.000
max412.000-3934.000=-3522.000
mean0.076-0.075=0.001
σ0.003-0.001=0.002
min0.074-0.074=-0.000
max0.082-0.076=0.006
cache=y
dps=1
iters=10
policies=100
mean26.208-26.712=-0.504
σ0.004-0.645=-0.641
min26.203-26.207=-0.004
max26.215-27.465=-1.250
mean412.000-3934.000=-3522.000
σ0.000
min412.000-3934.000=-3522.000
max412.000-3934.000=-3522.000
mean0.061-0.060=0.001
σ0.003-0.001=0.002
min0.059-0.059=-0.000
max0.069-0.061=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.313-1756.367=-0.054
σ0.368-0.373=-0.006
min1755.737-1755.789=-0.052
max1756.905-1756.974=-0.069
mean1658.050-1668.550=-10.500
σ635.605-649.813=-14.208
min609.000-619.000=-10.000
max2736.000-2645.000=91.000
mean2.348-2.280=0.068
σ0.109-0.171=-0.062
min2.219-2.106=0.113
max2.703-2.751=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.849-278.697=0.152
σ0.005-0.013=-0.008
min278.845-278.684=0.161
max278.858-278.718=0.140
mean2736.000-2645.000=91.000
σ0.000
min2736.000-2645.000=91.000
max2736.000-2645.000=91.000
mean0.410-0.418=-0.008
σ0.004-0.001=0.003
min0.407-0.416=-0.008
max0.418-0.419=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.903-2268.875=0.028
σ0.014-0.010=0.005
min2268.887-2268.866=0.021
max2268.918-2268.888=0.030
mean2736.000-2645.000=91.000
σ0.000
min2736.000-2645.000=91.000
max2736.000-2645.000=91.000
mean2.947-2.910=0.037
σ0.164-0.170=-0.005
min2.851-2.756=0.095
max3.238-3.173=0.065
iters=5
new-facts=6402
prior-facts=1
mean4953.928-4952.362=1.566
σ1.133-0.816=0.317
min4952.871-4951.964=0.907
max4955.818-4953.821=1.997
mean2736.000-2645.000=91.000
σ0.000
min2736.000-2645.000=91.000
max2736.000-2645.000=91.000
mean7.993-7.925=0.068
σ0.405-0.139=0.266
min7.668-7.723=-0.055
max8.670-8.041=0.629
iters=5
new-facts=6402
prior-facts=6402
mean5168.809-5167.004=1.805
σ0.084-0.147=-0.063
min5168.743-5166.742=2.001
max5168.903-5167.078=1.825
mean3438.600-3391.800=46.800
σ490.788-443.929=46.859
min2796.000-2768.000=28.000
max4086.000-3934.000=152.000
mean9.415-9.501=-0.086
σ0.270-0.142=0.128
min8.988-9.410=-0.421
max9.656-9.749=-0.093

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.029-1.028=0.000
σ0.135-0.135=-0.000
min0.940-0.935=0.004
max1.247-1.248=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.358-460.260=0.098
σ572.651-572.608=0.044
min174.024-173.954=0.070
max1319.335-1319.172=0.163
mean79.500
σ7.000
min76.000
max90.000
mean2736.000-435.000=2301.000
σ0.000
min2736.000-435.000=2301.000
max2736.000-435.000=2301.000
mean0.550-0.547=0.003
σ0.567-0.547=0.020
min0.263-0.268=-0.005
max1.401-1.367=0.034
policies=20
mean1740.479-1740.056=0.423
σ0.303-0.317=-0.014
min1740.279-1739.828=0.451
max1740.930-1740.520=0.410
mean760.000
σ0.000
min760.000
max760.000
mean2736.000-445.000=2291.000
σ0.000-9.381=-9.381
min2736.000-435.000=2301.000
max2736.000-453.000=2283.000
mean2.661-2.650=0.011
σ0.001-0.017=-0.016
min2.660-2.631=0.028
max2.662-2.666=-0.004
policies=200
mean17411.840-17409.966=1.874
σ0.415-0.059=0.356
min17411.500-17409.879=1.621
max17412.441-17410.002=2.440
mean7600.000
σ0.000
min7600.000
max7600.000
mean2736.000-491.750=2244.250
σ0.000-3.500=-3.500
min2736.000-488.000=2248.000
max2736.000-496.000=2240.000
mean26.900-27.033=-0.132
σ0.057-0.147=-0.090
min26.825-26.875=-0.050
max26.960-27.229=-0.269