Compare commits

Home / Compare 2e3d19ab .. 08eaec08

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean92.510-92.584=-0.074
σ0.053-0.054=-0.001
min92.466-92.532=-0.066
max92.652-92.726=-0.075
mean414.000
σ0.000
min414.000
max414.000
mean0.215-0.212=0.003
σ0.003-0.007=-0.004
min0.210-0.201=0.009
max0.219-0.221=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.128-43.203=-0.075
σ0.008-0.006=0.003
min43.116-43.192=-0.076
max43.137-43.211=-0.074
mean414.000
σ0.000
min414.000
max414.000
mean0.116-0.113=0.003
σ0.004-0.003=0.002
min0.111-0.109=0.002
max0.123-0.115=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1761.424-1760.516=0.908
σ0.358-0.362=-0.004
min1760.852-1759.945=0.908
max1761.998-1761.102=0.896
mean1654.500-1664.400=-9.900
σ636.558-628.302=8.256
min632.000-667.000=-35.000
max2778.000-2689.000=89.000
mean2.621-2.589=0.032
σ0.347-0.320=0.027
min2.190-2.183=0.006
max3.283-3.094=0.189

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean328.789-327.879=0.911
σ0.061-0.068=-0.007
min328.680-327.758=0.923
max328.820-327.915=0.906
mean2778.000-2689.000=89.000
σ0.000
min2778.000-2689.000=89.000
max2778.000-2689.000=89.000
mean0.434-0.440=-0.005
σ0.001-0.006=-0.004
min0.433-0.435=-0.002
max0.437-0.446=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1989.318-1988.345=0.974
σ0.015-0.019=-0.005
min1989.300-1988.311=0.989
max1989.340-1988.359=0.981
mean2778.000-2689.000=89.000
σ0.000
min2778.000-2689.000=89.000
max2778.000-2689.000=89.000
mean3.078-3.140=-0.062
σ0.097-0.115=-0.019
min2.974-3.026=-0.052
max3.234-3.312=-0.078
iters=5
new-facts=6402
prior-facts=1
mean4813.027-4809.078=3.949
σ7.842-1.072=6.770
min4809.458-4808.537=0.921
max4827.055-4810.993=16.062
mean2778.000-2689.000=89.000
σ0.000
min2778.000-2689.000=89.000
max2778.000-2689.000=89.000
mean8.877-8.611=0.265
σ0.356-0.385=-0.029
min8.467-7.974=0.494
max9.432-8.923=0.508
iters=5
new-facts=6402
prior-facts=6402
mean5000.516-4999.534=0.982
σ0.161-0.145=0.015
min5000.229-4999.277=0.953
max5000.602-4999.630=0.972
mean2993.800-2937.200=56.600
σ216.242-295.248=-79.005
min2778.000-2689.000=89.000
max3310.000-3388.000=-78.000
mean8.586-8.467=0.119
σ0.069-0.068=0.001
min8.478-8.388=0.090
max8.662-8.564=0.098

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-1.173=-0.105
σ0.263-0.243=0.021
min0.920-0.945=-0.026
max1.529-1.575=-0.046

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean470.836-471.172=-0.336
σ574.246-574.912=-0.665
min183.710-183.713=-0.003
max1332.205-1333.540=-1.334
mean90.250
σ8.500
min86.000
max103.000
mean2778.000-2689.000=89.000
σ0.000
min2778.000-2689.000=89.000
max2778.000-2689.000=89.000
mean0.487-0.578=-0.091
σ0.381-0.557=-0.176
min0.295-0.290=0.005
max1.058-1.413=-0.355
policies=20
mean1837.426-1837.402=0.024
σ0.396-0.403=-0.008
min1837.139-1837.123=0.016
max1838.006-1837.998=0.008
mean860.000
σ0.000
min860.000
max860.000
mean2778.000-2689.000=89.000
σ0.000
min2778.000-2689.000=89.000
max2778.000-2689.000=89.000
mean2.925-2.857=0.068
σ0.012-0.017=-0.005
min2.910-2.840=0.070
max2.941-2.880=0.061
policies=200
mean18381.412-18381.481=-0.069
σ0.430-0.566=-0.137
min18381.140-18381.006=0.134
max18382.051-18382.296=-0.245
mean8600.000
σ0.000
min8600.000
max8600.000
mean2778.000-2689.000=89.000
σ0.000
min2778.000-2689.000=89.000
max2778.000-2689.000=89.000
mean28.813-28.836=-0.023
σ0.292-0.119=0.173
min28.584-28.716=-0.132
max29.237-28.964=0.273