Compare commits

Home / Compare 4e908dfe .. 0280ab5f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.967-36.720=-0.753
σ0.104-0.801=-0.697
min35.920-35.919=0.001
max36.260-38.437=-2.178
mean413.000-3992.000=-3579.000
σ0.000
min413.000-3992.000=-3579.000
max413.000-3992.000=-3579.000
mean0.075-0.075=-0.000
σ0.004-0.001=0.004
min0.071-0.074=-0.003
max0.084-0.076=0.008
cache=y
dps=1
iters=10
policies=100
mean26.209-26.712=-0.503
σ0.004-0.644=-0.640
min26.203-26.210=-0.007
max26.218-27.463=-1.245
mean413.000-3992.000=-3579.000
σ0.000
min413.000-3992.000=-3579.000
max413.000-3992.000=-3579.000
mean0.061-0.060=0.000
σ0.002-0.001=0.002
min0.059-0.060=-0.000
max0.067-0.061=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.314-1756.366=-0.052
σ0.367-0.374=-0.007
min1755.741-1755.797=-0.056
max1756.910-1756.965=-0.055
mean1655.400-1656.750=-1.350
σ626.808-630.043=-3.235
min609.000-680.000=-71.000
max2643.000-2611.000=32.000
mean2.372-2.282=0.090
σ0.160-0.151=0.009
min2.242-2.148=0.095
max2.997-2.788=0.208

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.844-278.696=0.147
σ0.005-0.014=-0.010
min278.837-278.684=0.152
max278.849-278.719=0.130
mean2643.000-2611.000=32.000
σ0.000
min2643.000-2611.000=32.000
max2643.000-2611.000=32.000
mean0.407-0.426=-0.019
σ0.002-0.013=-0.010
min0.404-0.416=-0.012
max0.410-0.442=-0.032
iters=5
new-facts=1
prior-facts=6402
mean2268.904-2268.873=0.031
σ0.011-0.005=0.006
min2268.885-2268.868=0.017
max2268.912-2268.881=0.031
mean2643.000-2611.000=32.000
σ0.000
min2643.000-2611.000=32.000
max2643.000-2611.000=32.000
mean2.965-2.948=0.017
σ0.104-0.117=-0.014
min2.888-2.864=0.024
max3.145-3.151=-0.005
iters=5
new-facts=6402
prior-facts=1
mean4954.240-4952.363=1.878
σ0.806-0.992=-0.186
min4953.738-4951.723=2.015
max4955.661-4954.125=1.536
mean2643.000-2611.000=32.000
σ0.000
min2643.000-2611.000=32.000
max2643.000-2611.000=32.000
mean8.064-8.342=-0.279
σ0.235-0.677=-0.442
min7.821-7.810=0.012
max8.407-9.527=-1.119
iters=5
new-facts=6402
prior-facts=6402
mean5168.675-5167.074=1.601
σ0.201-0.014=0.186
min5168.392-5167.066=1.326
max5168.902-5167.099=1.803
mean3460.800-3422.800=38.000
σ475.553-454.531=21.021
min2796.000-2809.000=-13.000
max4019.000-3992.000=27.000
mean9.273-9.234=0.039
σ0.216-0.255=-0.039
min8.963-8.985=-0.021
max9.564-9.615=-0.051

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.064=0.143
σ0.387-0.122=0.265
min0.937-0.951=-0.013
max1.871-1.252=0.619

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.363-460.258=0.105
σ572.652-572.607=0.045
min174.027-173.953=0.074
max1319.341-1319.169=0.172
mean79.500
σ7.000
min76.000
max90.000
mean2643.000-435.000=2208.000
σ0.000
min2643.000-435.000=2208.000
max2643.000-435.000=2208.000
mean0.538-0.552=-0.014
σ0.532-0.560=-0.028
min0.269-0.267=0.002
max1.336-1.392=-0.056
policies=20
mean1740.492-1740.033=0.460
σ0.308-0.331=-0.023
min1740.300-1739.793=0.507
max1740.952-1740.519=0.433
mean760.000
σ0.000
min760.000
max760.000
mean2643.000-445.000=2198.000
σ0.000-9.381=-9.381
min2643.000-435.000=2208.000
max2643.000-453.000=2190.000
mean2.679-2.664=0.014
σ0.010-0.012=-0.002
min2.667-2.647=0.019
max2.689-2.675=0.014
policies=200
mean17411.950-17409.816=2.134
σ0.404-0.105=0.299
min17411.734-17409.659=2.075
max17412.556-17409.878=2.678
mean7600.000
σ0.000
min7600.000
max7600.000
mean2643.000-489.750=2153.250
σ0.000-2.754=-2.754
min2643.000-487.000=2156.000
max2643.000-493.000=2150.000
mean26.983-26.978=0.005
σ0.092-0.173=-0.081
min26.855-26.776=0.078
max27.074-27.198=-0.124