Compare commits

Home / Compare 1de491da .. 5cc42b98

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.039-31.042=-0.003
σ0.049-0.049=-0.000
min31.002-31.002=0.001
max31.174-31.178=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.077-0.079=-0.002
σ0.005-0.002=0.003
min0.071-0.077=-0.006
max0.086-0.086=0.000
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.002-0.003=-0.001
min21.138-21.138=-0.001
max21.146-21.149=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.066=-0.002
σ0.001-0.004=-0.003
min0.063-0.063=0.000
max0.065-0.074=-0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.409-1751.412=-0.002
σ0.361-0.364=-0.003
min1750.850-1750.845=0.005
max1751.999-1752.015=-0.016
mean1661.300-1641.600=19.700
σ624.122-618.294=5.828
min659.000-653.000=6.000
max2509.000-2479.000=30.000
mean2.805-2.733=0.073
σ0.115-0.234=-0.120
min2.597-2.291=0.306
max3.047-3.135=-0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.404-273.400=0.004
σ0.010-0.010=0.000
min273.394-273.389=0.005
max273.417-273.412=0.005
mean2509.000-2479.000=30.000
σ0.000
min2509.000-2479.000=30.000
max2509.000-2479.000=30.000
mean0.386-0.385=0.001
σ0.011-0.007=0.004
min0.378-0.381=-0.003
max0.399-0.398=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.839-1933.835=0.004
σ0.003-0.005=-0.002
min1933.835-1933.828=0.007
max1933.843-1933.840=0.004
mean2509.000-2479.000=30.000
σ0.000
min2509.000-2479.000=30.000
max2509.000-2479.000=30.000
mean3.081-3.001=0.080
σ0.178-0.052=0.126
min2.902-2.946=-0.044
max3.370-3.085=0.285
iters=5
new-facts=6402
prior-facts=1
mean4754.309-4754.330=-0.021
σ0.884-0.873=0.010
min4753.788-4753.795=-0.007
max4755.884-4755.884=-0.001
mean2509.000-2479.000=30.000
σ0.000
min2509.000-2479.000=30.000
max2509.000-2479.000=30.000
mean8.659-8.660=-0.001
σ0.608-0.503=0.105
min7.727-7.829=-0.102
max9.166-8.999=0.166
iters=5
new-facts=6402
prior-facts=6402
mean4944.796-4944.798=-0.001
σ0.081-0.083=-0.002
min4944.723-4944.732=-0.009
max4944.897-4944.894=0.003
mean2941.000-3027.800=-86.800
σ385.456-286.441=99.016
min2509.000-2620.000=-111.000
max3433.000-3388.000=45.000
mean8.571-8.689=-0.118
σ0.304-0.258=0.046
min8.374-8.459=-0.084
max9.105-9.110=-0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.766-1.710=0.056
σ0.155-0.175=-0.019
min1.531-1.458=0.074
max1.913-1.866=0.047

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.328-463.335=-0.006
σ572.196-572.197=-0.001
min177.226-177.232=-0.006
max1321.622-1321.630=-0.008
mean79.750
σ7.500
min76.000
max91.000
mean2509.000-2479.000=30.000
σ0.000
min2509.000-2479.000=30.000
max2509.000-2479.000=30.000
mean0.554-0.557=-0.004
σ0.541-0.554=-0.014
min0.276-0.277=-0.001
max1.364-1.388=-0.024
policies=20
mean1772.568-1772.592=-0.024
σ0.336-0.338=-0.003
min1772.346-1772.366=-0.020
max1773.066-1773.094=-0.027
mean760.000
σ0.000
min760.000
max760.000
mean2509.000-2479.000=30.000
σ0.000
min2509.000-2479.000=30.000
max2509.000-2479.000=30.000
mean2.754-2.772=-0.018
σ0.009-0.038=-0.028
min2.744-2.738=0.006
max2.766-2.806=-0.039
policies=200
mean17732.261-17732.465=-0.203
σ0.511-0.399=0.111
min17731.973-17732.205=-0.232
max17733.024-17733.053=-0.029
mean7600.000
σ0.000
min7600.000
max7600.000
mean2509.000-2479.000=30.000
σ0.000
min2509.000-2479.000=30.000
max2509.000-2479.000=30.000
mean27.737-27.754=-0.017
σ0.109-0.151=-0.042
min27.610-27.600=0.009
max27.876-27.952=-0.076