Compare commits

Home / Compare 8b0fc275 .. a2d6bb47

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.001
σ0.049-0.052=-0.002
min31.006-31.001=0.005
max31.179-31.185=-0.006
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.077-0.078=-0.001
σ0.005-0.005=-0.000
min0.072-0.072=-0.000
max0.085-0.088=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.003=0.000
min21.138-21.137=0.001
max21.148-21.147=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.000
min0.063-0.063=-0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.411=0.000
σ0.362-0.361=0.001
min1750.842-1750.849=-0.007
max1751.994-1752.002=-0.008
mean1659.600-1653.750=5.850
σ623.370-614.711=8.659
min659.000-640.000=19.000
max2506.000-2488.000=18.000
mean2.824-2.809=0.015
σ0.106-0.174=-0.069
min2.550-2.304=0.246
max3.031-3.062=-0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.405-273.401=0.003
σ0.011-0.011=-0.001
min273.394-273.389=0.005
max273.419-273.413=0.006
mean2506.000-2488.000=18.000
σ0.000
min2506.000-2488.000=18.000
max2506.000-2488.000=18.000
mean0.389-0.388=0.001
σ0.010-0.011=-0.001
min0.379-0.377=0.002
max0.398-0.403=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.844-1933.847=-0.002
σ0.007-0.009=-0.003
min1933.836-1933.832=0.005
max1933.854-1933.855=-0.002
mean2506.000-2488.000=18.000
σ0.000
min2506.000-2488.000=18.000
max2506.000-2488.000=18.000
mean3.036-3.120=-0.084
σ0.252-0.130=0.122
min2.763-2.988=-0.225
max3.357-3.281=0.076
iters=5
new-facts=6402
prior-facts=1
mean4754.339-4754.336=0.003
σ0.884-0.822=0.062
min4753.848-4753.823=0.025
max4755.916-4755.797=0.119
mean2506.000-2488.000=18.000
σ0.000
min2506.000-2488.000=18.000
max2506.000-2488.000=18.000
mean8.467-8.495=-0.029
σ0.547-0.511=0.036
min7.794-7.672=0.121
max9.036-8.957=0.079
iters=5
new-facts=6402
prior-facts=6402
mean4944.795-4944.803=-0.008
σ0.072-0.078=-0.005
min4944.738-4944.735=0.003
max4944.883-4944.901=-0.018
mean2915.800-2974.200=-58.400
σ377.781-345.299=32.483
min2506.000-2529.000=-23.000
max3433.000-3305.000=128.000
mean8.516-8.797=-0.281
σ0.211-0.318=-0.107
min8.399-8.490=-0.091
max8.892-9.322=-0.430

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.733-1.679=0.054
σ0.181-0.139=0.042
min1.416-1.526=-0.111
max1.839-1.831=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.329-463.330=-0.001
σ572.195-572.199=-0.004
min177.231-177.228=0.003
max1321.621-1321.628=-0.007
mean79.750
σ7.500
min76.000
max91.000
mean2506.000-2488.000=18.000
σ0.000
min2506.000-2488.000=18.000
max2506.000-2488.000=18.000
mean0.537-0.571=-0.034
σ0.513-0.577=-0.065
min0.276-0.277=-0.001
max1.306-1.437=-0.131
policies=20
mean1772.559-1772.563=-0.003
σ0.326-0.332=-0.006
min1772.340-1772.340=0.001
max1773.043-1773.055=-0.012
mean760.000
σ0.000
min760.000
max760.000
mean2506.000-2488.000=18.000
σ0.000
min2506.000-2488.000=18.000
max2506.000-2488.000=18.000
mean2.746-2.763=-0.017
σ0.020-0.007=0.013
min2.729-2.756=-0.026
max2.774-2.773=0.001
policies=200
mean17732.390-17732.495=-0.105
σ0.406-0.512=-0.106
min17732.140-17732.223=-0.082
max17732.994-17733.262=-0.269
mean7600.000
σ0.000
min7600.000
max7600.000
mean2506.000-2488.000=18.000
σ0.000
min2506.000-2488.000=18.000
max2506.000-2488.000=18.000
mean27.702-27.721=-0.019
σ0.120-0.096=0.024
min27.634-27.622=0.012
max27.882-27.847=0.035