Compare commits

Home / Compare b975978e .. 318a157c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-30.769=0.272
σ0.051-0.048=0.004
min31.002-30.726=0.276
max31.184-30.900=0.284
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.076-0.077=-0.001
σ0.004-0.002=0.002
min0.071-0.075=-0.004
max0.083-0.082=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.061=0.082
σ0.002-0.003=-0.001
min21.141-21.057=0.084
max21.145-21.065=0.080
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.062=0.003
σ0.003-0.003=0.000
min0.058-0.058=0.000
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.618=-0.207
σ0.361-0.361=0.000
min1750.845-1751.057=-0.212
max1751.984-1752.200=-0.216
mean1665.100-1666.150=-1.050
σ628.407-637.298=-8.890
min636.000-620.000=16.000
max2521.000-2650.000=-129.000
mean2.850-2.837=0.013
σ0.184-0.125=0.059
min2.314-2.580=-0.266
max3.135-3.108=0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.407-276.025=-2.619
σ0.009-0.010=-0.001
min273.392-276.014=-2.622
max273.414-276.038=-2.624
mean2521.000-2650.000=-129.000
σ0.000
min2521.000-2650.000=-129.000
max2521.000-2650.000=-129.000
mean0.390-0.391=-0.001
σ0.015-0.008=0.007
min0.376-0.387=-0.011
max0.413-0.405=0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.838-2168.563=-234.725
σ0.011-0.005=0.007
min1933.826-2168.555=-234.729
max1933.856-2168.567=-234.710
mean2521.000-2650.000=-129.000
σ0.000
min2521.000-2650.000=-129.000
max2521.000-2650.000=-129.000
mean3.106-2.869=0.237
σ0.144-0.155=-0.011
min2.973-2.743=0.230
max3.303-3.058=0.245
iters=5
new-facts=6402
prior-facts=1
mean4754.351-5048.091=-293.740
σ0.884-1.216=-0.332
min4753.768-5046.797=-293.029
max4755.918-5050.022=-294.104
mean2521.000-2650.000=-129.000
σ0.000
min2521.000-2650.000=-129.000
max2521.000-2650.000=-129.000
mean8.470-8.357=0.113
σ0.574-0.410=0.165
min7.632-8.054=-0.423
max9.031-9.064=-0.033
iters=5
new-facts=6402
prior-facts=6402
mean4944.800-5179.499=-234.699
σ0.080-0.084=-0.004
min4944.735-5179.422=-234.686
max4944.903-5179.594=-234.691
mean3009.400-3215.400=-206.000
σ366.110-493.366=-127.256
min2521.000-2650.000=-129.000
max3358.000-3888.000=-530.000
mean8.757-9.959=-1.202
σ0.439-0.270=0.169
min8.367-9.526=-1.159
max9.489-10.262=-0.773

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.640-1.199=0.442
σ0.168-0.249=-0.081
min1.372-0.951=0.421
max1.823-1.598=0.224

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.336-463.803=-0.467
σ572.196-572.665=-0.469
min177.234-177.467=-0.233
max1321.630-1322.800=-1.170
mean79.750
σ7.500
min76.000
max91.000
mean2521.000-2650.000=-129.000
σ0.000
min2521.000-2650.000=-129.000
max2521.000-2650.000=-129.000
mean0.568-0.557=0.011
σ0.584-0.560=0.024
min0.274-0.275=-0.001
max1.443-1.396=0.046
policies=20
mean1772.591-1774.934=-2.344
σ0.341-0.326=0.015
min1772.366-1774.713=-2.347
max1773.097-1775.418=-2.321
mean760.000
σ0.000
min760.000
max760.000
mean2521.000-2650.000=-129.000
σ0.000
min2521.000-2650.000=-129.000
max2521.000-2650.000=-129.000
mean2.752-2.733=0.018
σ0.011-0.006=0.005
min2.742-2.729=0.013
max2.766-2.741=0.025
policies=200
mean17732.507-17756.105=-23.598
σ0.493-0.461=0.032
min17732.248-17755.834=-23.586
max17733.245-17756.793=-23.548
mean7600.000
σ0.000
min7600.000
max7600.000
mean2521.000-2650.000=-129.000
σ0.000
min2521.000-2650.000=-129.000
max2521.000-2650.000=-129.000
mean27.698-27.611=0.087
σ0.105-0.128=-0.023
min27.595-27.490=0.105
max27.831-27.791=0.040