Compare commits

Home / Compare efb7e6e9 .. d34cc511

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.852=0.188
σ0.048-0.048=-0.000
min30.998-30.816=0.182
max31.174-30.987=0.187
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.079-0.078=0.001
σ0.003-0.003=0.000
min0.077-0.076=0.001
max0.087-0.084=0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.001-0.002=-0.001
min21.142-21.139=0.003
max21.146-21.146=-0.000
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.065-0.065=0.000
σ0.003-0.003=0.000
min0.063-0.063=0.000
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.419=-0.009
σ0.361-0.360=0.001
min1750.843-1750.850=-0.008
max1751.981-1752.000=-0.019
mean1637.250-1661.150=-23.900
σ619.070-626.523=-7.453
min647.000-660.000=-13.000
max2474.000-2513.000=-39.000
mean2.803-2.812=-0.009
σ0.189-0.156=0.032
min2.385-2.276=0.108
max3.174-3.059=0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.404-275.753=-2.350
σ0.012-0.010=0.002
min273.387-275.742=-2.355
max273.421-275.765=-2.344
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean0.389-0.397=-0.008
σ0.009-0.010=-0.001
min0.379-0.388=-0.009
max0.400-0.409=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.849-2168.279=-234.430
σ0.011-0.013=-0.002
min1933.834-2168.260=-234.427
max1933.863-2168.294=-234.431
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean3.078-2.944=0.134
σ0.084-0.130=-0.046
min3.003-2.753=0.250
max3.185-3.099=0.085
iters=5
new-facts=6402
prior-facts=1
mean4754.236-5048.102=-293.866
σ0.631-0.905=-0.274
min4753.742-5047.542=-293.800
max4755.341-5049.710=-294.368
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean8.621-8.780=-0.159
σ0.553-0.429=0.124
min7.702-8.114=-0.412
max9.122-9.262=-0.140
iters=5
new-facts=6402
prior-facts=6402
mean4944.803-5179.239=-234.436
σ0.085-0.083=0.003
min4944.731-5179.155=-234.424
max4944.899-5179.343=-234.444
mean2969.800-3263.800=-294.000
σ344.039-379.904=-35.865
min2526.000-2732.000=-206.000
max3299.000-3733.000=-434.000
mean8.622-9.907=-1.285
σ0.145-0.262=-0.117
min8.433-9.499=-1.066
max8.820-10.119=-1.300

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.768-1.726=0.042
σ0.027-0.155=-0.128
min1.735-1.459=0.276
max1.809-1.842=-0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.330-463.566=-0.235
σ572.194-572.653=-0.459
min177.232-177.237=-0.005
max1321.621-1322.545=-0.924
mean79.750
σ7.500
min76.000
max91.000
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean0.547-0.555=-0.007
σ0.528-0.550=-0.022
min0.277-0.271=0.006
max1.340-1.380=-0.040
policies=20
mean1772.575-1772.620=-0.045
σ0.342-0.342=-0.000
min1772.344-1772.394=-0.049
max1773.082-1773.128=-0.046
mean760.000
σ0.000
min760.000
max760.000
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean2.742-2.767=-0.025
σ0.010-0.008=0.002
min2.733-2.755=-0.022
max2.755-2.773=-0.018
policies=200
mean17732.377-17732.887=-0.510
σ0.436-0.399=0.037
min17732.072-17732.540=-0.467
max17733.017-17733.461=-0.444
mean7600.000
σ0.000
min7600.000
max7600.000
mean2474.000-2513.000=-39.000
σ0.000
min2474.000-2513.000=-39.000
max2474.000-2513.000=-39.000
mean27.683-27.781=-0.098
σ0.083-0.154=-0.071
min27.600-27.635=-0.034
max27.792-27.970=-0.178