Compare commits

Home / Compare ef531d10 .. cd306e42

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.039-31.041=-0.001
σ0.046-0.049=-0.003
min31.004-31.002=0.002
max31.168-31.176=-0.009
mean414.700-419.000=-4.300
σ0.483-0.000=0.483
min414.000-419.000=-5.000
max415.000-419.000=-4.000
mean0.074-0.077=-0.002
σ0.005-0.004=0.001
min0.070-0.071=-0.001
max0.084-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.003-0.003=-0.000
min21.138-21.139=-0.001
max21.146-21.148=-0.001
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.063-0.064=-0.001
σ0.003-0.001=0.003
min0.058-0.063=-0.005
max0.071-0.065=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.410=-0.000
σ0.361-0.362=-0.001
min1750.845-1750.844=0.001
max1751.973-1751.995=-0.021
mean1660.300-1657.700=2.600
σ622.571-646.869=-24.298
min638.000-654.000=-16.000
max2506.000-2854.000=-348.000
mean2.793-2.813=-0.020
σ0.169-0.156=0.013
min2.433-2.468=-0.035
max3.017-3.158=-0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.400-273.397=0.003
σ0.012-0.006=0.006
min273.389-273.388=0.001
max273.414-273.403=0.011
mean2506.000-2854.000=-348.000
σ0.000
min2506.000-2854.000=-348.000
max2506.000-2854.000=-348.000
mean0.384-0.381=0.003
σ0.009-0.007=0.003
min0.377-0.377=0.000
max0.397-0.393=0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.842-1933.838=0.004
σ0.014-0.010=0.004
min1933.833-1933.831=0.002
max1933.866-1933.855=0.011
mean2506.000-2854.000=-348.000
σ0.000
min2506.000-2854.000=-348.000
max2506.000-2854.000=-348.000
mean2.949-2.997=-0.048
σ0.185-0.040=0.145
min2.648-2.948=-0.301
max3.149-3.036=0.113
iters=5
new-facts=6402
prior-facts=1
mean4754.225-4754.267=-0.041
σ0.597-0.989=-0.392
min4753.780-4753.338=0.442
max4755.274-4755.941=-0.667
mean2506.000-2854.000=-348.000
σ0.000
min2506.000-2854.000=-348.000
max2506.000-2854.000=-348.000
mean8.508-8.326=0.182
σ0.581-0.594=-0.012
min7.699-7.822=-0.123
max9.085-9.217=-0.131
iters=5
new-facts=6402
prior-facts=6402
mean4944.714-4944.505=0.209
σ0.201-0.348=-0.147
min4944.382-4943.988=0.394
max4944.877-4944.879=-0.003
mean2963.800-3084.000=-120.200
σ431.363-304.428=126.934
min2506.000-2854.000=-348.000
max3551.000-3556.000=-5.000
mean8.417-8.417=-0.000
σ0.147-0.087=0.061
min8.246-8.316=-0.071
max8.644-8.547=0.097

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.750-1.023=0.727
σ0.188-0.135=0.053
min1.420-0.933=0.487
max1.891-1.243=0.648

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.342=-0.009
σ572.198-572.196=0.002
min177.233-177.235=-0.002
max1321.630-1321.636=-0.006
mean79.750
σ7.500
min76.000
max91.000
mean2506.000-2854.000=-348.000
σ0.000
min2506.000-2854.000=-348.000
max2506.000-2854.000=-348.000
mean0.555-0.437=0.118
σ0.551-0.301=0.250
min0.278-0.283=-0.005
max1.382-0.889=0.493
policies=20
mean1772.565-1772.630=-0.065
σ0.323-0.326=-0.003
min1772.368-1772.400=-0.032
max1773.047-1773.109=-0.062
mean760.000
σ0.000
min760.000
max760.000
mean2506.000-2854.000=-348.000
σ0.000
min2506.000-2854.000=-348.000
max2506.000-2854.000=-348.000
mean2.744-2.827=-0.083
σ0.012-0.009=0.003
min2.736-2.813=-0.078
max2.762-2.835=-0.073
policies=200
mean17732.412-17732.547=-0.135
σ0.579-0.487=0.092
min17732.042-17732.167=-0.125
max17733.263-17733.260=0.003
mean7600.000
σ0.000
min7600.000
max7600.000
mean2506.000-2854.000=-348.000
σ0.000
min2506.000-2854.000=-348.000
max2506.000-2854.000=-348.000
mean27.661-28.185=-0.524
σ0.148-0.548=-0.399
min27.527-27.626=-0.098
max27.873-28.786=-0.913