Compare commits

Home / Compare bc4ac7c0 .. e8bdd34a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956-35.951=0.005
σ0.101-0.102=-0.001
min35.909-35.907=0.002
max36.241-36.240=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.077-0.077=-0.001
σ0.003-0.004=-0.001
min0.074-0.074=-0.000
max0.084-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean26.202-26.200=0.002
σ0.003-0.003=-0.000
min26.198-26.196=0.002
max26.208-26.206=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.061-0.061=-0.000
σ0.003-0.003=-0.000
min0.059-0.059=-0.000
max0.068-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.303-1756.305=-0.001
σ0.370-0.368=0.002
min1755.726-1755.727=-0.002
max1756.899-1756.894=0.005
mean1656.900-1659.100=-2.200
σ628.968-631.215=-2.247
min673.000-613.000=60.000
max2608.000-2729.000=-121.000
mean2.375-2.411=-0.037
σ0.091-0.121=-0.031
min2.273-2.241=0.032
max2.571-2.775=-0.204

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.827-278.822=0.004
σ0.008-0.004=0.004
min278.817-278.816=0.001
max278.839-278.826=0.012
mean2608.000-2729.000=-121.000
σ0.000
min2608.000-2729.000=-121.000
max2608.000-2729.000=-121.000
mean0.416-0.409=0.007
σ0.009-0.007=0.002
min0.406-0.398=0.008
max0.429-0.416=0.012
iters=5
new-facts=1
prior-facts=6402
mean2268.891-2268.882=0.009
σ0.006-0.011=-0.005
min2268.884-2268.871=0.013
max2268.898-2268.898=0.000
mean2608.000-2729.000=-121.000
σ0.000
min2608.000-2729.000=-121.000
max2608.000-2729.000=-121.000
mean2.948-2.957=-0.009
σ0.116-0.055=0.061
min2.845-2.900=-0.055
max3.145-3.028=0.117
iters=5
new-facts=6402
prior-facts=1
mean4954.290-4954.244=0.046
σ0.933-0.890=0.043
min4953.712-4953.721=-0.010
max4955.945-4955.825=0.120
mean2608.000-2729.000=-121.000
σ0.000
min2608.000-2729.000=-121.000
max2608.000-2729.000=-121.000
mean7.992-8.093=-0.102
σ0.352-0.439=-0.086
min7.691-7.759=-0.068
max8.592-8.780=-0.188
iters=5
new-facts=6402
prior-facts=6402
mean5168.748-5168.782=-0.034
σ0.218-0.080=0.138
min5168.379-5168.722=-0.342
max5168.886-5168.888=-0.002
mean3357.400-3378.000=-20.600
σ460.637-450.943=9.694
min2748.000-2770.000=-22.000
max3968.000-3956.000=12.000
mean9.212-9.239=-0.028
σ0.437-0.187=0.250
min8.571-9.049=-0.478
max9.714-9.444=0.271

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.370-1.029=0.342
σ0.463-0.170=0.294
min0.943-0.945=-0.002
max1.911-1.332=0.579

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.814-459.818=-0.004
σ571.589-571.587=0.002
min174.017-174.019=-0.002
max1317.198-1317.199=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean2608.000-2729.000=-121.000
σ0.000
min2608.000-2729.000=-121.000
max2608.000-2729.000=-121.000
mean0.541-0.536=0.005
σ0.553-0.535=0.018
min0.263-0.266=-0.002
max1.370-1.339=0.031
policies=20
mean1740.403-1740.406=-0.003
σ0.305-0.320=-0.015
min1740.213-1740.200=0.013
max1740.857-1740.882=-0.025
mean760.000
σ0.000
min760.000
max760.000
mean2608.000-2729.000=-121.000
σ0.000
min2608.000-2729.000=-121.000
max2608.000-2729.000=-121.000
mean2.671-2.682=-0.012
σ0.012-0.014=-0.001
min2.654-2.669=-0.015
max2.682-2.698=-0.016
policies=200
mean17411.173-17410.914=0.259
σ0.590-0.542=0.048
min17410.853-17410.612=0.241
max17412.057-17411.725=0.332
mean7600.000
σ0.000
min7600.000
max7600.000
mean2608.000-2729.000=-121.000
σ0.000
min2608.000-2729.000=-121.000
max2608.000-2729.000=-121.000
mean27.053-27.007=0.046
σ0.112-0.050=0.062
min26.957-26.951=0.006
max27.193-27.068=0.125