Compare commits

Home / Compare e072ce83 .. 661e632d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.783
σ0.107
min35.736
max36.086
mean412.000
σ0.000
min412.000
max412.000
mean0.076
σ0.004
min0.073
max0.084
cache=y
dps=1
iters=10
policies=100
mean26.051
σ0.003
min26.046
max26.054
mean412.000
σ0.000
min412.000
max412.000
mean0.060
σ0.003
min0.058
max0.068

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.936-1752.884=3.052
σ0.363-0.362=0.001
min1755.363-1752.311=3.051
max1756.526-1753.474=3.051
mean1663.900-1668.800=-4.900
σ628.771-637.612=-8.841
min668.000-678.000=-10.000
max2647.000-2764.000=-117.000
mean2.774-2.745=0.029
σ0.205-0.155=0.050
min2.282-2.452=-0.171
max3.075-2.942=0.133

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.226-275.403=1.824
σ0.009-0.004=0.005
min277.217-275.397=1.820
max277.236-275.406=1.830
mean2647.000-2764.000=-117.000
σ0.000
min2647.000-2764.000=-117.000
max2647.000-2764.000=-117.000
mean0.405-0.418=-0.012
σ0.006-0.001=0.005
min0.400-0.416=-0.015
max0.413-0.419=-0.006
iters=5
new-facts=1
prior-facts=6402
mean2174.475-2263.870=-89.395
σ0.018-0.019=-0.001
min2174.458-2263.848=-89.389
max2174.503-2263.891=-89.388
mean2647.000-2764.000=-117.000
σ0.000
min2647.000-2764.000=-117.000
max2647.000-2764.000=-117.000
mean2.977-3.120=-0.143
σ0.205-0.122=0.083
min2.707-2.926=-0.220
max3.253-3.242=0.012
iters=5
new-facts=6402
prior-facts=1
mean5052.618-4951.893=100.724
σ1.009-0.821=0.188
min5052.067-4951.377=100.690
max5054.416-4953.353=101.063
mean2647.000-2764.000=-117.000
σ0.000
min2647.000-2764.000=-117.000
max2647.000-2764.000=-117.000
mean8.975-7.913=1.062
σ0.576-0.241=0.335
min8.100-7.688=0.412
max9.690-8.283=1.407
iters=5
new-facts=6402
prior-facts=6402
mean5188.387-5164.722=23.665
σ0.213-0.140=0.072
min5188.036-5164.501=23.535
max5188.557-5164.850=23.707
mean3218.000-3372.400=-154.400
σ380.754-423.654=-42.900
min2680.000-2954.000=-274.000
max3691.000-3801.000=-110.000
mean9.074-9.247=-0.173
σ0.476-0.415=0.061
min8.604-8.633=-0.029
max9.707-9.628=0.080

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.281-1.445=-0.164
σ0.411-0.274=0.137
min0.941-1.211=-0.270
max1.850-1.837=0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.916-455.707=9.210
σ572.653-572.605=0.048
min178.587-169.403=9.184
max1323.896-1314.613=9.282
mean79.500
σ7.000
min76.000
max90.000
mean2647.000-430.500=2216.500
σ0.000-0.577=-0.577
min2647.000-430.000=2217.000
max2647.000-431.000=2216.000
mean0.568-0.549=0.019
σ0.562-0.554=0.008
min0.277-0.266=0.012
max1.410-1.380=0.030
policies=20
mean1786.094-1694.545=91.550
σ0.349-0.318=0.031
min1785.857-1694.312=91.545
max1786.611-1695.011=91.600
mean760.000
σ0.000
min760.000
max760.000
mean2647.000-442.750=2204.250
σ0.000-10.874=-10.874
min2647.000-431.000=2216.000
max2647.000-452.000=2195.000
mean2.801-2.638=0.163
σ0.020-0.013=0.007
min2.787-2.631=0.156
max2.830-2.657=0.173
policies=200
mean17867.429-16954.981=912.447
σ0.633-0.163=0.470
min17867.089-16954.801=912.289
max17868.378-16955.134=913.244
mean7600.000
σ0.000
min7600.000
max7600.000
mean2647.000-489.000=2158.000
σ0.000-2.944=-2.944
min2647.000-485.000=2162.000
max2647.000-492.000=2155.000
mean28.145-26.431=1.714
σ0.156-0.114=0.042
min28.003-26.285=1.718
max28.328-26.562=1.767