Compare commits

Home / Compare 1de5347e .. 4a7fe85c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.731-70.562=0.169
σ0.050-0.044=0.007
min70.694-70.540=0.155
max70.869-70.685=0.184
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.163-0.156=0.007
σ0.009-0.005=0.003
min0.153-0.150=0.003
max0.181-0.165=0.016
cache=y
dps=1
iters=10
policies=100
mean21.445-21.289=0.156
σ0.002-0.002=0.001
min21.441-21.285=0.156
max21.449-21.292=0.157
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.065=-0.001
σ0.004-0.003=0.001
min0.060-0.060=-0.001
max0.072-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.286-1753.655=1.631
σ0.361-0.362=-0.001
min1754.720-1753.089=1.632
max1755.872-1754.239=1.634
mean1636.900-1653.850=-16.950
σ610.730-635.940=-25.211
min622.000-650.000=-28.000
max2466.000-2848.000=-382.000
mean2.761-2.781=-0.020
σ0.200-0.194=0.006
min2.269-2.303=-0.033
max2.972-3.138=-0.166

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.767-272.100=0.666
σ0.006-0.008=-0.002
min272.759-272.090=0.668
max272.775-272.110=0.664
mean2466.000-2848.000=-382.000
σ0.000
min2466.000-2848.000=-382.000
max2466.000-2848.000=-382.000
mean0.382-0.390=-0.008
σ0.004-0.009=-0.004
min0.377-0.382=-0.005
max0.388-0.400=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.150-1932.527=0.624
σ0.018-0.020=-0.002
min1933.127-1932.513=0.614
max1933.175-1932.561=0.614
mean2466.000-2848.000=-382.000
σ0.000
min2466.000-2848.000=-382.000
max2466.000-2848.000=-382.000
mean3.058-2.860=0.198
σ0.243-0.235=0.008
min2.721-2.493=0.229
max3.395-3.024=0.370
iters=5
new-facts=6402
prior-facts=1
mean4753.893-4753.312=0.581
σ0.838-0.812=0.025
min4753.407-4752.878=0.529
max4755.383-4754.761=0.622
mean2466.000-2848.000=-382.000
σ0.000
min2466.000-2848.000=-382.000
max2466.000-2848.000=-382.000
mean8.554-8.131=0.423
σ0.414-0.311=0.103
min7.959-7.691=0.269
max9.053-8.462=0.591
iters=5
new-facts=6402
prior-facts=6402
mean4944.315-4943.712=0.604
σ0.162-0.013=0.149
min4944.027-4943.690=0.337
max4944.408-4943.725=0.682
mean2906.800-3073.400=-166.600
σ375.319-298.866=76.454
min2466.000-2848.000=-382.000
max3417.000-3533.000=-116.000
mean8.373-8.403=-0.031
σ0.054-0.153=-0.098
min8.306-8.214=0.092
max8.440-8.632=-0.192

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.760-1.015=0.745
σ0.152-0.135=0.017
min1.502-0.948=0.554
max1.891-1.256=0.634

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.820-472.277=0.543
σ574.899-575.882=-0.983
min185.370-184.327=1.042
max1335.168-1336.100=-0.932
mean88.250
σ8.500
min84.000
max101.000
mean2466.000-2848.000=-382.000
σ0.000
min2466.000-2848.000=-382.000
max2466.000-2848.000=-382.000
mean0.566-0.455=0.112
σ0.557-0.310=0.247
min0.284-0.298=-0.014
max1.402-0.919=0.483
policies=20
mean1853.981-1843.597=10.384
σ0.368-0.378=-0.010
min1853.730-1843.313=10.417
max1854.526-1844.144=10.382
mean840.000
σ0.000
min840.000
max840.000
mean2466.000-2848.000=-382.000
σ0.000
min2466.000-2848.000=-382.000
max2466.000-2848.000=-382.000
mean2.861-2.988=-0.127
σ0.024-0.043=-0.019
min2.838-2.955=-0.117
max2.893-3.048=-0.155
policies=200
mean18546.459-18442.263=104.196
σ0.468-0.492=-0.024
min18546.212-18441.928=104.284
max18547.160-18442.994=104.166
mean8400.000
σ0.000
min8400.000
max8400.000
mean2466.000-2848.000=-382.000
σ0.000
min2466.000-2848.000=-382.000
max2466.000-2848.000=-382.000
mean28.847-29.256=-0.409
σ0.048-0.495=-0.447
min28.782-28.774=0.009
max28.886-29.889=-1.003