Compare commits

Home / Compare d70172b2 .. f4459c21

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.708-70.781=-0.074
σ0.045-0.048=-0.003
min70.680-70.753=-0.072
max70.834-70.914=-0.080
mean414.800-415.000=-0.200
σ0.422-0.000=0.422
min414.000-415.000=-1.000
max415.000
mean0.164-0.158=0.005
σ0.006-0.005=0.001
min0.157-0.150=0.007
max0.177-0.168=0.009
cache=y
dps=1
iters=10
policies=100
mean21.412-21.493=-0.081
σ0.002-0.003=-0.001
min21.407-21.490=-0.082
max21.415-21.500=-0.085
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.066=-0.001
σ0.003-0.003=0.000
min0.063-0.064=-0.001
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.092=0.837
σ0.361-0.358=0.003
min1754.363-1753.523=0.840
max1755.515-1754.676=0.839
mean1666.700-1650.000=16.700
σ620.222-627.251=-7.030
min626.000-630.000=-4.000
max2503.000-2707.000=-204.000
mean2.804-2.711=0.093
σ0.172-0.220=-0.048
min2.269-2.128=0.141
max3.003-2.999=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.791-271.940=0.851
σ0.006-0.016=-0.010
min272.785-271.919=0.865
max272.799-271.956=0.842
mean2503.000-2707.000=-204.000
σ0.000
min2503.000-2707.000=-204.000
max2503.000-2707.000=-204.000
mean0.376-0.383=-0.007
σ0.001-0.008=-0.007
min0.375-0.378=-0.003
max0.378-0.397=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1933.222-1932.324=0.898
σ0.010-0.009=0.001
min1933.212-1932.309=0.903
max1933.238-1932.332=0.906
mean2503.000-2707.000=-204.000
σ0.000
min2503.000-2707.000=-204.000
max2503.000-2707.000=-204.000
mean2.989-3.029=-0.040
σ0.142-0.025=0.117
min2.755-3.002=-0.247
max3.102-3.067=0.034
iters=5
new-facts=6402
prior-facts=1
mean4756.816-4753.061=3.755
σ7.610-0.926=6.684
min4752.878-4752.571=0.308
max4770.417-4754.711=15.705
mean2503.000-2707.000=-204.000
σ0.000
min2503.000-2707.000=-204.000
max2503.000-2707.000=-204.000
mean8.674-8.634=0.040
σ0.378-0.486=-0.108
min8.163-7.889=0.274
max9.073-9.056=0.017
iters=5
new-facts=6402
prior-facts=6402
mean4944.447-4943.556=0.892
σ0.012-0.014=-0.001
min4944.433-4943.539=0.894
max4944.465-4943.574=0.891
mean2971.200-2976.600=-5.400
σ271.021-227.674=43.347
min2623.000-2707.000=-84.000
max3332.000-3294.000=38.000
mean8.537-8.533=0.004
σ0.087-0.123=-0.036
min8.443-8.390=0.053
max8.669-8.708=-0.040

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.553-1.115=0.438
σ0.221-0.136=0.086
min1.183-0.935=0.249
max1.777-1.252=0.524

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.305-468.662=-0.357
σ574.231-574.935=-0.704
min181.183-181.189=-0.006
max1329.652-1331.064=-1.412
mean88.250
σ8.500
min84.000
max101.000
mean2503.000-2707.000=-204.000
σ0.000
min2503.000-2707.000=-204.000
max2503.000-2707.000=-204.000
mean0.565-0.567=-0.002
σ0.558-0.571=-0.013
min0.286-0.271=0.014
max1.401-1.423=-0.021
policies=20
mean1812.152-1812.207=-0.054
σ0.395-0.387=0.008
min1811.881-1811.949=-0.068
max1812.736-1812.778=-0.042
mean840.000
σ0.000
min840.000
max840.000
mean2503.000-2707.000=-204.000
σ0.000
min2503.000-2707.000=-204.000
max2503.000-2707.000=-204.000
mean2.813-2.842=-0.029
σ0.016-0.006=0.010
min2.793-2.835=-0.042
max2.829-2.847=-0.018
policies=200
mean18129.034-18129.165=-0.131
σ0.541-0.347=0.194
min18128.590-18128.907=-0.317
max18129.804-18129.677=0.128
mean8400.000
σ0.000
min8400.000
max8400.000
mean2503.000-2707.000=-204.000
σ0.000
min2503.000-2707.000=-204.000
max2503.000-2707.000=-204.000
mean28.330-28.542=-0.212
σ0.046-0.140=-0.094
min28.282-28.430=-0.148
max28.387-28.747=-0.360