Compare commits

Home / Compare 07d19a1d .. 0cc769da

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.697-70.568=0.129
σ0.047-0.045=0.002
min70.671-70.545=0.126
max70.830-70.694=0.135
mean413.200-414.000=-0.800
σ0.422-0.000=0.422
min413.000-414.000=-1.000
max414.000
mean0.160-0.159=0.001
σ0.003-0.005=-0.002
min0.155-0.152=0.004
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.424-21.288=0.136
σ0.011-0.003=0.008
min21.416-21.282=0.134
max21.455-21.293=0.162
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.062=0.002
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.372-1753.568=0.804
σ0.361-0.362=-0.001
min1753.802-1752.991=0.811
max1754.972-1754.152=0.819
mean1633.300-1651.150=-17.850
σ588.313-629.855=-41.542
min624.000-641.000=-17.000
max2416.000-2844.000=-428.000
mean2.759-2.804=-0.045
σ0.172-0.130=0.042
min2.259-2.387=-0.128
max2.936-2.978=-0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.422-272.018=1.404
σ0.003-0.007=-0.005
min273.420-272.008=1.412
max273.426-272.028=1.398
mean2416.000-2844.000=-428.000
σ0.000
min2416.000-2844.000=-428.000
max2416.000-2844.000=-428.000
mean0.386-0.393=-0.007
σ0.009-0.009=0.001
min0.380-0.379=0.002
max0.403-0.402=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.810-1932.439=1.371
σ0.011-0.014=-0.003
min1933.793-1932.416=1.376
max1933.823-1932.455=1.368
mean2416.000-2844.000=-428.000
σ0.000
min2416.000-2844.000=-428.000
max2416.000-2844.000=-428.000
mean2.864-3.057=-0.193
σ0.189-0.151=0.038
min2.534-2.957=-0.423
max2.984-3.308=-0.324
iters=5
new-facts=6402
prior-facts=1
mean4754.547-4752.878=1.669
σ0.912-0.876=0.036
min4754.107-4751.614=2.493
max4756.176-4754.089=2.087
mean2416.000-2844.000=-428.000
σ0.000
min2416.000-2844.000=-428.000
max2416.000-2844.000=-428.000
mean8.805-8.039=0.766
σ0.188-0.429=-0.241
min8.575-7.676=0.899
max9.014-8.611=0.403
iters=5
new-facts=6402
prior-facts=6402
mean4944.970-4943.625=1.345
σ0.167-0.017=0.150
min4944.672-4943.608=1.064
max4945.063-4943.648=1.415
mean2978.000-3065.000=-87.000
σ285.703-294.858=-9.156
min2596.000-2844.000=-248.000
max3321.000-3521.000=-200.000
mean8.659-8.626=0.033
σ0.248-0.455=-0.207
min8.426-8.308=0.118
max9.027-9.357=-0.330

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.818-1.049=0.769
σ0.064-0.127=-0.064
min1.764-0.935=0.829
max1.902-1.246=0.655

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.844-473.090=0.754
σ575.912-575.926=-0.014
min185.884-185.113=0.770
max1337.712-1336.979=0.733
mean88.250
σ8.500
min84.000
max101.000
mean2416.000-2844.000=-428.000
σ0.000
min2416.000-2844.000=-428.000
max2416.000-2844.000=-428.000
mean0.564-0.485=0.079
σ0.543-0.382=0.161
min0.288-0.291=-0.003
max1.379-1.058=0.321
policies=20
mean1859.147-1851.465=7.683
σ0.363-0.373=-0.010
min1858.898-1851.189=7.709
max1859.681-1852.006=7.675
mean840.000
σ0.000
min840.000
max840.000
mean2416.000-2844.000=-428.000
σ0.000
min2416.000-2844.000=-428.000
max2416.000-2844.000=-428.000
mean2.877-2.943=-0.066
σ0.038-0.014=0.024
min2.848-2.929=-0.080
max2.928-2.962=-0.034
policies=200
mean18598.316-18521.067=77.249
σ0.577-0.542=0.035
min18597.930-18520.711=77.218
max18599.166-18521.873=77.292
mean8400.000
σ0.000
min8400.000
max8400.000
mean2416.000-2844.000=-428.000
σ0.000
min2416.000-2844.000=-428.000
max2416.000-2844.000=-428.000
mean28.893-29.266=-0.373
σ0.055-0.509=-0.455
min28.845-28.781=0.063
max28.942-29.756=-0.814