Compare commits

Home / Compare b93cc339 .. 60195744

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.782=-0.002
σ0.044-0.053=-0.009
min70.752-70.748=0.004
max70.901-70.929=-0.028
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.156-0.160=-0.004
σ0.006-0.004=0.002
min0.148-0.157=-0.009
max0.164-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.003-0.003=-0.001
min21.489-21.489=-0.001
max21.497-21.497=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.064=-0.001
σ0.004-0.003=0.000
min0.058-0.060=-0.001
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1751.882=2.213
σ0.362-0.360=0.002
min1753.528-1751.310=2.219
max1754.693-1752.480=2.213
mean1665.500-1635.700=29.800
σ640.150-628.846=11.304
min630.000-619.000=11.000
max2779.000-2766.000=13.000
mean2.800-2.807=-0.007
σ0.173-0.210=-0.037
min2.267-2.129=0.139
max3.002-3.093=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.950-269.378=2.571
σ0.008-0.009=-0.001
min271.937-269.368=2.570
max271.958-269.391=2.567
mean2779.000-2766.000=13.000
σ0.000
min2779.000-2766.000=13.000
max2779.000-2766.000=13.000
mean0.380-0.378=0.002
σ0.001-0.005=-0.004
min0.378-0.374=0.004
max0.381-0.386=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.324-1929.741=2.583
σ0.018-0.023=-0.004
min1932.307-1929.722=2.585
max1932.355-1929.769=2.586
mean2779.000-2766.000=13.000
σ0.000
min2779.000-2766.000=13.000
max2779.000-2766.000=13.000
mean2.861-3.043=-0.182
σ0.235-0.218=0.017
min2.470-2.726=-0.257
max3.058-3.288=-0.230
iters=5
new-facts=6402
prior-facts=1
mean4753.099-4750.534=2.565
σ0.903-0.845=0.057
min4752.586-4750.064=2.522
max4754.704-4752.041=2.663
mean2779.000-2766.000=13.000
σ0.000
min2779.000-2766.000=13.000
max2779.000-2766.000=13.000
mean8.533-8.339=0.195
σ0.464-0.419=0.045
min7.769-7.791=-0.022
max8.945-8.812=0.133
iters=5
new-facts=6402
prior-facts=6402
mean4943.486-4940.982=2.504
σ0.159-0.014=0.145
min4943.203-4940.963=2.239
max4943.573-4940.998=2.575
mean3002.800-3027.200=-24.400
σ223.257-323.413=-100.156
min2779.000-2766.000=13.000
max3321.000-3520.000=-199.000
mean8.517-8.399=0.119
σ0.062-0.115=-0.053
min8.439-8.312=0.127
max8.611-8.597=0.014

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.990-1.017=-0.027
σ0.134-0.125=0.009
min0.926-0.926=-0.000
max1.229-1.214=0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.660-462.723=5.937
σ574.925-574.975=-0.051
min181.189-175.227=5.962
max1331.047-1325.186=5.861
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2779.000-2766.000=13.000
σ0.000
min2779.000-2766.000=13.000
max2779.000-2766.000=13.000
mean0.445-0.597=-0.152
σ0.303-0.637=-0.334
min0.288-0.275=0.013
max0.899-1.553=-0.653
policies=20
mean1812.223-1752.522=59.701
σ0.372-0.356=0.016
min1811.970-1752.300=59.669
max1812.769-1753.055=59.714
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2779.000-2766.000=13.000
σ0.000
min2779.000-2766.000=13.000
max2779.000-2766.000=13.000
mean2.938-2.728=0.211
σ0.061-0.015=0.047
min2.902-2.712=0.190
max3.030-2.741=0.290
policies=200
mean18129.221-17532.324=596.897
σ0.466-0.370=0.096
min18128.961-17532.116=596.845
max18129.917-17532.878=597.040
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2779.000-2766.000=13.000
σ0.000
min2779.000-2766.000=13.000
max2779.000-2766.000=13.000
mean28.492-27.530=0.962
σ0.041-0.153=-0.112
min28.453-27.409=1.044
max28.537-27.754=0.782