Compare commits

Home / Compare f2720332 .. 93451ce3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.375=0.001
σ0.059-0.060=-0.001
min70.337-70.333=0.003
max70.540-70.541=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.157-0.159=-0.002
σ0.005-0.004=0.001
min0.148-0.150=-0.002
max0.163-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.000
σ0.002-0.002=-0.000
min21.139-21.139=-0.000
max21.148-21.145=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.064-0.062=0.002
σ0.003-0.003=-0.001
min0.062-0.058=0.004
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.202-1752.199=0.003
σ0.363-0.363=0.000
min1751.624-1751.630=-0.006
max1752.779-1752.777=0.002
mean1654.100-1655.150=-1.050
σ645.522-628.635=16.887
min632.000-629.000=3.000
max2848.000-2851.000=-3.000
mean2.822-2.848=-0.026
σ0.160-0.082=0.079
min2.375-2.695=-0.320
max3.044-3.026=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.929-269.933=-0.003
σ0.009-0.005=0.004
min269.920-269.926=-0.006
max269.944-269.939=0.005
mean2848.000-2851.000=-3.000
σ0.000
min2848.000-2851.000=-3.000
max2848.000-2851.000=-3.000
mean0.372-0.379=-0.007
σ0.004-0.013=-0.009
min0.368-0.369=-0.001
max0.378-0.396=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1930.396-1930.401=-0.004
σ0.009-0.008=0.001
min1930.384-1930.389=-0.005
max1930.407-1930.409=-0.003
mean2848.000-2851.000=-3.000
σ0.000
min2848.000-2851.000=-3.000
max2848.000-2851.000=-3.000
mean2.549-2.558=-0.009
σ0.124-0.121=0.003
min2.435-2.447=-0.012
max2.706-2.718=-0.012
iters=5
new-facts=6402
prior-facts=1
mean4750.653-4750.771=-0.118
σ0.360-0.992=-0.632
min4750.422-4749.778=0.644
max4751.290-4752.439=-1.148
mean2848.000-2851.000=-3.000
σ0.000
min2848.000-2851.000=-3.000
max2848.000-2851.000=-3.000
mean8.656-8.444=0.212
σ0.589-0.539=0.051
min7.767-7.657=0.109
max9.327-9.073=0.255
iters=5
new-facts=6402
prior-facts=6402
mean4941.262-4941.330=-0.068
σ0.206-0.087=0.119
min4940.923-4941.253=-0.330
max4941.436-4941.428=0.008
mean3057.600-3045.600=12.000
σ225.435-201.896=23.539
min2848.000-2851.000=-3.000
max3392.000-3332.000=60.000
mean8.501-8.473=0.028
σ0.110-0.123=-0.013
min8.367-8.358=0.009
max8.666-8.637=0.029

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-1.105=-0.088
σ0.120-0.078=0.042
min0.932-1.063=-0.130
max1.209-1.244=-0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.923-466.131=-0.208
σ575.778-576.200=-0.422
min178.027-178.026=0.000
max1329.591-1330.431=-0.841
mean81.750-82.000=-0.250
σ7.500-8.000=-0.500
min78.000
max93.000-94.000=-1.000
mean2848.000-2851.000=-3.000
σ0.000
min2848.000-2851.000=-3.000
max2848.000-2851.000=-3.000
mean0.441-0.444=-0.003
σ0.309-0.306=0.003
min0.284-0.289=-0.006
max0.905-0.903=0.002
policies=20
mean1780.508-1780.491=0.017
σ0.363-0.358=0.005
min1780.252-1780.234=0.019
max1781.040-1781.014=0.026
mean780.000
σ0.000
min780.000
max780.000
mean2848.000-2851.000=-3.000
σ0.000
min2848.000-2851.000=-3.000
max2848.000-2851.000=-3.000
mean2.846-2.853=-0.008
σ0.009-0.019=-0.009
min2.838-2.826=0.012
max2.859-2.865=-0.006
policies=200
mean17811.565-17811.158=0.407
σ0.419-0.123=0.296
min17811.292-17810.998=0.294
max17812.189-17811.294=0.895
mean7800.000
σ0.000
min7800.000
max7800.000
mean2848.000-2851.000=-3.000
σ0.000
min2848.000-2851.000=-3.000
max2848.000-2851.000=-3.000
mean28.340-28.337=0.003
σ0.521-0.475=0.047
min27.805-27.786=0.019
max28.901-28.805=0.096