Compare commits

Home / Compare 86e8dcca .. 58b6defc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-31.041=39.334
σ0.058-0.050=0.008
min70.339-31.004=39.335
max70.536-31.179=39.357
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.160-0.078=0.082
σ0.002-0.004=-0.002
min0.157-0.072=0.085
max0.164-0.086=0.079
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.002=0.000
min21.139-21.139=-0.000
max21.147-21.147=-0.000
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.061-0.065=-0.004
σ0.003-0.003=0.000
min0.059-0.063=-0.004
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1751.412=0.787
σ0.362-0.362=-0.001
min1751.628-1750.839=0.789
max1752.780-1751.974=0.806
mean1664.300-1638.950=25.350
σ625.500-615.595=9.905
min685.000-627.000=58.000
max2749.000-2473.000=276.000
mean2.813-2.770=0.043
σ0.194-0.196=-0.002
min2.277-2.286=-0.009
max3.031-3.049=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.907-271.646=-1.739
σ0.007-0.011=-0.004
min269.896-271.634=-1.738
max269.915-271.660=-1.745
mean2749.000-2473.000=276.000
σ0.000
min2749.000-2473.000=276.000
max2749.000-2473.000=276.000
mean0.374-0.381=-0.007
σ0.005-0.008=-0.003
min0.370-0.376=-0.006
max0.379-0.395=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1930.393-1932.106=-1.712
σ0.006-0.018=-0.012
min1930.385-1932.082=-1.697
max1930.399-1932.123=-1.724
mean2749.000-2473.000=276.000
σ0.000
min2749.000-2473.000=276.000
max2749.000-2473.000=276.000
mean2.526-2.604=-0.078
σ0.124-0.104=0.020
min2.356-2.506=-0.150
max2.658-2.730=-0.071
iters=5
new-facts=6402
prior-facts=1
mean4750.853-4752.384=-1.531
σ0.816-1.047=-0.231
min4750.339-4751.579=-1.240
max4752.304-4754.141=-1.837
mean2749.000-2473.000=276.000
σ0.000
min2749.000-2473.000=276.000
max2749.000-2473.000=276.000
mean8.500-8.332=0.168
σ0.534-0.554=-0.020
min7.614-7.738=-0.123
max8.873-8.992=-0.119
iters=5
new-facts=6402
prior-facts=6402
mean4941.262-4942.962=-1.700
σ0.125-0.201=-0.076
min4941.072-4942.632=-1.560
max4941.423-4943.126=-1.703
mean3024.600-2968.600=56.000
σ249.937-429.123=-179.187
min2749.000-2478.000=271.000
max3362.000-3553.000=-191.000
mean8.504-8.474=0.030
σ0.106-0.116=-0.010
min8.368-8.367=0.001
max8.628-8.661=-0.034

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.804=-0.751
σ0.124-0.148=-0.024
min0.942-1.609=-0.667
max1.246-2.005=-0.760

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.912-465.113=0.799
σ575.770-575.753=0.017
min178.020-177.231=0.789
max1329.567-1328.742=0.825
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2749.000-2473.000=276.000
σ0.000
min2749.000-2473.000=276.000
max2749.000-2473.000=276.000
mean0.567-0.546=0.020
σ0.561-0.529=0.032
min0.283-0.277=0.005
max1.408-1.340=0.068
policies=20
mean1780.434-1772.570=7.864
σ0.347-0.327=0.020
min1780.202-1772.344=7.857
max1780.949-1773.054=7.895
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2749.000-2473.000=276.000
σ0.000
min2749.000-2473.000=276.000
max2749.000-2473.000=276.000
mean2.766-2.730=0.036
σ0.021-0.017=0.004
min2.746-2.709=0.037
max2.794-2.749=0.045
policies=200
mean17811.233-17732.504=78.728
σ0.525-0.474=0.050
min17810.803-17732.216=78.586
max17811.996-17733.214=78.782
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2749.000-2473.000=276.000
σ0.000
min2749.000-2473.000=276.000
max2749.000-2473.000=276.000
mean27.773-27.759=0.014
σ0.159-0.170=-0.011
min27.659-27.637=0.022
max28.008-28.010=-0.002