Compare commits

Home / Compare 97c7c7a1 .. b7c450e1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.375=0.004
σ0.046-0.059=-0.013
min70.348-70.336=0.012
max70.508-70.541=-0.033
mean412.000
σ0.000
min412.000
max412.000
mean0.160-0.157=0.003
σ0.003-0.006=-0.003
min0.158-0.151=0.007
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.002-0.003=-0.000
min21.139-21.139=-0.000
max21.147-21.147=-0.001
mean412.000-412.900=-0.900
σ0.000-0.316=-0.316
min412.000
max412.000-413.000=-1.000
mean0.061-0.065=-0.003
σ0.004-0.003=0.001
min0.058-0.058=0.000
max0.069-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.201=0.186
σ0.361-0.361=0.000
min1751.827-1751.633=0.193
max1752.960-1752.804=0.156
mean1626.200-1651.800=-25.600
σ589.531-647.512=-57.981
min623.000-643.000=-20.000
max2413.000-2848.000=-435.000
mean2.806-2.849=-0.043
σ0.176-0.142=0.034
min2.390-2.514=-0.124
max3.028-3.066=-0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.127-269.933=0.194
σ0.004-0.006=-0.003
min270.121-269.926=0.195
max270.131-269.941=0.190
mean2413.000-2848.000=-435.000
σ0.000
min2413.000-2848.000=-435.000
max2413.000-2848.000=-435.000
mean0.378-0.373=0.005
σ0.001-0.007=-0.006
min0.376-0.368=0.008
max0.379-0.386=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1930.598-1930.396=0.203
σ0.006-0.012=-0.006
min1930.589-1930.376=0.213
max1930.604-1930.409=0.195
mean2413.000-2848.000=-435.000
σ0.000
min2413.000-2848.000=-435.000
max2413.000-2848.000=-435.000
mean2.595-2.494=0.101
σ0.094-0.050=0.044
min2.513-2.441=0.072
max2.750-2.569=0.181
iters=5
new-facts=6402
prior-facts=1
mean4751.017-4750.522=0.495
σ0.877-1.207=-0.330
min4750.333-4749.316=1.017
max4752.553-4752.463=0.089
mean2413.000-2848.000=-435.000
σ0.000
min2413.000-2848.000=-435.000
max2413.000-2848.000=-435.000
mean8.148-8.726=-0.578
σ0.361-0.553=-0.191
min7.821-7.787=0.034
max8.602-9.231=-0.629
iters=5
new-facts=6402
prior-facts=6402
mean4941.534-4941.261=0.273
σ0.082-0.201=-0.119
min4941.463-4940.935=0.528
max4941.627-4941.427=0.200
mean2966.200-3043.600=-77.400
σ413.398-199.691=213.707
min2445.000-2848.000=-403.000
max3520.000-3320.000=200.000
mean8.633-8.520=0.114
σ0.381-0.177=0.204
min8.349-8.348=0.001
max9.258-8.775=0.483

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.808-1.072=0.735
σ0.123-0.092=0.031
min1.665-0.944=0.720
max1.984-1.204=0.780

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.353-465.910=0.443
σ575.916-575.758=0.158
min178.393-178.024=0.370
max1330.227-1329.547=0.680
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2413.000-2848.000=-435.000
σ0.000
min2413.000-2848.000=-435.000
max2413.000-2848.000=-435.000
mean0.584-0.441=0.143
σ0.596-0.302=0.295
min0.280-0.287=-0.007
max1.478-0.894=0.585
policies=20
mean1784.188-1780.500=3.689
σ0.365-0.362=0.003
min1783.953-1780.235=3.718
max1784.730-1781.027=3.703
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2413.000-2848.000=-435.000
σ0.000
min2413.000-2848.000=-435.000
max2413.000-2848.000=-435.000
mean2.785-2.859=-0.074
σ0.019-0.009=0.010
min2.760-2.849=-0.088
max2.803-2.871=-0.068
policies=200
mean17848.645-17811.329=37.316
σ0.453-0.443=0.010
min17848.338-17810.887=37.451
max17849.319-17811.941=37.378
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2413.000-2848.000=-435.000
σ0.000
min2413.000-2848.000=-435.000
max2413.000-2848.000=-435.000
mean27.992-28.360=-0.368
σ0.128-0.479=-0.351
min27.835-27.810=0.026
max28.130-28.784=-0.654