Compare commits

Home / Compare 8ecefac8 .. 7ffa7f75

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.374=0.006
σ0.045-0.058=-0.014
min70.354-70.335=0.019
max70.504-70.537=-0.033
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.158-0.158=-0.000
σ0.004-0.004=0.000
min0.150-0.150=-0.000
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.002
σ0.003-0.002=0.001
min21.140-21.142=-0.002
max21.149-21.147=0.002
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.061-0.066=-0.004
σ0.005-0.003=0.001
min0.058-0.063=-0.005
max0.073-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.202=0.187
σ0.360-0.361=-0.001
min1751.826-1751.628=0.198
max1752.961-1752.803=0.158
mean1653.400-1650.700=2.700
σ632.727-644.113=-11.386
min624.000-615.000=9.000
max2849.000-2775.000=74.000
mean2.846-2.826=0.021
σ0.120-0.119=0.001
min2.582-2.480=0.102
max3.035-3.050=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.230-270.024=0.205
σ0.008-0.007=0.002
min270.224-270.014=0.210
max270.242-270.030=0.212
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean0.391-0.378=0.013
σ0.009-0.010=-0.001
min0.382-0.369=0.013
max0.402-0.392=0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.691-1930.477=0.214
σ0.009-0.020=-0.012
min1930.680-1930.451=0.229
max1930.703-1930.496=0.207
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean2.507-2.554=-0.048
σ0.154-0.132=0.022
min2.325-2.453=-0.127
max2.746-2.772=-0.025
iters=5
new-facts=6402
prior-facts=1
mean4751.164-4750.821=0.344
σ0.875-0.946=-0.070
min4750.570-4749.808=0.761
max4752.716-4752.373=0.343
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean8.630-8.651=-0.021
σ0.562-0.284=0.278
min7.665-8.354=-0.689
max9.097-9.054=0.043
iters=5
new-facts=6402
prior-facts=6402
mean4941.631-4941.343=0.287
σ0.088-0.213=-0.125
min4941.561-4940.984=0.576
max4941.738-4941.507=0.231
mean3092.000-2993.800=98.200
σ249.646-212.957=36.689
min2849.000-2775.000=74.000
max3349.000-3306.000=43.000
mean8.773-8.582=0.192
σ0.264-0.171=0.093
min8.464-8.338=0.125
max9.179-8.789=0.390

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.039-1.032=0.007
σ0.140-0.135=0.006
min0.943-0.941=0.002
max1.272-1.251=0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.359-465.913=0.446
σ575.920-575.762=0.158
min178.393-178.025=0.368
max1330.239-1329.557=0.683
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean0.446-0.445=0.001
σ0.312-0.307=0.005
min0.288-0.292=-0.004
max0.913-0.906=0.008
policies=20
mean1784.272-1780.491=3.781
σ0.366-0.341=0.025
min1784.010-1780.242=3.767
max1784.809-1780.988=3.821
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean2.872-2.854=0.018
σ0.009-0.075=-0.066
min2.866-2.760=0.106
max2.885-2.943=-0.058
policies=200
mean17848.960-17811.464=37.496
σ0.437-0.569=-0.132
min17848.704-17811.010=37.694
max17849.610-17812.288=37.321
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2849.000-2775.000=74.000
σ0.000
min2849.000-2775.000=74.000
max2849.000-2775.000=74.000
mean28.527-27.912=0.615
σ0.520-0.270=0.251
min28.050-27.767=0.284
max29.043-28.316=0.726