Compare commits

Home / Compare ba2087d0 .. 0fc1582b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.567=-0.002
σ0.047-0.046=0.002
min70.535-70.540=-0.005
max70.697-70.691=0.006
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.161-0.161=0.000
σ0.003-0.003=-0.000
min0.158-0.157=0.001
max0.166-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=0.000
σ0.003-0.003=0.001
min21.282-21.283=-0.000
max21.292-21.291=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.060-0.063=-0.002
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1715.468-1753.372=-37.904
σ169.652-0.361=169.291
min994.700-1752.800=-758.100
max1753.948-1753.959=-0.010
mean1610.900-1662.400=-51.500
σ619.692-637.232=-17.540
min621.000-618.000=3.000
max2696.000-2804.000=-108.000
mean2.781-2.820=-0.039
σ0.288-0.084=0.204
min1.705-2.632=-0.927
max3.163-2.979=0.184

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.752-271.754=-0.003
σ0.006-0.005=0.001
min271.745-271.747=-0.002
max271.760-271.761=-0.001
mean2696.000-2804.000=-108.000
σ0.000
min2696.000-2804.000=-108.000
max2696.000-2804.000=-108.000
mean0.378-0.381=-0.003
σ0.006-0.004=0.002
min0.371-0.379=-0.008
max0.388-0.389=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.177-1932.169=0.008
σ0.018-0.013=0.005
min1932.151-1932.151=-0.000
max1932.196-1932.182=0.013
mean2696.000-2804.000=-108.000
σ0.000
min2696.000-2804.000=-108.000
max2696.000-2804.000=-108.000
mean2.921-2.961=-0.040
σ0.126-0.303=-0.177
min2.744-2.457=0.287
max3.059-3.251=-0.192
iters=5
new-facts=6402
prior-facts=1
mean4752.920-4752.781=0.139
σ0.903-1.025=-0.123
min4752.413-4751.921=0.492
max4754.525-4754.560=-0.035
mean2696.000-2804.000=-108.000
σ0.000
min2696.000-2804.000=-108.000
max2696.000-2804.000=-108.000
mean8.445-8.743=-0.298
σ0.536-0.255=0.281
min7.646-8.461=-0.815
max8.995-9.105=-0.109
iters=5
new-facts=6402
prior-facts=6402
mean4943.373-4943.308=0.065
σ0.016-0.148=-0.133
min4943.354-4943.046=0.309
max4943.391-4943.403=-0.011
mean2956.000-3010.400=-54.400
σ309.121-211.701=97.420
min2696.000-2804.000=-108.000
max3427.000-3311.000=116.000
mean8.378-8.592=-0.214
σ0.060-0.160=-0.100
min8.309-8.440=-0.130
max8.430-8.845=-0.415

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.071=-0.051
σ0.138-0.225=-0.087
min0.930-0.932=-0.002
max1.244-1.458=-0.214

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.870-467.861=0.010
σ575.950-575.922=0.028
min179.890-179.888=0.001
max1331.795-1331.744=0.051
mean86.250
σ8.500
min82.000
max99.000
mean2696.000-2804.000=-108.000
σ0.000
min2696.000-2804.000=-108.000
max2696.000-2804.000=-108.000
mean0.562-0.479=0.083
σ0.556-0.391=0.165
min0.283-0.281=0.002
max1.397-1.066=0.331
policies=20
mean1799.143-1799.165=-0.022
σ0.370-0.376=-0.006
min1798.917-1798.900=0.017
max1799.695-1799.723=-0.029
mean820.000
σ0.000
min820.000
max820.000
mean2696.000-2804.000=-108.000
σ0.000
min2696.000-2804.000=-108.000
max2696.000-2804.000=-108.000
mean2.794-2.796=-0.001
σ0.013-0.019=-0.006
min2.786-2.776=0.010
max2.814-2.815=-0.002
policies=200
mean17998.495-17998.503=-0.008
σ0.444-0.467=-0.023
min17998.221-17998.233=-0.011
max17999.159-17999.200=-0.042
mean8200.000
σ0.000
min8200.000
max8200.000
mean2696.000-2804.000=-108.000
σ0.000
min2696.000-2804.000=-108.000
max2696.000-2804.000=-108.000
mean28.102-28.248=-0.146
σ0.077-0.140=-0.063
min28.028-28.093=-0.065
max28.190-28.430=-0.240