Compare commits

Home / Compare 672c0fad .. e7970f36

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.375=-0.000
σ0.058-0.059=-0.001
min70.335-70.336=-0.002
max70.537-70.541=-0.004
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.157-0.157=0.000
σ0.004-0.006=-0.002
min0.150-0.151=-0.001
max0.163-0.168=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.003=0.000
min21.139-21.139=0.000
max21.147-21.147=-0.000
mean416.000-412.900=3.100
σ0.000-0.316=-0.316
min416.000-412.000=4.000
max416.000-413.000=3.000
mean0.062-0.065=-0.003
σ0.003-0.003=0.001
min0.057-0.058=-0.001
max0.065-0.068=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.203-1752.201=0.002
σ0.361-0.361=-0.000
min1751.625-1751.633=-0.008
max1752.784-1752.804=-0.020
mean1655.900-1651.800=4.100
σ646.775-647.512=-0.737
min647.000-643.000=4.000
max2858.000-2848.000=10.000
mean2.864-2.849=0.015
σ0.108-0.142=-0.034
min2.562-2.514=0.048
max3.091-3.066=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.933=-0.001
σ0.007-0.006=0.001
min269.920-269.926=-0.006
max269.938-269.941=-0.003
mean2858.000-2848.000=10.000
σ0.000
min2858.000-2848.000=10.000
max2858.000-2848.000=10.000
mean0.372-0.373=-0.001
σ0.006-0.007=-0.002
min0.368-0.368=0.000
max0.382-0.386=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.400-1930.396=0.004
σ0.025-0.012=0.012
min1930.357-1930.376=-0.020
max1930.420-1930.409=0.011
mean2858.000-2848.000=10.000
σ0.000
min2858.000-2848.000=10.000
max2858.000-2848.000=10.000
mean2.537-2.494=0.043
σ0.132-0.050=0.082
min2.444-2.441=0.003
max2.755-2.569=0.186
iters=5
new-facts=6402
prior-facts=1
mean4750.845-4750.522=0.323
σ0.803-1.207=-0.404
min4750.343-4749.316=1.028
max4752.259-4752.463=-0.205
mean2858.000-2848.000=10.000
σ0.000
min2858.000-2848.000=10.000
max2858.000-2848.000=10.000
mean8.593-8.726=-0.133
σ0.275-0.553=-0.278
min8.281-7.787=0.494
max8.919-9.231=-0.313
iters=5
new-facts=6402
prior-facts=6402
mean4941.329-4941.261=0.068
σ0.083-0.201=-0.117
min4941.263-4940.935=0.328
max4941.421-4941.427=-0.006
mean3022.400-3043.600=-21.200
σ186.934-199.691=-12.757
min2858.000-2848.000=10.000
max3314.000-3320.000=-6.000
mean8.453-8.520=-0.067
σ0.120-0.177=-0.056
min8.294-8.348=-0.054
max8.556-8.775=-0.219

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-1.072=-0.018
σ0.126-0.092=0.034
min0.938-0.944=-0.007
max1.251-1.204=0.047

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.913-465.910=0.003
σ575.757-575.758=-0.001
min178.031-178.024=0.007
max1329.548-1329.547=0.001
mean81.750
σ7.500
min78.000
max93.000
mean2858.000-2848.000=10.000
σ0.000
min2858.000-2848.000=10.000
max2858.000-2848.000=10.000
mean0.442-0.441=0.001
σ0.303-0.302=0.001
min0.286-0.287=-0.001
max0.897-0.894=0.003
policies=20
mean1780.506-1780.500=0.006
σ0.357-0.362=-0.005
min1780.252-1780.235=0.017
max1781.030-1781.027=0.003
mean780.000
σ0.000
min780.000
max780.000
mean2858.000-2848.000=10.000
σ0.000
min2858.000-2848.000=10.000
max2858.000-2848.000=10.000
mean2.849-2.859=-0.010
σ0.009-0.009=-0.001
min2.841-2.849=-0.007
max2.861-2.871=-0.010
policies=200
mean17811.595-17811.329=0.266
σ0.462-0.443=0.019
min17811.256-17810.887=0.369
max17812.278-17811.941=0.336
mean7800.000
σ0.000
min7800.000
max7800.000
mean2858.000-2848.000=10.000
σ0.000
min2858.000-2848.000=10.000
max2858.000-2848.000=10.000
mean28.364-28.360=0.005
σ0.466-0.479=-0.013
min27.819-27.810=0.009
max28.792-28.784=0.008