Compare commits

Home / Compare 0b6ce5da .. cb6bcc3b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.728=0.004
σ0.044-0.047=-0.004
min70.708-70.703=0.005
max70.852-70.861=-0.009
mean413.000
σ0.000
min413.000
max413.000
mean0.158-0.156=0.002
σ0.003-0.006=-0.003
min0.155-0.148=0.007
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.446-21.449=-0.004
σ0.002-0.012=-0.010
min21.442-21.442=-0.001
max21.448-21.483=-0.035
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.064=-0.001
σ0.003-0.003=-0.000
min0.059-0.060=-0.001
max0.067-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.529-1754.527=0.001
σ0.360-0.360=0.000
min1753.960-1753.954=0.006
max1755.112-1755.111=0.001
mean1650.550-1645.950=4.600
σ639.738-635.457=4.281
min616.000-639.000=-23.000
max2785.000-2855.000=-70.000
mean2.826-2.783=0.042
σ0.184-0.204=-0.020
min2.178-2.330=-0.152
max3.100-3.111=-0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.607-273.610=-0.004
σ0.010-0.006=0.004
min273.598-273.602=-0.004
max273.623-273.616=0.007
mean2785.000-2855.000=-70.000
σ0.000
min2785.000-2855.000=-70.000
max2785.000-2855.000=-70.000
mean0.383-0.383=0.000
σ0.004-0.004=0.000
min0.380-0.381=-0.001
max0.390-0.390=0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.997-1934.001=-0.004
σ0.002-0.006=-0.003
min1933.993-1933.993=-0.000
max1933.999-1934.006=-0.007
mean2785.000-2855.000=-70.000
σ0.000
min2785.000-2855.000=-70.000
max2785.000-2855.000=-70.000
mean3.054-2.943=0.111
σ0.116-0.184=-0.068
min2.915-2.692=0.222
max3.216-3.129=0.088
iters=5
new-facts=6402
prior-facts=1
mean4754.760-4754.649=0.111
σ0.837-0.899=-0.062
min4754.306-4753.956=0.350
max4756.250-4756.224=0.025
mean2785.000-2855.000=-70.000
σ0.000
min2785.000-2855.000=-70.000
max2785.000-2855.000=-70.000
mean8.464-8.554=-0.090
σ0.521-0.540=-0.019
min7.617-7.661=-0.043
max8.948-8.933=0.016
iters=5
new-facts=6402
prior-facts=6402
mean4945.153-4945.221=-0.068
σ0.143-0.019=0.123
min4944.898-4945.197=-0.298
max4945.232-4945.243=-0.011
mean3034.800-3066.000=-31.200
σ255.453-222.741=32.712
min2785.000-2855.000=-70.000
max3398.000-3298.000=100.000
mean8.696-8.697=-0.001
σ0.300-0.269=0.031
min8.419-8.366=0.053
max9.118-9.070=0.048

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.084=-0.059
σ0.132-0.113=0.019
min0.936-0.944=-0.008
max1.237-1.260=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.851-472.841=0.010
σ574.961-574.930=0.031
min185.364-185.372=-0.008
max1335.292-1335.236=0.056
mean88.250
σ8.500
min84.000
max101.000
mean2785.000-2855.000=-70.000
σ0.000
min2785.000-2855.000=-70.000
max2785.000-2855.000=-70.000
mean0.497-0.490=0.007
σ0.421-0.381=0.040
min0.285-0.297=-0.012
max1.129-1.061=0.067
policies=20
mean1853.990-1854.013=-0.023
σ0.385-0.347=0.037
min1853.720-1853.774=-0.053
max1854.557-1854.524=0.034
mean840.000
σ0.000
min840.000
max840.000
mean2785.000-2855.000=-70.000
σ0.000
min2785.000-2855.000=-70.000
max2785.000-2855.000=-70.000
mean2.886-2.957=-0.071
σ0.011-0.007=0.004
min2.875-2.950=-0.075
max2.901-2.964=-0.063
policies=200
mean18546.611-18546.606=0.006
σ0.439-0.506=-0.066
min18546.295-18546.195=0.099
max18547.260-18547.334=-0.073
mean8400.000
σ0.000
min8400.000
max8400.000
mean2785.000-2855.000=-70.000
σ0.000
min2785.000-2855.000=-70.000
max2785.000-2855.000=-70.000
mean28.885-29.139=-0.254
σ0.035-0.405=-0.369
min28.837-28.839=-0.002
max28.921-29.736=-0.816