Compare commits

Home / Compare ffff4b3b .. 9bd63548

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.396-70.395=0.000
σ0.044-0.048=-0.004
min70.367-70.370=-0.003
max70.518-70.530=-0.012
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.160-0.154=0.006
σ0.003-0.005=-0.001
min0.157-0.149=0.008
max0.165-0.162=0.003
cache=y
dps=1
iters=10
policies=100
mean21.147-21.148=-0.001
σ0.003-0.003=0.001
min21.141-21.144=-0.003
max21.154-21.152=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.064=0.000
σ0.004-0.002=0.002
min0.059-0.062=-0.003
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.393=-0.000
σ0.362-0.359=0.003
min1751.829-1751.819=0.010
max1752.960-1752.960=0.001
mean1656.200-1651.950=4.250
σ644.704-626.583=18.121
min622.000-627.000=-5.000
max2850.000-2852.000=-2.000
mean2.857-2.839=0.018
σ0.194-0.089=0.105
min2.281-2.701=-0.420
max3.187-3.011=0.176

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.119-270.126=-0.007
σ0.004-0.012=-0.008
min270.114-270.118=-0.004
max270.124-270.146=-0.022
mean2850.000-2852.000=-2.000
σ0.000
min2850.000-2852.000=-2.000
max2850.000-2852.000=-2.000
mean0.380-0.378=0.002
σ0.001-0.005=-0.004
min0.378-0.370=0.008
max0.381-0.382=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.566-1930.608=-0.041
σ0.064-0.006=0.058
min1930.455-1930.599=-0.144
max1930.613-1930.617=-0.004
mean2850.000-2852.000=-2.000
σ0.000
min2850.000-2852.000=-2.000
max2850.000-2852.000=-2.000
mean2.590-2.511=0.079
σ0.128-0.075=0.053
min2.477-2.453=0.024
max2.788-2.630=0.159
iters=5
new-facts=6402
prior-facts=1
mean4751.185-4751.331=-0.146
σ1.033-0.824=0.209
min4750.208-4750.926=-0.718
max4752.943-4752.803=0.140
mean2850.000-2852.000=-2.000
σ0.000
min2850.000-2852.000=-2.000
max2850.000-2852.000=-2.000
mean8.701-8.289=0.412
σ0.559-0.361=0.198
min7.968-7.701=0.267
max9.424-8.584=0.840
iters=5
new-facts=6402
prior-facts=6402
mean4941.694-4941.549=0.146
σ0.170-0.308=-0.138
min4941.391-4941.076=0.315
max4941.784-4941.768=0.016
mean2987.400-3078.800=-91.400
σ216.504-226.501=-9.997
min2850.000-2852.000=-2.000
max3345.000-3380.000=-35.000
mean8.395-8.736=-0.341
σ0.022-0.404=-0.383
min8.365-8.389=-0.024
max8.417-9.332=-0.915

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.103-0.997=0.106
σ0.253-0.130=0.124
min0.923-0.930=-0.007
max1.500-1.229=0.271

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.372-466.368=0.004
σ575.929-575.922=0.007
min178.405-178.403=0.002
max1330.265-1330.251=0.014
mean84.000
σ8.000
min80.000
max96.000
mean2850.000-2852.000=-2.000
σ0.000
min2850.000-2852.000=-2.000
max2850.000-2852.000=-2.000
mean0.446-0.439=0.007
σ0.304-0.302=0.002
min0.291-0.282=0.010
max0.903-0.892=0.010
policies=20
mean1784.349-1784.358=-0.008
σ0.367-0.359=0.008
min1784.095-1784.108=-0.013
max1784.889-1784.885=0.004
mean800.000
σ0.000
min800.000
max800.000
mean2850.000-2852.000=-2.000
σ0.000
min2850.000-2852.000=-2.000
max2850.000-2852.000=-2.000
mean2.859-2.863=-0.004
σ0.007-0.005=0.002
min2.851-2.857=-0.006
max2.865-2.869=-0.003
policies=200
mean17849.775-17849.665=0.111
σ0.418-0.551=-0.133
min17849.544-17849.372=0.172
max17850.401-17850.490=-0.090
mean8000.000
σ0.000
min8000.000
max8000.000
mean2850.000-2852.000=-2.000
σ0.000
min2850.000-2852.000=-2.000
max2850.000-2852.000=-2.000
mean28.480-28.466=0.013
σ0.496-0.399=0.097
min28.019-28.001=0.017
max28.959-28.803=0.156