Compare commits

Home / Compare 774dfabb .. e79999b1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.699=-0.004
σ0.046-0.046=-0.000
min70.671-70.669=0.002
max70.825-70.827=-0.003
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.157-0.161=-0.004
σ0.005-0.004=0.001
min0.151-0.158=-0.007
max0.165-0.170=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.420-21.420=0.000
σ0.003-0.003=0.000
min21.417-21.416=0.001
max21.427-21.424=0.003
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.063-0.065=-0.002
σ0.002-0.002=0.000
min0.059-0.063=-0.004
max0.067-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.459=-0.001
σ0.359-0.360=-0.001
min1753.887-1753.883=0.003
max1755.026-1755.052=-0.027
mean1641.600-1650.800=-9.200
σ629.198-635.747=-6.549
min624.000-625.000=-1.000
max2860.000-2774.000=86.000
mean2.819-2.793=0.026
σ0.119-0.207=-0.089
min2.601-2.148=0.453
max3.118-3.001=0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.506-273.500=0.006
σ0.010-0.007=0.004
min273.494-273.490=0.004
max273.520-273.507=0.013
mean2860.000-2774.000=86.000
σ0.000
min2860.000-2774.000=86.000
max2860.000-2774.000=86.000
mean0.376-0.376=0.000
σ0.004-0.005=-0.001
min0.373-0.371=0.002
max0.382-0.384=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.900-1933.891=0.008
σ0.014-0.006=0.008
min1933.882-1933.886=-0.004
max1933.917-1933.901=0.015
mean2860.000-2774.000=86.000
σ0.000
min2860.000-2774.000=86.000
max2860.000-2774.000=86.000
mean2.908-2.996=-0.088
σ0.257-0.137=0.119
min2.467-2.800=-0.333
max3.118-3.147=-0.029
iters=5
new-facts=6402
prior-facts=1
mean4754.734-4754.507=0.227
σ0.783-0.639=0.144
min4754.325-4754.141=0.184
max4756.133-4755.646=0.487
mean2860.000-2774.000=86.000
σ0.000
min2860.000-2774.000=86.000
max2860.000-2774.000=86.000
mean7.932-8.778=-0.846
σ0.316-0.143=0.173
min7.693-8.613=-0.919
max8.480-8.998=-0.518
iters=5
new-facts=6402
prior-facts=6402
mean4945.117-4945.044=0.073
σ0.024-0.163=-0.138
min4945.087-4944.754=0.332
max4945.150-4945.129=0.021
mean3052.800-3046.200=6.600
σ269.777-232.357=37.420
min2860.000-2774.000=86.000
max3481.000-3328.000=153.000
mean8.608-8.553=0.055
σ0.348-0.151=0.197
min8.306-8.378=-0.072
max9.182-8.770=0.411

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.016-1.026=-0.010
σ0.143-0.137=0.007
min0.911-0.936=-0.025
max1.248-1.246=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.066-473.068=-0.002
σ575.913-575.940=-0.027
min185.106-185.095=0.011
max1336.936-1336.978=-0.042
mean88.250
σ8.500
min84.000
max101.000
mean2860.000-2774.000=86.000
σ0.000
min2860.000-2774.000=86.000
max2860.000-2774.000=86.000
mean0.449-0.489=-0.040
σ0.298-0.394=-0.096
min0.298-0.288=0.010
max0.896-1.079=-0.183
policies=20
mean1851.430-1851.271=0.158
σ0.367-0.373=-0.005
min1851.159-1851.011=0.148
max1851.963-1851.821=0.141
mean840.000
σ0.000
min840.000
max840.000
mean2860.000-2774.000=86.000
σ0.000
min2860.000-2774.000=86.000
max2860.000-2774.000=86.000
mean2.955-2.896=0.058
σ0.018-0.040=-0.022
min2.941-2.852=0.090
max2.980-2.945=0.036
policies=200
mean18519.845-18519.288=0.557
σ0.653-0.072=0.581
min18519.290-18519.215=0.075
max18520.575-18519.381=1.195
mean8400.000
σ0.000
min8400.000
max8400.000
mean2860.000-2774.000=86.000
σ0.000
min2860.000-2774.000=86.000
max2860.000-2774.000=86.000
mean29.103-28.810=0.292
σ0.456-0.048=0.408
min28.806-28.755=0.051
max29.772-28.862=0.911