Compare commits

Home / Compare ba9d5a3c .. f5561567

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.730=0.002
σ0.050-0.047=0.003
min70.701-70.702=-0.001
max70.872-70.862=0.009
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.167-0.160=0.007
σ0.011-0.003=0.008
min0.154-0.157=-0.003
max0.184-0.166=0.018
cache=y
dps=1
iters=10
policies=100
mean21.445-21.445=0.000
σ0.003-0.003=-0.000
min21.440-21.440=0.000
max21.448-21.450=-0.002
mean414.700-415.000=-0.300
σ0.483-0.000=0.483
min414.000-415.000=-1.000
max415.000
mean0.065-0.064=0.001
σ0.003-0.003=-0.000
min0.063-0.059=0.004
max0.072-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.528-1754.529=-0.001
σ0.360-0.361=-0.001
min1753.960-1753.960=0.000
max1755.126-1755.108=0.018
mean1654.000-1654.300=-0.300
σ632.102-639.885=-7.783
min640.000-639.000=1.000
max2846.000-2850.000=-4.000
mean2.837-2.869=-0.032
σ0.193-0.129=0.064
min2.301-2.608=-0.308
max3.220-3.157=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.610-273.608=0.002
σ0.009-0.006=0.003
min273.603-273.602=0.001
max273.622-273.617=0.005
mean2846.000-2850.000=-4.000
σ0.000
min2846.000-2850.000=-4.000
max2846.000-2850.000=-4.000
mean0.389-0.382=0.007
σ0.010-0.005=0.005
min0.380-0.379=0.001
max0.405-0.391=0.014
iters=5
new-facts=1
prior-facts=6402
mean1933.996-1934.002=-0.006
σ0.008-0.015=-0.008
min1933.986-1933.979=0.007
max1934.006-1934.017=-0.011
mean2846.000-2850.000=-4.000
σ0.000
min2846.000-2850.000=-4.000
max2846.000-2850.000=-4.000
mean3.007-3.051=-0.044
σ0.043-0.169=-0.126
min2.964-2.849=0.115
max3.076-3.299=-0.222
iters=5
new-facts=6402
prior-facts=1
mean4754.840-4754.799=0.042
σ0.814-0.816=-0.002
min4754.375-4754.320=0.056
max4756.292-4756.253=0.039
mean2846.000-2850.000=-4.000
σ0.000
min2846.000-2850.000=-4.000
max2846.000-2850.000=-4.000
mean8.135-8.285=-0.150
σ0.322-0.414=-0.092
min7.819-7.624=0.195
max8.653-8.755=-0.101
iters=5
new-facts=6402
prior-facts=6402
mean4945.221-4945.218=0.003
σ0.012-0.014=-0.002
min4945.205-4945.203=0.002
max4945.237-4945.239=-0.001
mean3076.000-3072.400=3.600
σ303.815-222.667=81.147
min2846.000-2850.000=-4.000
max3543.000-3370.000=173.000
mean8.470-8.794=-0.324
σ0.116-0.272=-0.156
min8.337-8.493=-0.156
max8.646-9.079=-0.433

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.035=0.017
σ0.124-0.155=-0.031
min0.935-0.926=0.009
max1.241-1.287=-0.046

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.844-472.840=0.004
σ574.926-574.926=-0.000
min185.375-185.374=0.001
max1335.233-1335.229=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2846.000-2850.000=-4.000
σ0.000
min2846.000-2850.000=-4.000
max2846.000-2850.000=-4.000
mean0.452-0.488=-0.036
σ0.305-0.381=-0.077
min0.297-0.293=0.005
max0.909-1.059=-0.151
policies=20
mean1854.005-1854.014=-0.010
σ0.378-0.380=-0.002
min1853.718-1853.726=-0.008
max1854.551-1854.564=-0.014
mean840.000
σ0.000
min840.000
max840.000
mean2846.000-2850.000=-4.000
σ0.000
min2846.000-2850.000=-4.000
max2846.000-2850.000=-4.000
mean2.962-2.953=0.009
σ0.018-0.009=0.009
min2.944-2.944=-0.001
max2.983-2.966=0.017
policies=200
mean18546.497-18546.713=-0.216
σ0.370-0.421=-0.051
min18546.205-18546.329=-0.124
max18547.037-18547.307=-0.271
mean8400.000
σ0.000
min8400.000
max8400.000
mean2846.000-2850.000=-4.000
σ0.000
min2846.000-2850.000=-4.000
max2846.000-2850.000=-4.000
mean29.254-29.183=0.071
σ0.522-0.534=-0.013
min28.770-28.723=0.047
max29.841-29.922=-0.081