Compare commits

Home / Compare a50edefe .. bf83dcde

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.565=-0.002
σ0.044-0.045=-0.001
min70.539-70.540=-0.002
max70.686-70.689=-0.003
mean413.000-413.400=-0.400
σ0.000-0.516=-0.516
min413.000
max413.000-414.000=-1.000
mean0.158-0.157=0.001
σ0.005-0.006=-0.001
min0.149-0.151=-0.002
max0.165-0.169=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.291-21.288=0.003
σ0.010-0.002=0.007
min21.284-21.284=0.000
max21.318-21.291=0.026
mean413.800-414.000=-0.200
σ0.422-0.000=0.422
min413.000-414.000=-1.000
max414.000
mean0.063-0.065=-0.001
σ0.003-0.003=0.000
min0.058-0.063=-0.005
max0.066-0.072=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.566-1753.568=-0.002
σ0.362-0.359=0.002
min1752.994-1752.999=-0.005
max1754.131-1754.154=-0.023
mean1653.800-1666.800=-13.000
σ622.823-647.044=-24.220
min625.000-688.000=-63.000
max2845.000-2774.000=71.000
mean2.750-2.810=-0.060
σ0.184-0.151=0.033
min2.307-2.445=-0.138
max3.043-2.977=0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.012-272.014=-0.001
σ0.008-0.007=0.000
min272.002-272.002=0.000
max272.021-272.022=-0.002
mean2845.000-2774.000=71.000
σ0.000
min2845.000-2774.000=71.000
max2845.000-2774.000=71.000
mean0.382-0.390=-0.008
σ0.008-0.011=-0.002
min0.376-0.378=-0.002
max0.396-0.403=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.434-1932.437=-0.003
σ0.003-0.013=-0.010
min1932.429-1932.413=0.015
max1932.437-1932.445=-0.008
mean2845.000-2774.000=71.000
σ0.000
min2845.000-2774.000=71.000
max2845.000-2774.000=71.000
mean3.016-3.028=-0.012
σ0.057-0.066=-0.009
min2.946-2.965=-0.019
max3.087-3.124=-0.037
iters=5
new-facts=6402
prior-facts=1
mean4753.066-4752.941=0.125
σ0.581-0.701=-0.120
min4752.686-4752.222=0.464
max4754.098-4754.115=-0.017
mean2845.000-2774.000=71.000
σ0.000
min2845.000-2774.000=71.000
max2845.000-2774.000=71.000
mean8.509-8.559=-0.050
σ0.233-0.043=0.190
min8.249-8.494=-0.246
max8.873-8.608=0.264
iters=5
new-facts=6402
prior-facts=6402
mean4943.627-4943.634=-0.007
σ0.020-0.018=0.002
min4943.609-4943.618=-0.009
max4943.650-4943.655=-0.005
mean3052.800-3027.800=25.000
σ217.173-233.821=-16.648
min2845.000-2774.000=71.000
max3364.000-3327.000=37.000
mean8.573-8.680=-0.106
σ0.147-0.223=-0.076
min8.402-8.413=-0.012
max8.770-8.867=-0.097

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.072-1.082=-0.010
σ0.111-0.110=0.002
min0.929-0.942=-0.013
max1.241-1.250=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-473.093=-0.013
σ575.915-575.946=-0.032
min185.116-185.108=0.008
max1336.953-1337.013=-0.060
mean88.250
σ8.500
min84.000
max101.000
mean2845.000-2774.000=71.000
σ0.000
min2845.000-2774.000=71.000
max2845.000-2774.000=71.000
mean0.485-0.563=-0.078
σ0.375-0.545=-0.170
min0.294-0.287=0.007
max1.048-1.380=-0.332
policies=20
mean1851.439-1851.427=0.012
σ0.361-0.371=-0.010
min1851.180-1851.175=0.005
max1851.965-1851.975=-0.010
mean840.000
σ0.000
min840.000
max840.000
mean2845.000-2774.000=71.000
σ0.000
min2845.000-2774.000=71.000
max2845.000-2774.000=71.000
mean2.942-2.875=0.066
σ0.004-0.039=-0.035
min2.936-2.849=0.087
max2.946-2.932=0.014
policies=200
mean18521.058-18520.855=0.203
σ0.426-0.497=-0.071
min18520.807-18520.499=0.308
max18521.693-18521.571=0.122
mean8400.000
σ0.000
min8400.000
max8400.000
mean2845.000-2774.000=71.000
σ0.000
min2845.000-2774.000=71.000
max2845.000-2774.000=71.000
mean29.085-28.737=0.349
σ0.532-0.012=0.520
min28.529-28.723=-0.195
max29.632-28.748=0.884