Compare commits

Home / Compare 9210334a .. bcc5b0a1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.310-35.308=0.001
σ0.052-0.054=-0.002
min35.284-35.278=0.006
max35.456-35.460=-0.003
mean414.700-416.000=-1.300
σ0.483-0.000=0.483
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.086-0.083=0.003
σ0.004-0.006=-0.002
min0.083-0.077=0.007
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean23.815-23.814=0.001
σ0.003-0.003=0.001
min23.812-23.810=0.002
max23.822-23.818=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.069-0.066=0.002
σ0.003-0.004=-0.001
min0.066-0.062=0.004
max0.075-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.473-1756.472=0.001
σ0.364-0.365=-0.001
min1755.897-1755.897=-0.000
max1757.056-1757.060=-0.003
mean1651.900-1629.800=22.100
σ642.063-592.991=49.072
min627.000-654.000=-27.000
max2840.000-2427.000=413.000
mean2.375-2.378=-0.003
σ0.097-0.080=0.018
min2.279-2.227=0.052
max2.636-2.533=0.103

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.734-324.729=0.005
σ0.041-0.055=-0.014
min324.662-324.631=0.030
max324.761-324.759=0.002
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean0.424-0.431=-0.007
σ0.001-0.010=-0.009
min0.423-0.423=-0.000
max0.425-0.447=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1985.287-1985.285=0.001
σ0.014-0.020=-0.007
min1985.265-1985.254=0.011
max1985.300-1985.302=-0.002
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean2.698-2.636=0.062
σ0.139-0.164=-0.026
min2.557-2.461=0.097
max2.861-2.901=-0.040
iters=5
new-facts=6402
prior-facts=1
mean4808.798-4668.164=140.635
σ7.716-307.152=-299.436
min4804.877-4118.714=686.163
max4822.591-4805.628=16.963
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean8.589-8.686=-0.096
σ0.439-0.480=-0.041
min7.818-7.961=-0.143
max8.907-9.171=-0.264
iters=5
new-facts=6402
prior-facts=6402
mean4996.418-4996.491=-0.073
σ0.158-0.017=0.140
min4996.137-4996.471=-0.335
max4996.505-4996.513=-0.008
mean3076.400-2863.800=212.600
σ311.436-294.206=17.230
min2840.000-2427.000=413.000
max3555.000-3225.000=330.000
mean8.493-8.564=-0.071
σ0.135-0.127=0.008
min8.334-8.424=-0.090
max8.706-8.700=0.006

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.952-1.641=-0.689
σ0.061-0.099=-0.038
min0.907-1.542=-0.635
max1.058-1.766=-0.708

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.952-462.925=0.027
σ574.253-574.247=0.006
min175.812-175.798=0.014
max1324.332-1324.295=0.036
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean0.469-0.547=-0.078
σ0.375-0.548=-0.173
min0.278-0.273=0.006
max1.031-1.369=-0.337
policies=20
mean1758.483-1758.268=0.214
σ0.351-0.333=0.018
min1758.243-1758.057=0.186
max1759.003-1758.763=0.240
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean2.780-2.723=0.057
σ0.010-0.009=0.000
min2.771-2.711=0.060
max2.794-2.733=0.061
policies=200
mean17591.176-17590.113=1.063
σ0.641-0.695=-0.055
min17590.414-17589.450=0.964
max17591.743-17591.085=0.658
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean27.909-27.533=0.376
σ0.307-0.205=0.102
min27.556-27.358=0.199
max28.246-27.767=0.478