Compare commits

Home / Compare 9f1670b2 .. 87d48c2a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.619-35.308=0.310
σ0.054-0.054=0.001
min35.592-35.278=0.314
max35.772-35.460=0.313
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.086-0.083=0.003
σ0.003-0.006=-0.002
min0.083-0.077=0.007
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean24.046-23.814=0.232
σ0.003-0.003=0.000
min24.042-23.810=0.232
max24.053-23.818=0.234
mean413.600-416.000=-2.400
σ0.516-0.000=0.516
min413.000-416.000=-3.000
max414.000-416.000=-2.000
mean0.066-0.066=-0.001
σ0.005-0.004=0.001
min0.062-0.062=-0.000
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.472=0.019
σ0.364-0.365=-0.001
min1755.918-1755.897=0.021
max1757.082-1757.060=0.023
mean1654.150-1629.800=24.350
σ637.067-592.991=44.076
min689.000-654.000=35.000
max2840.000-2427.000=413.000
mean2.346-2.378=-0.033
σ0.083-0.080=0.003
min2.204-2.227=-0.023
max2.503-2.533=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.761-324.729=0.033
σ0.055-0.055=0.000
min324.664-324.631=0.033
max324.797-324.759=0.038
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean0.425-0.431=-0.006
σ0.003-0.010=-0.007
min0.423-0.423=-0.000
max0.430-0.447=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.319-1985.285=0.034
σ0.017-0.020=-0.003
min1985.298-1985.254=0.044
max1985.338-1985.302=0.035
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean2.731-2.636=0.094
σ0.108-0.164=-0.057
min2.616-2.461=0.155
max2.834-2.901=-0.067
iters=5
new-facts=6402
prior-facts=1
mean4808.855-4668.164=140.692
σ7.788-307.152=-299.364
min4804.898-4118.714=686.184
max4822.776-4805.628=17.148
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean8.711-8.686=0.025
σ0.613-0.480=0.133
min7.744-7.961=-0.217
max9.295-9.171=0.124
iters=5
new-facts=6402
prior-facts=6402
mean4996.457-4996.491=-0.034
σ0.171-0.017=0.153
min4996.152-4996.471=-0.319
max4996.549-4996.513=0.036
mean3050.200-2863.800=186.400
σ273.042-294.206=-21.164
min2840.000-2427.000=413.000
max3471.000-3225.000=246.000
mean8.574-8.564=0.010
σ0.108-0.127=-0.019
min8.506-8.424=0.082
max8.758-8.700=0.059

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.943-1.641=-0.698
σ0.061-0.099=-0.038
min0.901-1.542=-0.642
max1.050-1.766=-0.716

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.948-462.925=0.024
σ574.248-574.247=0.001
min175.818-175.798=0.020
max1324.321-1324.295=0.026
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean0.434-0.547=-0.113
σ0.301-0.548=-0.247
min0.284-0.273=0.011
max0.885-1.369=-0.483
policies=20
mean1758.502-1758.268=0.234
σ0.337-0.333=0.005
min1758.289-1758.057=0.232
max1759.004-1758.763=0.241
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean2.794-2.723=0.071
σ0.009-0.009=-0.000
min2.784-2.711=0.073
max2.803-2.733=0.070
policies=200
mean17592.056-17590.113=1.943
σ0.484-0.695=-0.212
min17591.694-17589.450=2.243
max17592.767-17591.085=1.681
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2427.000=413.000
σ0.000
min2840.000-2427.000=413.000
max2840.000-2427.000=413.000
mean27.820-27.533=0.287
σ0.335-0.205=0.129
min27.452-27.358=0.094
max28.197-27.767=0.429