Compare commits

Home / Compare 5da3f8c3 .. c6d5bd9d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.001
σ0.052-0.054=-0.002
min35.592-35.588=0.004
max35.765-35.772=-0.006
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.085=-0.000
σ0.004-0.003=0.000
min0.081-0.082=-0.001
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-24.048=0.000
σ0.003-0.004=-0.000
min24.040-24.043=-0.003
max24.051-24.053=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.068-0.066=0.002
σ0.003-0.005=-0.002
min0.066-0.062=0.004
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.490=-0.001
σ0.365-0.364=0.001
min1755.915-1755.914=0.002
max1757.075-1757.076=-0.001
mean1652.200-1653.300=-1.100
σ644.668-646.932=-2.264
min649.000
max2840.000-2844.000=-4.000
mean2.352-2.353=-0.001
σ0.080-0.126=-0.046
min2.267-2.155=0.111
max2.533-2.714=-0.181

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.761-324.768=-0.007
σ0.043-0.047=-0.004
min324.684-324.685=-0.000
max324.790-324.801=-0.011
mean2840.000-2844.000=-4.000
σ0.000
min2840.000-2844.000=-4.000
max2840.000-2844.000=-4.000
mean0.417-0.423=-0.006
σ0.002-0.000=0.001
min0.416-0.423=-0.007
max0.420-0.424=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.313=0.000
σ0.015-0.015=0.001
min1985.292-1985.302=-0.010
max1985.334-1985.331=0.003
mean2840.000-2844.000=-4.000
σ0.000
min2840.000-2844.000=-4.000
max2840.000-2844.000=-4.000
mean2.636-2.620=0.016
σ0.129-0.187=-0.058
min2.515-2.373=0.143
max2.817-2.835=-0.018
iters=5
new-facts=6402
prior-facts=1
mean4809.111-4809.084=0.026
σ7.773-7.685=0.088
min4805.604-4805.629=-0.025
max4823.016-4822.832=0.184
mean2840.000-2844.000=-4.000
σ0.000
min2840.000-2844.000=-4.000
max2840.000-2844.000=-4.000
mean9.162-8.926=0.236
σ0.341-0.119=0.221
min8.925-8.727=0.198
max9.755-9.019=0.736
iters=5
new-facts=6402
prior-facts=6402
mean4996.552-4996.616=-0.064
σ0.151-0.018=0.133
min4996.285-4996.595=-0.311
max4996.646-4996.643=0.003
mean3047.600-3071.800=-24.200
σ270.853-302.521=-31.668
min2840.000-2844.000=-4.000
max3465.000-3541.000=-76.000
mean8.503-8.528=-0.025
σ0.114-0.135=-0.022
min8.444-8.410=0.034
max8.705-8.724=-0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-0.984=-0.004
σ0.068-0.137=-0.069
min0.924-0.917=0.007
max1.056-1.229=-0.173

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.211=-0.006
σ574.774-574.775=-0.001
min175.808-175.817=-0.009
max1325.366-1325.373=-0.007
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2844.000=-4.000
σ0.000
min2840.000-2844.000=-4.000
max2840.000-2844.000=-4.000
mean0.430-0.428=0.002
σ0.299-0.299=-0.001
min0.278-0.274=0.004
max0.878-0.877=0.001
policies=20
mean1758.488-1758.524=-0.036
σ0.353-0.345=0.008
min1758.241-1758.287=-0.047
max1759.009-1759.035=-0.025
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2844.000=-4.000
σ0.000
min2840.000-2844.000=-4.000
max2840.000-2844.000=-4.000
mean2.788-2.792=-0.004
σ0.005-0.005=0.001
min2.781-2.787=-0.007
max2.792-2.798=-0.005
policies=200
mean17591.980-17592.145=-0.166
σ0.432-0.450=-0.018
min17591.725-17591.899=-0.175
max17592.626-17592.820=-0.194
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2844.000=-4.000
σ0.000
min2840.000-2844.000=-4.000
max2840.000-2844.000=-4.000
mean27.908-27.901=0.007
σ0.376-0.424=-0.048
min27.527-27.436=0.091
max28.323-28.429=-0.105