Compare commits

Home / Compare 94f1d5de .. 8a5ad129

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.000
σ0.054-0.054=-0.000
min35.590-35.587=0.003
max35.770-35.770=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.086-0.086=0.000
σ0.004-0.004=0.000
min0.082-0.082=0.000
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.000
σ0.002-0.003=-0.001
min24.044-24.041=0.003
max24.050-24.052=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.068-0.067=0.002
σ0.003-0.003=0.000
min0.066-0.063=0.004
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.491=-0.001
σ0.365-0.365=-0.000
min1755.919-1755.915=0.004
max1757.078-1757.070=0.008
mean1652.700-1654.600=-1.900
σ628.766-642.845=-14.079
min621.000-624.000=-3.000
max2697.000-2794.000=-97.000
mean2.332-2.343=-0.011
σ0.119-0.110=0.009
min2.076-2.246=-0.170
max2.628-2.704=-0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.770-324.768=0.002
σ0.034-0.045=-0.011
min324.712-324.688=0.024
max324.803-324.790=0.013
mean2697.000-2794.000=-97.000
σ0.000
min2697.000-2794.000=-97.000
max2697.000-2794.000=-97.000
mean0.423-0.430=-0.007
σ0.001-0.010=-0.008
min0.422-0.420=0.002
max0.425-0.445=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1985.319-1985.322=-0.004
σ0.010-0.016=-0.006
min1985.308-1985.294=0.013
max1985.334-1985.334=0.000
mean2697.000-2794.000=-97.000
σ0.000
min2697.000-2794.000=-97.000
max2697.000-2794.000=-97.000
mean2.789-2.593=0.196
σ0.283-0.095=0.188
min2.589-2.508=0.081
max3.273-2.732=0.541
iters=5
new-facts=6402
prior-facts=1
mean4809.098-4809.088=0.010
σ7.667-7.731=-0.064
min4805.584-4805.609=-0.025
max4822.814-4822.918=-0.104
mean2697.000-2794.000=-97.000
σ0.000
min2697.000-2794.000=-97.000
max2697.000-2794.000=-97.000
mean8.990-9.030=-0.040
σ0.293-0.160=0.133
min8.745-8.886=-0.141
max9.474-9.277=0.198
iters=5
new-facts=6402
prior-facts=6402
mean4996.560-4996.554=0.006
σ0.155-0.146=0.009
min4996.286-4996.295=-0.009
max4996.655-4996.646=0.009
mean2988.800-3028.600=-39.800
σ331.400-292.161=39.239
min2697.000-2794.000=-97.000
max3483.000-3469.000=14.000
mean8.574-8.562=0.012
σ0.147-0.246=-0.099
min8.447-8.410=0.037
max8.735-8.991=-0.256

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.001-0.946=0.055
σ0.067-0.054=0.012
min0.918-0.917=0.001
max1.052-1.043=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.212-463.207=0.005
σ574.770-574.766=0.004
min175.818-175.819=-0.001
max1325.367-1325.357=0.010
mean86.250
σ8.500
min82.000
max99.000
mean2697.000-2794.000=-97.000
σ0.000
min2697.000-2794.000=-97.000
max2697.000-2794.000=-97.000
mean0.537-0.430=0.107
σ0.529-0.306=0.224
min0.271-0.276=-0.005
max1.331-0.889=0.442
policies=20
mean1758.479-1758.514=-0.035
σ0.335-0.360=-0.025
min1758.266-1758.311=-0.045
max1758.979-1759.052=-0.073
mean820.000
σ0.000
min820.000
max820.000
mean2697.000-2794.000=-97.000
σ0.000
min2697.000-2794.000=-97.000
max2697.000-2794.000=-97.000
mean2.725-2.822=-0.097
σ0.013-0.084=-0.070
min2.709-2.775=-0.066
max2.738-2.947=-0.210
policies=200
mean17591.925-17592.032=-0.107
σ0.516-0.634=-0.118
min17591.621-17591.583=0.037
max17592.695-17592.961=-0.266
mean8200.000
σ0.000
min8200.000
max8200.000
mean2697.000-2794.000=-97.000
σ0.000
min2697.000-2794.000=-97.000
max2697.000-2794.000=-97.000
mean27.425-27.351=0.074
σ0.140-0.164=-0.024
min27.272-27.204=0.068
max27.601-27.554=0.047