Compare commits

Home / Compare 2dc5fbb6 .. 651457d1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.001
σ0.056-0.052=0.003
min35.587-35.592=-0.005
max35.775-35.765=0.010
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.085-0.085=0.000
σ0.003-0.004=-0.000
min0.082-0.081=0.001
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.002-0.003=-0.001
min24.044-24.040=0.004
max24.049-24.051=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.069-0.068=0.001
σ0.004-0.003=0.001
min0.066-0.066=0.001
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.489=-0.000
σ0.364-0.365=-0.000
min1755.915-1755.915=-0.001
max1757.075-1757.075=0.000
mean1655.850-1652.200=3.650
σ644.014-644.668=-0.654
min635.000-649.000=-14.000
max2843.000-2840.000=3.000
mean2.332-2.352=-0.020
σ0.063-0.080=-0.017
min2.254-2.267=-0.013
max2.466-2.533=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.738-324.761=-0.022
σ0.043-0.043=-0.001
min324.662-324.684=-0.022
max324.763-324.790=-0.027
mean2843.000-2840.000=3.000
σ0.000
min2843.000-2840.000=3.000
max2843.000-2840.000=3.000
mean0.426-0.417=0.009
σ0.005-0.002=0.003
min0.423-0.416=0.007
max0.434-0.420=0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.322-1985.313=0.009
σ0.014-0.015=-0.002
min1985.300-1985.292=0.008
max1985.335-1985.334=0.001
mean2843.000-2840.000=3.000
σ0.000
min2843.000-2840.000=3.000
max2843.000-2840.000=3.000
mean2.672-2.636=0.036
σ0.132-0.129=0.002
min2.520-2.515=0.005
max2.872-2.817=0.054
iters=5
new-facts=6402
prior-facts=1
mean4809.089-4809.111=-0.022
σ7.736-7.773=-0.037
min4805.605-4805.604=0.001
max4822.928-4823.016=-0.088
mean2843.000-2840.000=3.000
σ0.000
min2843.000-2840.000=3.000
max2843.000-2840.000=3.000
mean8.969-9.162=-0.193
σ0.487-0.341=0.147
min8.245-8.925=-0.680
max9.565-9.755=-0.190
iters=5
new-facts=6402
prior-facts=6402
mean4996.566-4996.552=0.014
σ0.181-0.151=0.030
min4996.247-4996.285=-0.038
max4996.674-4996.646=0.028
mean3086.000-3047.600=38.400
σ259.533-270.853=-11.320
min2843.000-2840.000=3.000
max3358.000-3465.000=-107.000
mean9.158-8.503=0.655
σ0.551-0.114=0.437
min8.528-8.444=0.084
max9.899-8.705=1.194

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-0.981=0.087
σ0.264-0.068=0.196
min0.916-0.924=-0.007
max1.529-1.056=0.472

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.219-463.205=0.014
σ574.771-574.774=-0.003
min175.821-175.808=0.013
max1325.376-1325.366=0.010
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2840.000=3.000
σ0.000
min2843.000-2840.000=3.000
max2843.000-2840.000=3.000
mean0.421-0.430=-0.009
σ0.284-0.299=-0.015
min0.273-0.278=-0.004
max0.846-0.878=-0.032
policies=20
mean1758.533-1758.488=0.045
σ0.366-0.353=0.013
min1758.284-1758.241=0.043
max1759.075-1759.009=0.066
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2840.000=3.000
σ0.000
min2843.000-2840.000=3.000
max2843.000-2840.000=3.000
mean2.786-2.788=-0.003
σ0.012-0.005=0.006
min2.771-2.781=-0.009
max2.798-2.792=0.006
policies=200
mean17592.089-17591.980=0.109
σ0.498-0.432=0.066
min17591.686-17591.725=-0.038
max17592.805-17592.626=0.179
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2840.000=3.000
σ0.000
min2843.000-2840.000=3.000
max2843.000-2840.000=3.000
mean27.794-27.908=-0.114
σ0.317-0.376=-0.059
min27.446-27.527=-0.081
max28.168-28.323=-0.156