Compare commits

Home / Compare ffbf4d6b .. ef80919a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.959-35.799=-4.840
σ0.049-0.107=-0.058
min30.919-35.752=-4.833
max31.095-36.102=-5.007
mean414.000
σ0.000
min414.000
max414.000
mean0.078-0.077=0.001
σ0.004-0.005=-0.001
min0.076-0.074=0.002
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-26.065=-5.005
σ0.002-0.004=-0.002
min21.057-26.060=-5.003
max21.063-26.071=-5.008
mean414.000
σ0.000
min414.000
max414.000
mean0.063-0.061=0.002
σ0.002-0.002=-0.000
min0.061-0.060=0.002
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1755.921=-4.510
σ0.361-0.366=-0.006
min1750.840-1755.343=-4.503
max1751.978-1756.516=-4.539
mean1641.850-1660.550=-18.700
σ619.032-626.166=-7.134
min651.000-673.000=-22.000
max2478.000-2663.000=-185.000
mean2.796-2.685=0.112
σ0.158-0.211=-0.052
min2.271-2.263=0.008
max2.959-2.955=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.403-274.828=-1.424
σ0.011-0.004=0.006
min273.395-274.823=-1.428
max273.418-274.834=-1.416
mean2478.000-2663.000=-185.000
σ0.000
min2478.000-2663.000=-185.000
max2478.000-2663.000=-185.000
mean0.387-0.391=-0.004
σ0.008-0.009=-0.001
min0.377-0.383=-0.007
max0.398-0.402=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.839-1940.003=-6.164
σ0.011-0.008=0.003
min1933.826-1939.994=-6.168
max1933.850-1940.011=-6.161
mean2478.000-2663.000=-185.000
σ0.000
min2478.000-2663.000=-185.000
max2478.000-2663.000=-185.000
mean2.913-3.053=-0.140
σ0.262-0.099=0.163
min2.471-2.956=-0.486
max3.118-3.196=-0.078
iters=5
new-facts=6402
prior-facts=1
mean4754.357-4758.853=-4.496
σ0.853-0.897=-0.044
min4753.735-4758.334=-4.599
max4755.859-4760.451=-4.592
mean2478.000-2663.000=-185.000
σ0.000
min2478.000-2663.000=-185.000
max2478.000-2663.000=-185.000
mean8.648-8.170=0.478
σ0.610-0.643=-0.033
min7.754-7.731=0.023
max9.465-9.294=0.171
iters=5
new-facts=6402
prior-facts=6402
mean4944.803-4953.979=-9.176
σ0.078-0.088=-0.010
min4944.737-4953.909=-9.172
max4944.888-4954.080=-9.192
mean3015.200-2976.800=38.400
σ359.008-354.721=4.287
min2533.000-2663.000=-130.000
max3348.000-3490.000=-142.000
mean8.873-8.478=0.395
σ0.390-0.133=0.257
min8.524-8.382=0.142
max9.422-8.707=0.715

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.705-1.204=0.501
σ0.137-0.325=-0.188
min1.590-0.943=0.646
max1.924-1.735=0.189

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.334-464.858=-1.523
σ572.196-572.658=-0.462
min177.233-178.525=-1.292
max1321.629-1323.845=-2.216
mean79.750-79.500=0.250
σ7.500-7.000=0.500
min76.000
max91.000-90.000=1.000
mean2478.000-2663.000=-185.000
σ0.000
min2478.000-2663.000=-185.000
max2478.000-2663.000=-185.000
mean0.558-0.568=-0.011
σ0.548-0.568=-0.020
min0.278-0.277=0.001
max1.380-1.420=-0.041
policies=20
mean1772.562-1785.492=-12.930
σ0.316-0.345=-0.029
min1772.357-1785.261=-12.904
max1773.032-1786.002=-12.970
mean760.000
σ0.000
min760.000
max760.000
mean2478.000-2663.000=-185.000
σ0.000
min2478.000-2663.000=-185.000
max2478.000-2663.000=-185.000
mean2.733-2.807=-0.074
σ0.014-0.035=-0.021
min2.713-2.768=-0.054
max2.744-2.851=-0.107
policies=200
mean17732.432-17861.388=-128.956
σ0.570-0.572=-0.002
min17732.058-17860.962=-128.904
max17733.269-17862.217=-128.948
mean7600.000
σ0.000
min7600.000
max7600.000
mean2478.000-2663.000=-185.000
σ0.000
min2478.000-2663.000=-185.000
max2478.000-2663.000=-185.000
mean27.692-28.247=-0.555
σ0.161-0.196=-0.035
min27.571-28.064=-0.492
max27.929-28.483=-0.554