Compare commits

Home / Compare ddb1024b .. 12bf96fb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=0.000
σ0.055-0.052=0.003
min35.587-35.592=-0.004
max35.773-35.765=0.008
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.084-0.085=-0.001
σ0.005-0.004=0.001
min0.078-0.081=-0.003
max0.092-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.003-0.003=-0.000
min24.043-24.040=0.003
max24.051-24.051=0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.068=-0.003
σ0.003-0.003=-0.000
min0.061-0.066=-0.004
max0.069-0.076=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.489=-0.000
σ0.365-0.365=-0.000
min1755.915-1755.915=-0.000
max1757.081-1757.075=0.006
mean1655.850-1652.200=3.650
σ641.870-644.668=-2.798
min623.000-649.000=-26.000
max2848.000-2840.000=8.000
mean2.354-2.352=0.002
σ0.068-0.080=-0.012
min2.266-2.267=-0.001
max2.507-2.533=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.761=0.001
σ0.056-0.043=0.012
min324.663-324.684=-0.021
max324.793-324.790=0.003
mean2848.000-2840.000=8.000
σ0.000
min2848.000-2840.000=8.000
max2848.000-2840.000=8.000
mean0.429-0.417=0.012
σ0.009-0.002=0.008
min0.424-0.416=0.008
max0.445-0.420=0.025
iters=5
new-facts=1
prior-facts=6402
mean1985.316-1985.313=0.003
σ0.015-0.015=-0.000
min1985.298-1985.292=0.006
max1985.332-1985.334=-0.002
mean2848.000-2840.000=8.000
σ0.000
min2848.000-2840.000=8.000
max2848.000-2840.000=8.000
mean2.658-2.636=0.021
σ0.105-0.129=-0.024
min2.567-2.515=0.052
max2.778-2.817=-0.040
iters=5
new-facts=6402
prior-facts=1
mean4809.000-4809.111=-0.110
σ7.774-7.773=0.001
min4805.014-4805.604=-0.589
max4822.897-4823.016=-0.119
mean2848.000-2840.000=8.000
σ0.000
min2848.000-2840.000=8.000
max2848.000-2840.000=8.000
mean8.795-9.162=-0.367
σ0.409-0.341=0.068
min8.075-8.925=-0.850
max9.056-9.755=-0.699
iters=5
new-facts=6402
prior-facts=6402
mean4996.489-4996.552=-0.063
σ0.192-0.151=0.041
min4996.256-4996.285=-0.028
max4996.647-4996.646=0.001
mean3067.000-3047.600=19.400
σ291.781-270.853=20.928
min2848.000-2840.000=8.000
max3517.000-3465.000=52.000
mean8.543-8.503=0.040
σ0.132-0.114=0.018
min8.465-8.444=0.021
max8.777-8.705=0.072

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.009-0.981=0.028
σ0.118-0.068=0.051
min0.928-0.924=0.005
max1.194-1.056=0.138

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.205=0.005
σ574.767-574.774=-0.007
min175.816-175.808=0.008
max1325.360-1325.366=-0.006
mean86.250
σ8.500
min82.000
max99.000
mean2848.000-2840.000=8.000
σ0.000
min2848.000-2840.000=8.000
max2848.000-2840.000=8.000
mean0.435-0.430=0.005
σ0.301-0.299=0.002
min0.283-0.278=0.006
max0.887-0.878=0.009
policies=20
mean1758.501-1758.488=0.013
σ0.352-0.353=-0.001
min1758.253-1758.241=0.012
max1759.020-1759.009=0.010
mean820.000
σ0.000
min820.000
max820.000
mean2848.000-2840.000=8.000
σ0.000
min2848.000-2840.000=8.000
max2848.000-2840.000=8.000
mean2.791-2.788=0.003
σ0.004-0.005=-0.002
min2.786-2.781=0.005
max2.795-2.792=0.003
policies=200
mean17592.131-17591.980=0.151
σ0.512-0.432=0.080
min17591.834-17591.725=0.109
max17592.897-17592.626=0.271
mean8200.000
σ0.000
min8200.000
max8200.000
mean2848.000-2840.000=8.000
σ0.000
min2848.000-2840.000=8.000
max2848.000-2840.000=8.000
mean28.030-27.908=0.121
σ0.376-0.376=-0.000
min27.662-27.527=0.135
max28.494-28.323=0.171