Compare commits

Home / Compare c8d04a47 .. 1d20143a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.726-36.727=-0.001
σ0.685-0.616=0.069
min35.925-35.918=0.007
max37.523-37.223=0.300
mean4009.000-4144.000=-135.000
σ0.000
min4009.000-4144.000=-135.000
max4009.000-4144.000=-135.000
mean0.075-0.075=0.000
σ0.001-0.001=0.000
min0.074-0.074=-0.000
max0.076-0.076=0.000
cache=y
dps=1
iters=10
policies=100
mean26.711-26.711=-0.000
σ0.645-0.645=0.001
min26.206-26.206=-0.001
max27.466-27.465=0.001
mean4009.000-4144.000=-135.000
σ0.000
min4009.000-4144.000=-135.000
max4009.000-4144.000=-135.000
mean0.060-0.060=-0.000
σ0.001-0.001=0.000
min0.059-0.059=-0.000
max0.061-0.061=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.357-1756.358=-0.001
σ0.373-0.373=0.001
min1755.790-1755.781=0.009
max1756.956-1756.973=-0.017
mean1654.800-1650.350=4.450
σ627.590-632.471=-4.881
min681.000-619.000=62.000
max2604.000-2591.000=13.000
mean2.272-2.280=-0.008
σ0.107-0.167=-0.059
min2.137-2.105=0.032
max2.549-2.704=-0.155

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.674-278.676=-0.001
σ0.007-0.011=-0.005
min278.666-278.665=0.001
max278.682-278.694=-0.012
mean2604.000-2591.000=13.000
σ0.000
min2604.000-2591.000=13.000
max2604.000-2591.000=13.000
mean0.418-0.420=-0.002
σ0.001-0.006=-0.005
min0.417-0.415=0.002
max0.419-0.431=-0.011
iters=5
new-facts=1
prior-facts=6402
mean2268.845-2268.846=-0.001
σ0.004-0.004=-0.000
min2268.839-2268.840=-0.001
max2268.849-2268.851=-0.002
mean2604.000-2591.000=13.000
σ0.000
min2604.000-2591.000=13.000
max2604.000-2591.000=13.000
mean2.934-3.120=-0.186
σ0.069-0.176=-0.107
min2.863-2.923=-0.060
max3.046-3.337=-0.292
iters=5
new-facts=6402
prior-facts=1
mean4952.299-4952.300=-0.002
σ0.881-0.844=0.037
min4951.754-4951.859=-0.105
max4953.863-4953.807=0.056
mean2604.000-2591.000=13.000
σ0.000
min2604.000-2591.000=13.000
max2604.000-2591.000=13.000
mean8.217-8.075=0.142
σ0.481-0.310=0.170
min7.847-7.764=0.083
max8.932-8.421=0.511
iters=5
new-facts=6402
prior-facts=6402
mean5167.055-5166.916=0.139
σ0.010-0.322=-0.312
min5167.047-5166.340=0.706
max5167.072-5167.085=-0.013
mean3403.600-3435.200=-31.600
σ479.802-489.734=-9.932
min2746.000-2855.000=-109.000
max4009.000-4144.000=-135.000
mean9.201-9.306=-0.106
σ0.186-0.535=-0.349
min8.970-8.748=0.223
max9.418-10.066=-0.648

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.034-1.074=-0.040
σ0.135-0.110=0.026
min0.940-0.933=0.007
max1.256-1.241=0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.253-460.254=-0.002
σ572.608-572.608=0.000
min173.947-173.949=-0.002
max1319.165-1319.166=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.537-0.535=0.002
σ0.524-0.526=-0.002
min0.273-0.267=0.006
max1.322-1.324=-0.001
policies=20
mean1740.000-1739.997=0.004
σ0.336-0.321=0.015
min1739.758-1739.768=-0.011
max1740.493-1740.468=0.025
mean760.000
σ0.000
min760.000
max760.000
mean445.000-447.500=-2.500
σ9.381-9.950=-0.569
min435.000-437.000=-2.000
max453.000-456.000=-3.000
mean2.669-2.646=0.023
σ0.007-0.013=-0.006
min2.662-2.629=0.034
max2.677-2.661=0.016
policies=200
mean17409.265-17409.337=-0.071
σ0.053-0.048=0.005
min17409.224-17409.297=-0.073
max17409.343-17409.403=-0.060
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.250-490.500=-0.250
σ3.096-1.732=1.364
min486.000-489.000=-3.000
max493.000
mean26.924-26.830=0.094
σ0.138-0.105=0.033
min26.781-26.732=0.049
max27.113-26.979=0.133