Compare commits

Home / Compare 2daa1394 .. 423f248d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.979-35.977=0.002
σ0.099-0.104=-0.006
min35.931-35.929=0.002
max36.258-36.273=-0.015
mean3957.000-3715.000=242.000
σ0.000
min3957.000-3715.000=242.000
max3957.000-3715.000=242.000
mean0.077-0.074=0.003
σ0.002-0.002=-0.000
min0.075-0.072=0.003
max0.081-0.080=0.001
cache=y
dps=1
iters=10
policies=100
mean26.206-26.209=-0.003
σ0.004-0.009=-0.006
min26.200-26.200=0.000
max26.212-26.233=-0.021
mean3957.000-3715.000=242.000
σ0.000
min3957.000-3715.000=242.000
max3957.000-3715.000=242.000
mean0.061-0.059=0.002
σ0.001-0.002=-0.001
min0.059-0.054=0.005
max0.062-0.064=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.358-1756.357=0.001
σ0.373-0.373=0.000
min1755.781-1755.784=-0.003
max1756.961-1756.962=-0.000
mean1653.550-1631.750=21.800
σ627.262-624.392=2.870
min680.000-622.000=58.000
max2603.000-2816.000=-213.000
mean2.248-2.242=0.005
σ0.123-0.084=0.039
min2.135-2.132=0.003
max2.681-2.376=0.305

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.674-278.676=-0.002
σ0.013-0.012=0.000
min278.666-278.661=0.005
max278.696-278.692=0.004
mean2603.000-2816.000=-213.000
σ0.000
min2603.000-2816.000=-213.000
max2603.000-2816.000=-213.000
mean0.424-0.422=0.002
σ0.009-0.010=-0.001
min0.419-0.416=0.003
max0.440-0.440=0.000
iters=5
new-facts=1
prior-facts=6402
mean2268.848-2268.845=0.003
σ0.005-0.010=-0.005
min2268.843-2268.830=0.013
max2268.857-2268.855=0.002
mean2603.000-2816.000=-213.000
σ0.000
min2603.000-2816.000=-213.000
max2603.000-2816.000=-213.000
mean2.937-3.148=-0.211
σ0.053-0.225=-0.172
min2.885-2.791=0.095
max3.009-3.349=-0.340
iters=5
new-facts=6402
prior-facts=1
mean4952.194-4952.203=-0.009
σ0.633-0.766=-0.133
min4951.826-4951.816=0.010
max4953.318-4953.571=-0.253
mean2603.000-2816.000=-213.000
σ0.000
min2603.000-2816.000=-213.000
max2603.000-2816.000=-213.000
mean8.074-7.730=0.344
σ0.380-0.148=0.232
min7.722-7.586=0.136
max8.518-7.915=0.604
iters=5
new-facts=6402
prior-facts=6402
mean5167.053-5166.891=0.162
σ0.011-0.022=-0.012
min5167.044-5166.868=0.176
max5167.065-5166.915=0.150
mean3352.400-3335.800=16.600
σ452.789-389.056=63.733
min2756.000-2938.000=-182.000
max3957.000-3715.000=242.000
mean9.495-8.758=0.737
σ0.412-0.337=0.075
min9.072-8.459=0.613
max10.110-9.133=0.977

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.112-1.468=-0.356
σ0.083-0.240=-0.156
min1.066-1.166=-0.100
max1.261-1.783=-0.522

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.255-460.254=0.001
σ572.607-572.608=-0.000
min173.950-173.950=0.000
max1319.166-1319.166=0.000
mean79.500
σ7.000
min76.000
max90.000
mean437.000
σ0.000
min437.000
max437.000
mean0.560-0.567=-0.007
σ0.573-0.582=-0.009
min0.268-0.268=0.000
max1.419-1.440=-0.020
policies=20
mean1740.008-1740.007=0.001
σ0.344-0.339=0.005
min1739.770-1739.762=0.008
max1740.517-1740.505=0.013
mean760.000
σ0.000
min760.000
max760.000
mean446.250
σ9.032
min437.000
max454.000
mean2.713-2.672=0.041
σ0.060-0.015=0.045
min2.651-2.656=-0.005
max2.779-2.690=0.089
policies=200
mean17409.258-17409.205=0.053
σ0.151-0.126=0.025
min17409.078-17409.039=0.039
max17409.392-17409.327=0.065
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.250-488.000=3.250
σ2.062-0.000=2.062
min489.000-488.000=1.000
max493.000-488.000=5.000
mean26.997-26.874=0.124
σ0.123-0.098=0.025
min26.901-26.761=0.140
max27.160-26.991=0.169