Compare commits

Home / Compare 4fc45a8a .. d7df35d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.728-36.728=-0.000
σ0.688-0.614=0.074
min35.922-35.921=0.001
max37.532-37.221=0.311
mean4016.000-4009.000=7.000
σ0.000
min4016.000-4009.000=7.000
max4016.000-4009.000=7.000
mean0.074-0.075=-0.001
σ0.000-0.001=-0.000
min0.073-0.073=0.000
max0.075-0.076=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.708-26.713=-0.005
σ0.574-0.646=-0.072
min26.211-26.208=0.003
max27.463-27.465=-0.002
mean4016.000-4009.000=7.000
σ0.000
min4016.000-4009.000=7.000
max4016.000-4009.000=7.000
mean0.060-0.060=-0.000
σ0.001-0.001=0.000
min0.059-0.059=-0.000
max0.061-0.061=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.378-1756.378=-0.000
σ0.372-0.376=-0.003
min1755.805-1755.805=0.001
max1756.984-1756.995=-0.011
mean1661.950-1670.300=-8.350
σ627.435-624.871=2.564
min688.000-661.000=27.000
max2611.000-2603.000=8.000
mean2.302-2.339=-0.036
σ0.180-0.198=-0.019
min2.144-2.172=-0.028
max2.786-2.822=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.719-278.717=0.002
σ0.005-0.006=-0.001
min278.711-278.710=0.001
max278.723-278.724=-0.000
mean2611.000-2603.000=8.000
σ0.000
min2611.000-2603.000=8.000
max2611.000-2603.000=8.000
mean0.419-0.419=-0.000
σ0.001-0.001=-0.000
min0.418-0.418=-0.000
max0.420-0.420=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2268.880-2268.888=-0.008
σ0.014-0.007=0.007
min2268.856-2268.877=-0.021
max2268.888-2268.894=-0.006
mean2611.000-2603.000=8.000
σ0.000
min2611.000-2603.000=8.000
max2611.000-2603.000=8.000
mean2.984-2.995=-0.011
σ0.134-0.184=-0.050
min2.895-2.805=0.090
max3.220-3.301=-0.082
iters=5
new-facts=6402
prior-facts=1
mean4952.259-4952.254=0.004
σ0.941-0.986=-0.045
min4951.407-4951.286=0.121
max4953.876-4953.923=-0.047
mean2611.000-2603.000=8.000
σ0.000
min2611.000-2603.000=8.000
max2611.000-2603.000=8.000
mean7.998-8.075=-0.077
σ0.173-0.285=-0.112
min7.797-7.831=-0.033
max8.250-8.540=-0.290
iters=5
new-facts=6402
prior-facts=6402
mean5167.095-5167.095=-0.000
σ0.011-0.009=0.002
min5167.083-5167.082=0.001
max5167.113-5167.105=0.008
mean3362.400-3353.400=9.000
σ448.654-449.576=-0.921
min2840.000-2831.000=9.000
max4016.000-4009.000=7.000
mean9.376-9.339=0.037
σ0.296-0.364=-0.069
min8.955-9.026=-0.070
max9.698-9.904=-0.206

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.113-1.057=0.056
σ0.077-0.125=-0.048
min1.072-0.938=0.134
max1.251-1.250=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.266-460.263=0.002
σ572.607-572.607=0.001
min173.961-173.959=0.002
max1319.177-1319.173=0.004
mean79.500
σ7.000
min76.000
max90.000
mean437.000-436.000=1.000
σ0.000
min437.000-436.000=1.000
max437.000-436.000=1.000
mean0.571-0.553=0.017
σ0.591-0.556=0.035
min0.271-0.270=0.001
max1.457-1.388=0.069
policies=20
mean1740.115-1740.095=0.020
σ0.334-0.325=0.009
min1739.876-1739.855=0.021
max1740.605-1740.571=0.034
mean760.000
σ0.000
min760.000
max760.000
mean448.250-444.750=3.500
σ10.308-8.461=1.847
min437.000-436.000=1.000
max457.000-452.000=5.000
mean2.666-2.670=-0.003
σ0.009-0.023=-0.014
min2.658-2.637=0.021
max2.678-2.689=-0.011
policies=200
mean17410.395-17410.237=0.158
σ0.076-0.073=0.003
min17410.330-17410.129=0.201
max17410.504-17410.289=0.215
mean7600.000
σ0.000
min7600.000
max7600.000
mean494.000-490.750=3.250
σ3.367-2.217=1.149
min490.000-488.000=2.000
max498.000-493.000=5.000
mean26.878-26.983=-0.105
σ0.089-0.069=0.020
min26.749-26.908=-0.160
max26.950-27.055=-0.105