Compare commits

Home / Compare 2ff4d0cb .. 0ff2c61a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.913-53.915=-0.001
σ0.368-0.368=0.000
min53.780-53.787=-0.008
max54.960-54.960=0.000
mean418.100-414.000=4.100
σ0.316-0.000=0.316
min418.000-414.000=4.000
max419.000-414.000=5.000
mean0.138-0.139=-0.001
σ0.006-0.004=0.002
min0.129-0.133=-0.004
max0.147-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.140-43.144=-0.004
σ0.006-0.011=-0.005
min43.130-43.131=-0.002
max43.149-43.170=-0.021
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.119-0.120=-0.002
σ0.004-0.003=0.001
min0.114-0.118=-0.004
max0.125-0.127=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.082-992.069=0.013
σ1.232-1.217=0.015
min991.499-991.519=-0.020
max997.254-997.189=0.065
mean1070.950-1055.450=15.500
σ319.091-313.861=5.229
min605.000-602.000=3.000
max1641.000-1525.000=116.000
mean1.534-1.559=-0.025
σ0.072-0.107=-0.035
min1.472-1.375=0.096
max1.763-1.742=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.676-285.679=-0.003
σ0.013-0.014=-0.001
min285.658-285.656=0.002
max285.692-285.690=0.001
mean1641.000-1525.000=116.000
σ0.000
min1641.000-1525.000=116.000
max1641.000-1525.000=116.000
mean0.377-0.382=-0.005
σ0.001-0.011=-0.009
min0.375-0.373=0.003
max0.378-0.394=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1285.641-1285.636=0.005
σ0.133-0.123=0.009
min1285.573-1285.573=-0.000
max1285.878-1285.856=0.022
mean1641.000-1525.000=116.000
σ0.000
min1641.000-1525.000=116.000
max1641.000-1525.000=116.000
mean1.943-1.925=0.018
σ0.135-0.127=0.008
min1.872-1.853=0.019
max2.184-2.150=0.034
iters=5
new-facts=6402
prior-facts=1
mean1807.959-1807.961=-0.002
σ7.013-7.025=-0.012
min1804.615-1804.598=0.018
max1820.489-1820.514=-0.025
mean1641.000-1525.000=116.000
σ0.000
min1641.000-1525.000=116.000
max1641.000-1525.000=116.000
mean4.139-4.158=-0.019
σ0.151-0.211=-0.060
min3.990-3.980=0.010
max4.341-4.392=-0.050
iters=5
new-facts=6402
prior-facts=6402
mean2070.471-2070.463=0.008
σ0.010-0.010=0.000
min2070.458-2070.450=0.007
max2070.486-2070.478=0.008
mean1844.600-1826.400=18.200
σ176.761-183.021=-6.261
min1641.000-1602.000=39.000
max2080.000-2067.000=13.000
mean4.564-4.540=0.024
σ0.053-0.079=-0.026
min4.501-4.446=0.055
max4.640-4.632=0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.109-1.594=-0.485
σ0.209-0.271=-0.061
min0.916-1.153=-0.237
max1.399-1.801=-0.402

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.381-437.372=0.009
σ572.347-572.349=-0.003
min151.199-151.191=0.008
max1295.901-1295.896=0.005
mean90.250
σ8.500
min86.000
max103.000
mean1641.000-1525.000=116.000
σ0.000
min1641.000-1525.000=116.000
max1641.000-1525.000=116.000
mean0.523-0.515=0.008
σ0.520-0.508=0.012
min0.252-0.260=-0.008
max1.302-1.276=0.026
policies=20
mean1512.217-1512.195=0.022
σ0.247-0.257=-0.010
min1512.060-1512.021=0.039
max1512.585-1512.577=0.008
mean860.000
σ0.000
min860.000
max860.000
mean1641.000-1525.000=116.000
σ0.000
min1641.000-1525.000=116.000
max1641.000-1525.000=116.000
mean2.540-2.538=0.002
σ0.019-0.006=0.013
min2.514-2.531=-0.018
max2.556-2.546=0.010
policies=200
mean15129.589-15129.476=0.113
σ0.174-0.138=0.036
min15129.419-15129.347=0.072
max15129.811-15129.672=0.139
mean8600.000
σ0.000
min8600.000
max8600.000
mean1641.000-1525.000=116.000
σ0.000
min1641.000-1525.000=116.000
max1641.000-1525.000=116.000
mean25.641-25.604=0.037
σ0.092-0.152=-0.060
min25.547-25.495=0.051
max25.765-25.829=-0.064