Compare commits

Home / Compare b56946d1 .. a19910f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.913-53.913=0.000
σ0.366-0.367=-0.001
min53.785-53.789=-0.004
max54.955-54.958=-0.003
mean418.000-417.200=0.800
σ0.000-0.632=-0.632
min418.000-417.000=1.000
max418.000-419.000=-1.000
mean0.139-0.139=-0.000
σ0.004-0.004=-0.000
min0.135-0.135=0.000
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.140-43.140=0.000
σ0.005-0.006=-0.001
min43.130-43.128=0.002
max43.149-43.152=-0.004
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.120-0.122=-0.001
σ0.004-0.003=0.001
min0.116-0.119=-0.003
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.067-992.068=-0.000
σ1.296-1.265=0.031
min991.514-991.522=-0.008
max997.528-997.395=0.133
mean1069.100-1070.200=-1.100
σ319.812-322.580=-2.769
min575.000-576.000=-1.000
max1649.000-1637.000=12.000
mean1.549-1.526=0.024
σ0.126-0.084=0.042
min1.460-1.391=0.069
max2.040-1.766=0.275

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.677-285.678=-0.001
σ0.007-0.010=-0.003
min285.667-285.666=0.001
max285.685-285.689=-0.004
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.376-0.376=0.001
σ0.001-0.002=-0.001
min0.375-0.374=0.001
max0.378-0.378=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.615-1285.621=-0.006
σ0.076-0.096=-0.020
min1285.572-1285.573=-0.001
max1285.750-1285.792=-0.043
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean1.933-1.921=0.012
σ0.166-0.134=0.032
min1.846-1.812=0.035
max2.230-2.149=0.081
iters=5
new-facts=6402
prior-facts=1
mean1808.011-1807.989=0.022
σ6.982-7.012=-0.030
min1804.627-1804.608=0.019
max1820.486-1820.517=-0.030
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean4.362-4.266=0.096
σ0.334-0.247=0.087
min4.000-3.954=0.046
max4.901-4.580=0.321
iters=5
new-facts=6402
prior-facts=6402
mean2070.466-2070.466=0.000
σ0.012-0.011=0.001
min2070.451-2070.457=-0.006
max2070.485-2070.486=-0.001
mean1870.600-1838.200=32.400
σ196.070-174.996=21.073
min1649.000-1637.000=12.000
max2092.000-2074.000=18.000
mean4.551-4.511=0.040
σ0.127-0.042=0.085
min4.468-4.476=-0.008
max4.775-4.570=0.205

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.276-1.192=0.085
σ0.342-0.306=0.036
min0.910-0.908=0.002
max1.824-1.695=0.129

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.382-437.386=-0.004
σ572.361-572.360=0.001
min151.191-151.201=-0.010
max1295.923-1295.926=-0.002
mean90.250
σ8.500
min86.000
max103.000
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.526-0.525=0.001
σ0.528-0.538=-0.010
min0.259-0.252=0.007
max1.318-1.332=-0.014
policies=20
mean1512.217-1512.214=0.003
σ0.262-0.248=0.014
min1512.044-1512.056=-0.012
max1512.606-1512.583=0.023
mean860.000
σ0.000
min860.000
max860.000
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean2.547-2.535=0.013
σ0.022-0.039=-0.018
min2.523-2.504=0.019
max2.572-2.590=-0.018
policies=200
mean15129.729-15129.704=0.025
σ0.082-0.040=0.042
min15129.622-15129.646=-0.024
max15129.796-15129.733=0.063
mean8600.000
σ0.000
min8600.000
max8600.000
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean25.560-25.645=-0.085
σ0.120-0.144=-0.024
min25.398-25.514=-0.116
max25.680-25.824=-0.145