Compare commits

Home / Compare 38a51d2a .. 98f04c36

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.913-53.913=0.000
σ0.366-0.369=-0.003
min53.774-53.786=-0.012
max54.954-54.963=-0.009
mean415.000
σ0.000
min415.000
max415.000
mean0.138-0.136=0.002
σ0.004-0.004=-0.000
min0.132-0.130=0.003
max0.145-0.142=0.002
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.002
σ0.007-0.007=0.000
min43.132-43.131=0.001
max43.156-43.152=0.004
mean415.700-415.000=0.700
σ0.483-0.000=0.483
min415.000
max416.000-415.000=1.000
mean0.121-0.118=0.003
σ0.003-0.002=0.001
min0.118-0.114=0.004
max0.128-0.122=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.088-992.077=0.012
σ1.228-1.238=-0.010
min991.497-991.497=0.000
max997.233-997.282=-0.048
mean1063.950-1064.650=-0.700
σ315.164-319.932=-4.768
min602.000-604.000=-2.000
max1591.000-1623.000=-32.000
mean1.536-1.550=-0.014
σ0.088-0.087=0.001
min1.435-1.474=-0.039
max1.829-1.805=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.663-285.675=-0.012
σ0.017-0.008=0.010
min285.646-285.663=-0.017
max285.690-285.682=0.007
mean1591.000-1623.000=-32.000
σ0.000
min1591.000-1623.000=-32.000
max1591.000-1623.000=-32.000
mean0.377-0.379=-0.002
σ0.003-0.009=-0.006
min0.375-0.373=0.002
max0.381-0.394=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1285.644-1285.635=0.009
σ0.137-0.129=0.008
min1285.576-1285.571=0.005
max1285.889-1285.866=0.023
mean1591.000-1623.000=-32.000
σ0.000
min1591.000-1623.000=-32.000
max1591.000-1623.000=-32.000
mean1.950-1.869=0.081
σ0.148-0.030=0.117
min1.838-1.846=-0.007
max2.189-1.921=0.268
iters=5
new-facts=6402
prior-facts=1
mean1807.992-1807.970=0.023
σ7.001-6.991=0.010
min1804.651-1804.620=0.031
max1820.501-1820.461=0.040
mean1591.000-1623.000=-32.000
σ0.000
min1591.000-1623.000=-32.000
max1591.000-1623.000=-32.000
mean4.235-4.172=0.063
σ0.200-0.131=0.069
min3.971-4.009=-0.038
max4.533-4.349=0.184
iters=5
new-facts=6402
prior-facts=6402
mean2070.466-2070.462=0.004
σ0.011-0.014=-0.003
min2070.452-2070.445=0.008
max2070.482-2070.482=0.000
mean1827.400-1856.000=-28.600
σ183.360-203.924=-20.564
min1603.000-1623.000=-20.000
max2070.000-2091.000=-21.000
mean4.526-4.558=-0.032
σ0.050-0.160=-0.110
min4.457-4.426=0.031
max4.574-4.824=-0.250

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.219-1.322=-0.103
σ0.256-0.409=-0.153
min0.915-0.915=-0.000
max1.577-1.792=-0.215

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.391-437.385=0.006
σ572.362-572.364=-0.002
min151.202-151.198=0.003
max1295.934-1295.931=0.002
mean90.250
σ8.500
min86.000
max103.000
mean1591.000-1623.000=-32.000
σ0.000
min1591.000-1623.000=-32.000
max1591.000-1623.000=-32.000
mean0.537-0.548=-0.011
σ0.569-0.592=-0.024
min0.248-0.249=-0.001
max1.390-1.436=-0.046
policies=20
mean1512.251-1512.197=0.054
σ0.239-0.232=0.007
min1512.100-1512.042=0.058
max1512.607-1512.542=0.065
mean860.000
σ0.000
min860.000
max860.000
mean1591.000-1623.000=-32.000
σ0.000
min1591.000-1623.000=-32.000
max1591.000-1623.000=-32.000
mean2.522-2.504=0.018
σ0.010-0.005=0.005
min2.511-2.500=0.010
max2.535-2.512=0.024
policies=200
mean15130.071-15129.572=0.500
σ0.185-0.144=0.041
min15129.832-15129.435=0.397
max15130.278-15129.769=0.509
mean8600.000
σ0.000
min8600.000
max8600.000
mean1591.000-1623.000=-32.000
σ0.000
min1591.000-1623.000=-32.000
max1591.000-1623.000=-32.000
mean25.659-25.589=0.071
σ0.252-0.070=0.182
min25.387-25.528=-0.141
max25.958-25.655=0.303